-- Logs begin at Thu 2022-07-21 07:46:14 UTC, end at Thu 2022-07-21 09:24:55 UTC. -- Jul 21 08:18:05.791314 dv-cinder-850318-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 21 08:18:05.801201 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 21 08:18:05.803246 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 08:18:05 2022] *** Jul 21 08:18:05.803246 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 08:18:05.803246 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 08:18:05.803246 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: nodename: dv-cinder-850318-4-iscsi Jul 21 08:18:05.803246 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: machine: x86_64 Jul 21 08:18:05.803246 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: clock source: unix Jul 21 08:18:05.803246 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: pcre jit disabled Jul 21 08:18:05.803246 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: detected number of CPU cores: 4 Jul 21 08:18:05.803246 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: current working directory: / Jul 21 08:18:05.803246 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: detected binary path: /usr/bin/uwsgi-core Jul 21 08:18:05.803929 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: your processes number limit is 47680 Jul 21 08:18:05.803929 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: your memory page size is 4096 bytes Jul 21 08:18:05.803929 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: detected max file descriptor number: 2048 Jul 21 08:18:05.803929 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: lock engine: pthread robust mutexes Jul 21 08:18:05.803929 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: thunder lock: enabled Jul 21 08:18:05.803929 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 21 08:18:05.803929 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 08:18:05.847024 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: Python main interpreter initialized at 0x5653a3abf9c0 Jul 21 08:18:05.847024 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: python threads support enabled Jul 21 08:18:05.847024 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: your server socket listen backlog is limited to 100 connections Jul 21 08:18:05.847024 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: your mercy for graceful operations on workers is 90 seconds Jul 21 08:18:05.847350 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 08:18:05.847456 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: *** Operational MODE: preforking *** Jul 21 08:18:05.847726 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: *** uWSGI is running in multiple interpreter mode *** Jul 21 08:18:05.847726 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: spawned uWSGI master process (pid: 80249) Jul 21 08:18:05.847912 dv-cinder-850318-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 21 08:18:05.848971 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: spawned uWSGI worker 1 (pid: 80261, cores: 1) Jul 21 08:18:05.848971 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: spawned uWSGI worker 2 (pid: 80262, cores: 1) Jul 21 08:18:05.848971 dv-cinder-850318-4-iscsi devstack@keystone.service[80249]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 08:18:11.303473 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 08:18:11.303473 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: from cryptography.utils import int_from_bytes Jul 21 08:18:11.304410 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 08:18:11.304410 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: from cryptography.utils import int_from_bytes Jul 21 08:18:11.304952 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 08:18:11.304952 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: from cryptography.utils import int_from_bytes Jul 21 08:18:11.305475 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 08:18:11.305475 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: from cryptography.utils import int_from_bytes Jul 21 08:18:11.363756 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 08:18:11.363946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 08:18:11.364145 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] command line args: [] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 08:18:11.364417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 08:18:11.364598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ================================================================================ {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 08:18:11.364856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] admin_token = **** {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.365105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] config_dir = [] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.365297 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.365483 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] config_source = [] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.365708 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] debug = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.365794 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 08:18:11.365941 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.366204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 08:18:11.366204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] command line args: [] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 08:18:11.366314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.366453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 08:18:11.366531 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.366630 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ================================================================================ {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 08:18:11.366783 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.366889 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] admin_token = **** {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.367191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.367318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] config_dir = [] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.367429 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] list_limit = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.367532 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.367639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] log_config_append = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.367741 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] config_source = [] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.367837 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.367932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] debug = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.368033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] log_dir = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.368139 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.368244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] log_file = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.368329 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.368407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.368524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.368605 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.368684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.368797 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.368874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.369049 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.369169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] list_limit = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.369282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.369404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] log_config_append = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.369550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.369681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.369681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] log_dir = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.369895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.370009 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] log_file = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.370129 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.370250 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.370370 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.370488 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.370607 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.370727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.370847 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.370961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.371082 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.371200 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.371200 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.371421 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.371546 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.371667 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.371785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.371899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.372014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.372014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.372254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.372367 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.372367 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] publish_errors = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.372594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.372711 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.372824 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.372936 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.373047 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.373167 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.373328 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.373451 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.373451 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.373679 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.373804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] standard_threads = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.373923 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] publish_errors = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.374036 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.374166 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.374291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.374411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.374530 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.374649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.374852 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] use_journal = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.375463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.375585 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] use_json = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.375585 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] use_stderr = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.375802 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.375915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] use_syslog = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.376026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] standard_threads = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.376144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.376269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.376389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.376508 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.376508 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.376717 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.376835 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] use_journal = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.377024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.377140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] use_json = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.377140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] use_stderr = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.377350 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.377462 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] use_syslog = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.377601 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.377734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 08:18:11.377855 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.377975 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.378095 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.378207 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.378332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.378458 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.378572 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.378685 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.378804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.378917 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.379029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.379149 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.379263 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.379382 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.379496 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.379608 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.379719 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.379840 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.379954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.380071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.380185 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.380297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.380425 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.380548 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.380662 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.380774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.380892 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.381012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.381133 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.381253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.381367 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.381479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.381620 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.381734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.381734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.381958 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.382069 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.382187 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.382300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.382417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.382602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.382718 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.382836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.382957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.382957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.383174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.383304 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.383425 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.383544 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.383658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.383770 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.383882 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.384001 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.384115 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.384226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.384344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.384344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.384560 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.384683 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.384797 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.384908 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.385026 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.385138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.385250 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.385372 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.385486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.385609 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.385733 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.385831 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.385924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.386026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.386123 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.386216 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.386317 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.386451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.386557 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.386662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.386767 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.386889 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.387040 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.387148 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.387266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.387389 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.387494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.387604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.387717 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.387846 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.387970 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.388097 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.388214 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.388335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.388457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.388571 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.388684 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.388798 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.388920 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.389025 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.389142 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.389257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.389360 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.389478 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.389652 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.389769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.389884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.389997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.390110 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.390229 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.390356 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.390467 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.390580 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.390693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.390806 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.390920 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.391042 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.391157 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.391270 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.391391 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.391391 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.391617 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.391738 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.391853 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.391974 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.392088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.392200 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.392321 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.392443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.392557 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.392676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.392790 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.392903 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.393017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.393137 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.393252 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.393365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.393478 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.393604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.393718 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.393910 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.394027 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.394142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.394261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.394376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.394489 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.394610 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.394730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.394845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.394964 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.395079 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.395193 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.395326 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.395453 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.395568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.395688 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.395809 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.395930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.396044 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.396166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.396287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.396402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.396504 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.396616 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.396730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.396854 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.396969 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.397082 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.397196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.397308 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.397421 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.397591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.397709 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.397823 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.397937 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.398050 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.398197 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.398323 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.398439 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.398552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.398664 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.398778 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.398890 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.399011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.399133 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.399247 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.399362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.399475 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.399588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.399708 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.399823 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.399936 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.400049 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.400049 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.400261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.400383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.400498 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.400611 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.400724 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.400837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.400950 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.401071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.401187 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.401299 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.401423 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] auth.external = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.401551 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.401668 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.401784 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.401784 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] auth.external = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.401997 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.402112 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.402252 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.402376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.402495 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] auth.password = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.402609 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.402730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] auth.token = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.402852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] auth.password = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.402968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.403082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] auth.token = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.403197 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.403310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.403432 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.403556 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.403677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.403792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.403906 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.404020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.404142 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.404259 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.404373 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.404487 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.404601 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] credential.caching = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.404715 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.404837 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.404953 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] credential.caching = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.405066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.405188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.405304 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.405418 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.405589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.405721 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.405838 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.405952 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.406066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.406181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.406181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.406412 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.406527 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.406643 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.406757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.406872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.407003 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.407126 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.407242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.407357 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.407479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.407669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.407787 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.407903 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.408017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.408131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.408246 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.408368 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.408484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.408600 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] federation.caching = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.408714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] federation.caching = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.408837 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.408953 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.409077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.409193 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.409314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.409430 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.409559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.409675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.409803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.409921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.410037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.410151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.410266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.410380 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.410503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.410619 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.410735 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.410850 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.410965 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.411079 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.411201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.411320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.411436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] identity.caching = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.411550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] identity.caching = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.411664 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.411779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.411902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.412024 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.412139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.412254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.412369 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.412489 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.412616 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.412732 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.412847 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.412962 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.413077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.413191 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.413313 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.413429 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.413589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.413708 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.413708 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.413934 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.414062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.414179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.414294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.414407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.414521 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.414636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.414758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.414874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.414989 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.415103 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.415217 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.415332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.415459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.415575 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.415690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.415804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.415925 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.416048 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.416165 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.416280 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.416394 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.416508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.416621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.416733 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.416848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.416962 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.417076 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.417191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.417305 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.417427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.417561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.417688 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.417805 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.417919 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.418034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.418156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.418274 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.418394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.418510 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.418624 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.418738 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.418860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.418977 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.419092 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.419206 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.419320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.419435 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.419557 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.419673 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.419787 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.419902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.420016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.420130 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.420252 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.420369 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.420483 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.420596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.420710 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.420825 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.420946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.421062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.421176 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.421293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.421409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.421568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.421568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.422303 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.422421 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.422535 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.422649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.422764 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.422889 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.423006 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.423120 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.423233 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.423347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.423462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.423588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.423704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.423818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.user = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.423933 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.424047 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.424161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.user = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.424282 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.424398 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.424513 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.424627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.424741 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.424855 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.424977 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.425093 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.425206 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.425320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.425434 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.425566 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.425695 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.425813 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.425927 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.426041 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.426155 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.426269 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.426391 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.426548 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.426666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.426780 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.426894 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.427008 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.427130 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.427247 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.427362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.427476 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.427590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.427704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.427826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.427943 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.428057 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.428171 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.428285 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.428398 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.428520 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.428636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.428750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.428750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.428963 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.429077 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.429200 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.429316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.429430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.429430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.429665 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.429665 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.429892 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.430009 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.430122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.430236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.430349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.430463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.430650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.430769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.430883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.430996 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.431110 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.431234 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.431359 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.431475 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.431588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.431702 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.431816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.431938 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.432054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.432167 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.432280 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.432394 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] resource.caching = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.432506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.432628 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.432743 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.432858 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.432972 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] resource.caching = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.433091 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.433207 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.433328 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.433444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.433607 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.433723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.433837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.433952 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.434078 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.434196 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.434310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.434424 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.434538 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.434652 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.434773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] role.caching = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.434889 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.435004 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] role.driver = sql {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.435118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.435231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.435345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] role.caching = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.435466 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.435582 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] role.driver = sql {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.435695 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.435809 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.435923 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.436037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.436159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.436274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.436388 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.436502 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.436615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.436729 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.436851 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.436966 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.437080 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.437193 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.437941 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.438063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.438192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.438311 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.438425 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.438539 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.438653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.438768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.438891 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.439007 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.439122 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.439237 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.439351 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.439472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.439596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.439596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.439814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.439928 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.440042 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.440164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.440282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.440398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.440512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.440626 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.440740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.440867 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.440984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.441098 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.441217 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.441332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.441446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.441589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.441708 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.441822 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.441936 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.442050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.442164 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.442287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.442404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.442518 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.442632 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.442746 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.442861 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.442983 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.443100 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.443214 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.443329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.443443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] token.caching = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.443557 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.443679 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.443795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.443909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.444024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.444138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.444252 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] token.caching = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.444375 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.444492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.444605 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.444719 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.444833 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.444948 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.445069 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.445186 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.445300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.445415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.445546 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.445664 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.445790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.445907 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.446022 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.446136 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.446249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.446363 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.446487 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.446604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.446717 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.446832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.446945 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.447059 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.447182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.447298 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.447411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.447527 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.447640 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] database.connection = **** {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.447762 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.447887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.448011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.448126 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.448126 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.448375 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.448490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.448604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] database.connection = **** {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.448731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.448855 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.448979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.449096 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.449210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.449332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.449447 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.449618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.449812 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.449931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.450045 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.450166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.450282 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.450396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.450520 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.450636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.450752 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.450867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.450981 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.451095 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.451222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.451338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.451453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.451567 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.451680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.451795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.451918 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.452034 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.452149 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 08:18:11.452264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.452264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.452264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.452264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 08:18:11.452264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 08:18:11.480459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.480688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.480911 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.481704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.481942 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.482168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.489827 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.491066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.519669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.519899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.520273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.520504 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.661445 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.662498 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.710860 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.710985 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.711098 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.711184 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.775426 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.775655 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.775753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.775879 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.776001 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.776106 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.776190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.776299 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.776383 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.776514 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.776608 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.776746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.802470 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.802593 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.802723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.802831 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.802910 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.803059 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.803143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.803337 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.803419 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.803552 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.803636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.803768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.803849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.804087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.814822 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.814992 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.827467 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.827681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.827773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.827933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.828042 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.828156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.828242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.828373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.828455 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.828588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.828672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.828800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.828880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80262) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.829014 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80261) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 08:18:11.846336 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.846546 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 08:18:11.846824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.846909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.847036 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 08:18:11.847154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 08:18:11.847336 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.847418 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.847556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 08:18:11.847638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.847826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.847918 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.848075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.848156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.848331 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.848586 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.859965 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.860237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.860500 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.860582 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.860776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.860860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.861068 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.861348 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.868837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:11.869429 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80261) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:11.872095 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:11.872368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.872643 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.872726 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80261) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:11.872972 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.873053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.873252 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.873336 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.873556 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.873664 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.873814 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.873950 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.874081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.874213 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.874345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.874484 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.874611 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.874785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.874924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.875056 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.875328 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.875596 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.901182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.901840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.902821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:11.903096 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.903455 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80261) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:11.903737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.908822 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:11.909095 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.909371 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.909495 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80261) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:11.909797 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.910074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.916608 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:11.916847 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.917294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80261) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:11.917601 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.921410 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:11.922299 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.922578 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.922722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80261) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:11.922853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.923008 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.923122 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.923287 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.923387 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.923567 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.923648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.923843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.923925 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.924114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.924378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.924640 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.942319 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.942588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.943210 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.943487 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.947398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:11.948136 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80261) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:11.951005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.951292 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.951780 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.952073 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.957877 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:11.959247 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80261) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:11.962525 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:11.963780 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80261) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:11.966297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.966592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.966881 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.967165 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.967433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.967554 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.967760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.967852 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.968140 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.968423 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.969215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.969492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.988242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:11.988615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.988891 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.989158 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.989390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80261) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:11.989799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.990076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.990348 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.997008 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.998257 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.998728 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.998998 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:11.999991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.000264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.002155 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:12.002432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.002707 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.002982 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.003269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.003350 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80261) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:12.003613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.003918 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.004198 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.004526 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.016575 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:12.016853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.017128 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.017401 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.017703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.017906 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80261) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:12.018003 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.018186 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.018269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.018465 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.018744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.019023 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.019317 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.019591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.037746 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:12.039234 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80261) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:12.040975 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:12.042518 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80261) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:12.044260 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.045843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.045933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.047993 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.048082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:12.048356 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.048634 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.049653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80261) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:12.049934 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.050215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.056036 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.057653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:12.057738 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.059277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80261) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:12.060832 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.061124 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.061404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.061708 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.062551 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.062839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.063123 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.063400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.070860 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:12.071140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.071409 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.072599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80261) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:12.072881 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.073155 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.079756 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80262) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:12.080035 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.080307 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.080574 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.080834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.081105 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.081371 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.081552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80261) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 08:18:12.081650 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.081831 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.081914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.082110 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.082191 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.082381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.082463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.082646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.082727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.082905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.082994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.083167 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80262) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.083248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.083446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.083713 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.083979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.084252 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.084511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.084780 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.085043 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80261) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 08:18:12.121408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5653a3abf9c0 pid: 80262 (default app) Jul 21 08:18:12.123637 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5653a3abf9c0 pid: 80261 (default app) Jul 21 08:18:12.124714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7be2a4-3c09-4b15-8e0a-4ddd238e32a6 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:12.125093 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7be2a4-3c09-4b15-8e0a-4ddd238e32a6 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:12.125372 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7be2a4-3c09-4b15-8e0a-4ddd238e32a6 None None] PATH_INFO: `/v3` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:12.129553 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Thu Jul 21 08:18:12 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:20.598643 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8eaea6-96ed-4810-9e53-503262bd9b51 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:20.599209 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8eaea6-96ed-4810-9e53-503262bd9b51 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:20.599209 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8eaea6-96ed-4810-9e53-503262bd9b51 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:20.603789 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1/2] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:20.609099 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7947530-e1f8-4c2a-9ab7-0370787a9ac2 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:20.609496 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7947530-e1f8-4c2a-9ab7-0370787a9ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:20.609696 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7947530-e1f8-4c2a-9ab7-0370787a9ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:20.680712 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: INFO dbcounter [None req-f7947530-e1f8-4c2a-9ab7-0370787a9ac2 None None] Registered counter for database keystone Jul 21 08:18:20.702351 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG oslo_db.sqlalchemy.engines [None req-f7947530-e1f8-4c2a-9ab7-0370787a9ac2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80262) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:18:20.709024 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writer thread running {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:18:20.883408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG passlib.handlers.bcrypt [None req-f7947530-e1f8-4c2a-9ab7-0370787a9ac2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80262) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 08:18:20.883846 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG passlib.handlers.bcrypt [None req-f7947530-e1f8-4c2a-9ab7-0370787a9ac2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80262) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 08:18:20.937959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-f7947530-e1f8-4c2a-9ab7-0370787a9ac2 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:20.939553 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f7947530-e1f8-4c2a-9ab7-0370787a9ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:21.066614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 08:18:21.278928 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8eaea6-96ed-4810-9e53-503262bd9b51 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:21.349486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: INFO dbcounter [None req-9e8eaea6-96ed-4810-9e53-503262bd9b51 None None] Registered counter for database keystone Jul 21 08:18:21.373833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG oslo_db.sqlalchemy.engines [None req-9e8eaea6-96ed-4810-9e53-503262bd9b51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80261) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 08:18:21.380737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writer thread running {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 08:18:21.498931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8eaea6-96ed-4810-9e53-503262bd9b51 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:21.503404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dcfeb-2d01-4d56-a1ab-90973b35a70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:21.504072 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dcfeb-2d01-4d56-a1ab-90973b35a70c admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:21.504363 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dcfeb-2d01-4d56-a1ab-90973b35a70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:21.504646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dcfeb-2d01-4d56-a1ab-90973b35a70c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:21.512845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725dcfeb-2d01-4d56-a1ab-90973b35a70c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:21.565488 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: WARNING keystone.common.rbac_enforcer.enforcer [None req-725dcfeb-2d01-4d56-a1ab-90973b35a70c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 08:18:21.565807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725dcfeb-2d01-4d56-a1ab-90973b35a70c admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:21.575399 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1324 bytes} [Thu Jul 21 08:18:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:18:21.581435 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7947530-e1f8-4c2a-9ab7-0370787a9ac2 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:21.596293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7947530-e1f8-4c2a-9ab7-0370787a9ac2 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:21.600734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f6e03-8033-4934-b403-0bf9cc99d7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:21.601888 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f6e03-8033-4934-b403-0bf9cc99d7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:21.602179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f6e03-8033-4934-b403-0bf9cc99d7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:21.602460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f6e03-8033-4934-b403-0bf9cc99d7c8 admin admin] PATH_INFO: `/v3/projects/735f219fa6204590a96733afe606902c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:21.606826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f6e03-8033-4934-b403-0bf9cc99d7c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=735f219fa6204590a96733afe606902c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:21.657938 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c76f6e03-8033-4934-b403-0bf9cc99d7c8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 08:18:21.658520 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f6e03-8033-4934-b403-0bf9cc99d7c8 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:21.662869 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 3/5] 10.222.0.57 () {56 vars in 1207 bytes} [Thu Jul 21 08:18:21 2022] GET /identity/v3/projects/735f219fa6204590a96733afe606902c => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:23.666387 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc7433-6a1b-489c-85c6-3b5843e4d300 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:23.666930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc7433-6a1b-489c-85c6-3b5843e4d300 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:23.666930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc7433-6a1b-489c-85c6-3b5843e4d300 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:23.671541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 3/6] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:23.676898 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d7c4b-6137-46ff-ad25-bf22f3a84969 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:23.677326 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d7c4b-6137-46ff-ad25-bf22f3a84969 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:23.677506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d7c4b-6137-46ff-ad25-bf22f3a84969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:23.698522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-896d7c4b-6137-46ff-ad25-bf22f3a84969 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:23.700037 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-896d7c4b-6137-46ff-ad25-bf22f3a84969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:23.713034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 08:18:23.736602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc7433-6a1b-489c-85c6-3b5843e4d300 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:23.748734 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc7433-6a1b-489c-85c6-3b5843e4d300 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:23.752952 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d224a8-89e5-4860-acd4-1d0ccc98ce7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:23.753618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d224a8-89e5-4860-acd4-1d0ccc98ce7d admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:23.754349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d224a8-89e5-4860-acd4-1d0ccc98ce7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:23.754349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d224a8-89e5-4860-acd4-1d0ccc98ce7d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:23.761904 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d224a8-89e5-4860-acd4-1d0ccc98ce7d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:23.763695 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d224a8-89e5-4860-acd4-1d0ccc98ce7d admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:23.772407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1324 bytes} [Thu Jul 21 08:18:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:18:23.777918 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d7c4b-6137-46ff-ad25-bf22f3a84969 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:23.787354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d7c4b-6137-46ff-ad25-bf22f3a84969 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:23.791699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a473d69-014a-4bc1-99c5-0b6b3719f746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:23.792552 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a473d69-014a-4bc1-99c5-0b6b3719f746 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:23.792835 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a473d69-014a-4bc1-99c5-0b6b3719f746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:23.793111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a473d69-014a-4bc1-99c5-0b6b3719f746 admin admin] PATH_INFO: `/v3/users/1854e64df6074ad496a8d7112fa61f3e` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:23.794530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a473d69-014a-4bc1-99c5-0b6b3719f746 admin admin] RBAC: Authorizing `identity:get_user(user_id=1854e64df6074ad496a8d7112fa61f3e)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:23.796956 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a473d69-014a-4bc1-99c5-0b6b3719f746 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:23.798540 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 5/9] 10.222.0.57 () {56 vars in 1198 bytes} [Thu Jul 21 08:18:23 2022] GET /identity/v3/users/1854e64df6074ad496a8d7112fa61f3e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:25.877905 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f44c34-2453-4fca-914d-651e55fd9de5 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:25.878435 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f44c34-2453-4fca-914d-651e55fd9de5 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:25.878435 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f44c34-2453-4fca-914d-651e55fd9de5 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:25.879800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 5/10] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:25.885723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ac785-a57f-4b4d-9050-c0aab8a90eeb None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:25.886238 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ac785-a57f-4b4d-9050-c0aab8a90eeb None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:25.886414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ac785-a57f-4b4d-9050-c0aab8a90eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:25.902735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-b67ac785-a57f-4b4d-9050-c0aab8a90eeb None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:25.903888 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b67ac785-a57f-4b4d-9050-c0aab8a90eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:25.938836 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b695277-b5d1-4542-bb40-ca3b99d23e6d None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:25.939218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b695277-b5d1-4542-bb40-ca3b99d23e6d None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:25.939572 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b695277-b5d1-4542-bb40-ca3b99d23e6d None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:25.940989 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 6/11] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:25.945909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752cd3b-634d-4c4f-9839-350e1e550b5d None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:25.946198 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752cd3b-634d-4c4f-9839-350e1e550b5d None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:25.946480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752cd3b-634d-4c4f-9839-350e1e550b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:25.986079 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 6/12] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:18:25.986354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG passlib.handlers.bcrypt [None req-b752cd3b-634d-4c4f-9839-350e1e550b5d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80261) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 08:18:25.986722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG passlib.handlers.bcrypt [None req-b752cd3b-634d-4c4f-9839-350e1e550b5d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80261) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 08:18:26.008836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ac785-a57f-4b4d-9050-c0aab8a90eeb None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:26.032857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-b752cd3b-634d-4c4f-9839-350e1e550b5d None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:26.033950 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:26.034496 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b752cd3b-634d-4c4f-9839-350e1e550b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:26.113201 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ac785-a57f-4b4d-9050-c0aab8a90eeb None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:26.133267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 7/13] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:18:26.146291 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6343a-4eec-449f-a0dd-8f8dd3f93525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:26.147084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6343a-4eec-449f-a0dd-8f8dd3f93525 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:26.147367 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6343a-4eec-449f-a0dd-8f8dd3f93525 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:26.147665 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6343a-4eec-449f-a0dd-8f8dd3f93525 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:26.154689 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752cd3b-634d-4c4f-9839-350e1e550b5d None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:26.159269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a6343a-4eec-449f-a0dd-8f8dd3f93525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:26.170381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-05a6343a-4eec-449f-a0dd-8f8dd3f93525 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:26.170381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:26.170381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:26.170381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:26.170381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:26.170381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:26.170381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:26.170381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:26.170381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:26.170381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:26.170381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:26.170381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:26.170381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:26.170381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:26.170381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:26.170381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:26.171958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:26.171958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:26.171958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:26.171958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:26.171958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:26.171958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:26.171958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:26.171958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:26.171958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:26.171958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:26.171958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:26.171958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:26.171958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:26.171958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:26.171958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:26.171958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:26.172968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:26.172968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:26.172968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:26.172968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:26.172968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:26.172968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:26.172968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:26.172968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:26.172968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:26.172968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:26.172968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:26.172968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:18:26.172968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 7/14] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:18:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:18:26.178018 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6343a-4eec-449f-a0dd-8f8dd3f93525 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:26.254996 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752cd3b-634d-4c4f-9839-350e1e550b5d None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:26.257243 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:26.258906 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:26.275674 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6343a-4eec-449f-a0dd-8f8dd3f93525 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:26.291874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cdab5-422b-4b46-91ce-c1cbc4d266e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:26.292779 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cdab5-422b-4b46-91ce-c1cbc4d266e3 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:26.293066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cdab5-422b-4b46-91ce-c1cbc4d266e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:26.293346 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cdab5-422b-4b46-91ce-c1cbc4d266e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:26.311768 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c6bdd-931e-4597-88ef-d26e86cd4453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:26.312428 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c6bdd-931e-4597-88ef-d26e86cd4453 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:26.312711 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c6bdd-931e-4597-88ef-d26e86cd4453 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:26.312989 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c6bdd-931e-4597-88ef-d26e86cd4453 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:26.313768 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c6bdd-931e-4597-88ef-d26e86cd4453 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:26.314077 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c6bdd-931e-4597-88ef-d26e86cd4453 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:26.315478 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c6bdd-931e-4597-88ef-d26e86cd4453 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:26.326921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 8/15] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:26.333376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c6bdd-931e-4597-88ef-d26e86cd4453 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:26.362251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73cdab5-422b-4b46-91ce-c1cbc4d266e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:26.363818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73cdab5-422b-4b46-91ce-c1cbc4d266e3 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:26.431546 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c6bdd-931e-4597-88ef-d26e86cd4453 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:26.459674 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 8/16] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:18:26.464324 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bd0b9-5faa-4ce2-ac83-67b1fe24a6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:26.465189 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bd0b9-5faa-4ce2-ac83-67b1fe24a6ce None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:26.465482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bd0b9-5faa-4ce2-ac83-67b1fe24a6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:26.465795 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510bd0b9-5faa-4ce2-ac83-67b1fe24a6ce None admin] PATH_INFO: `/v3/users/1854e64df6074ad496a8d7112fa61f3e` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:26.465892 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cdab5-422b-4b46-91ce-c1cbc4d266e3 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:26.466999 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510bd0b9-5faa-4ce2-ac83-67b1fe24a6ce None admin] RBAC: Authorizing `identity:get_user(user_id=1854e64df6074ad496a8d7112fa61f3e)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:26.468487 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510bd0b9-5faa-4ce2-ac83-67b1fe24a6ce None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:26.468675 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:26.470125 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 9/17] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:26 2022] GET /identity/v3/users/1854e64df6074ad496a8d7112fa61f3e => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:26.475297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bd0b9-5faa-4ce2-ac83-67b1fe24a6ce None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:26.490719 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:26.562831 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cdab5-422b-4b46-91ce-c1cbc4d266e3 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:26.575299 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510bd0b9-5faa-4ce2-ac83-67b1fe24a6ce None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:26.595971 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076468b-323e-49fe-b46f-6943b55e4903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:26.596760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076468b-323e-49fe-b46f-6943b55e4903 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:26.597049 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076468b-323e-49fe-b46f-6943b55e4903 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:26.597321 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076468b-323e-49fe-b46f-6943b55e4903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:26.610012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b06f7-e42a-4dc5-a195-e7e225d8bd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:26.610791 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b06f7-e42a-4dc5-a195-e7e225d8bd3d None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:26.611075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b06f7-e42a-4dc5-a195-e7e225d8bd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:26.611349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b06f7-e42a-4dc5-a195-e7e225d8bd3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:26.612512 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b06f7-e42a-4dc5-a195-e7e225d8bd3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:26.613967 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b06f7-e42a-4dc5-a195-e7e225d8bd3d None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:26.615533 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 10/18] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:26.615649 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076468b-323e-49fe-b46f-6943b55e4903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:26.617027 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076468b-323e-49fe-b46f-6943b55e4903 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:26.621261 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b06f7-e42a-4dc5-a195-e7e225d8bd3d None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:26.639190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-d076468b-323e-49fe-b46f-6943b55e4903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:18:26.639190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:26.639190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:26.639190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:26.639190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:26.639190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:26.639190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:26.639190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:26.639190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:26.639190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:26.639190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:26.639190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:26.639190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:18:26.639190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:18:26.639190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:18:26.640570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:18:26.640570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:26.640570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:26.640570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:26.640570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:26.640570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:26.640570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:26.640570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:26.640570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:26.640570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:26.640570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:26.640570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:26.640570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:26.640570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:26.640570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:26.640570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:26.640570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:26.646514 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:18:26.646514 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:18:26.646514 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:18:26.646514 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:18:26.646514 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 9/19] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:18:26.646777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076468b-323e-49fe-b46f-6943b55e4903 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:26.700588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:26.701224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:26.720010 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b06f7-e42a-4dc5-a195-e7e225d8bd3d None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:26.744801 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076468b-323e-49fe-b46f-6943b55e4903 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:26.760549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec44300-a3e0-4f7f-9de1-287a10c04ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:26.761210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec44300-a3e0-4f7f-9de1-287a10c04ddf None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:26.761486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec44300-a3e0-4f7f-9de1-287a10c04ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:26.761793 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec44300-a3e0-4f7f-9de1-287a10c04ddf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:26.762623 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec44300-a3e0-4f7f-9de1-287a10c04ddf None admin] RBAC: Adding query filter params (role.id=beed8caad097496292e544146859df5c, scope.domain.id=default, user.id=1854e64df6074ad496a8d7112fa61f3e) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:26.762930 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec44300-a3e0-4f7f-9de1-287a10c04ddf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:26.764417 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec44300-a3e0-4f7f-9de1-287a10c04ddf None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:26.771682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 11/20] 10.222.0.57 () {56 vars in 1322 bytes} [Thu Jul 21 08:18:26 2022] GET /identity/v3/role_assignments?user.id=1854e64df6074ad496a8d7112fa61f3e&scope.domain.id=default&role.id=beed8caad097496292e544146859df5c => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:26.782580 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649874c-4ecd-4627-a632-ce357f9cbfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:26.783265 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649874c-4ecd-4627-a632-ce357f9cbfa2 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:26.783550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649874c-4ecd-4627-a632-ce357f9cbfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:26.783828 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649874c-4ecd-4627-a632-ce357f9cbfa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:26.784581 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649874c-4ecd-4627-a632-ce357f9cbfa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:26.784895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649874c-4ecd-4627-a632-ce357f9cbfa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:26.786419 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649874c-4ecd-4627-a632-ce357f9cbfa2 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:26.805943 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 10/21] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:29.052393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3a29e-4a57-4957-85e6-5cfe4d1c15fd None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:29.053854 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3a29e-4a57-4957-85e6-5cfe4d1c15fd None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:29.054607 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3a29e-4a57-4957-85e6-5cfe4d1c15fd None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:29.056680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 12/22] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:29.063003 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38678cec-5f66-4971-b7c8-2c6c39c13d1a None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:29.063898 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38678cec-5f66-4971-b7c8-2c6c39c13d1a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:29.064376 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38678cec-5f66-4971-b7c8-2c6c39c13d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:29.086871 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-38678cec-5f66-4971-b7c8-2c6c39c13d1a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:29.088388 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-38678cec-5f66-4971-b7c8-2c6c39c13d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:29.181919 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 11/23] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:29.220951 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3a29e-4a57-4957-85e6-5cfe4d1c15fd None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:29.355031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3a29e-4a57-4957-85e6-5cfe4d1c15fd None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:29.400448 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00083e8d-a6f4-4ee9-8da0-d8556d3edd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:29.401635 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00083e8d-a6f4-4ee9-8da0-d8556d3edd78 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:29.402149 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00083e8d-a6f4-4ee9-8da0-d8556d3edd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:29.402625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00083e8d-a6f4-4ee9-8da0-d8556d3edd78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:29.412218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0a29d-f40f-406a-807b-db88df2eacb0 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:29.412832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0a29d-f40f-406a-807b-db88df2eacb0 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:29.413318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0a29d-f40f-406a-807b-db88df2eacb0 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:29.415162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 12/24] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:29.422819 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00083e8d-a6f4-4ee9-8da0-d8556d3edd78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:29.423627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdf29c-f9b4-4f3c-ab13-8ccec322b03c None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:29.424125 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdf29c-f9b4-4f3c-ab13-8ccec322b03c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:29.424618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdf29c-f9b4-4f3c-ab13-8ccec322b03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:29.430584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-00083e8d-a6f4-4ee9-8da0-d8556d3edd78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:29.430584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:29.430584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:29.430584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:29.430584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:29.430584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:29.430584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:29.430584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:29.430584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:29.430584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:29.430584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:29.430584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:29.430584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:29.430584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:29.430584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:29.430584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:29.431424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:29.431424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:29.431424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:29.431424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:29.431424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:29.431424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:29.431424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:29.431424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:29.431424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:29.431424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:29.431424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:29.431424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:29.431424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:29.431424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:29.431424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:29.431424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:29.432181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:29.432181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:29.432181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:29.432181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:29.432181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:29.432181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:29.432181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:29.432181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:29.432181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:29.432181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:29.432181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:29.432181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:18:29.432181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 13/25] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:18:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:29.439044 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00083e8d-a6f4-4ee9-8da0-d8556d3edd78 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:29.447657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:29.451133 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-76fdf29c-f9b4-4f3c-ab13-8ccec322b03c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:29.452800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-76fdf29c-f9b4-4f3c-ab13-8ccec322b03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:29.536880 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:29.571769 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 13/26] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:29.573226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cb020-01a7-4b73-b9e4-b1a607d49cea None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:29.573539 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cb020-01a7-4b73-b9e4-b1a607d49cea None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:29.573821 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119cb020-01a7-4b73-b9e4-b1a607d49cea None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:29.575351 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 14/27] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:29.580471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f9811-d269-469f-a071-8bf1063a458e None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:29.580763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f9811-d269-469f-a071-8bf1063a458e None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:29.581043 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f9811-d269-469f-a071-8bf1063a458e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:29.601372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-981f9811-d269-469f-a071-8bf1063a458e None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:29.602840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-981f9811-d269-469f-a071-8bf1063a458e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:29.611327 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00083e8d-a6f4-4ee9-8da0-d8556d3edd78 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:29.650253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046b265-2f24-44d7-8067-56825214c614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:29.650930 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046b265-2f24-44d7-8067-56825214c614 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:29.651215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046b265-2f24-44d7-8067-56825214c614 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:29.651492 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046b265-2f24-44d7-8067-56825214c614 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:29.652252 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046b265-2f24-44d7-8067-56825214c614 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:29.652560 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046b265-2f24-44d7-8067-56825214c614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:29.653989 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046b265-2f24-44d7-8067-56825214c614 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:29.672128 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 14/28] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:29.673441 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046b265-2f24-44d7-8067-56825214c614 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:29.707636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 15/29] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:29.708597 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f9811-d269-469f-a071-8bf1063a458e None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:29.801402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:29.837860 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046b265-2f24-44d7-8067-56825214c614 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:29.867711 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f9811-d269-469f-a071-8bf1063a458e None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:29.874140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7364f86-5151-4631-aafe-03b3d10e79ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:29.874812 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7364f86-5151-4631-aafe-03b3d10e79ca None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:29.875098 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7364f86-5151-4631-aafe-03b3d10e79ca None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:29.875376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7364f86-5151-4631-aafe-03b3d10e79ca None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:29.876193 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7364f86-5151-4631-aafe-03b3d10e79ca None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:29.877644 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7364f86-5151-4631-aafe-03b3d10e79ca None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:29.878264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:29.906576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78a893-9700-432b-8f83-ae0b91cf9e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:29.907475 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78a893-9700-432b-8f83-ae0b91cf9e1d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:29.907774 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78a893-9700-432b-8f83-ae0b91cf9e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:29.908041 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78a893-9700-432b-8f83-ae0b91cf9e1d None admin] PATH_INFO: `/v3/users/1854e64df6074ad496a8d7112fa61f3e` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:29.909627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78a893-9700-432b-8f83-ae0b91cf9e1d None admin] RBAC: Authorizing `identity:get_user(user_id=1854e64df6074ad496a8d7112fa61f3e)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:29.911083 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78a893-9700-432b-8f83-ae0b91cf9e1d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:29.912895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 16/30] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:29 2022] GET /identity/v3/users/1854e64df6074ad496a8d7112fa61f3e => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:29.917861 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78a893-9700-432b-8f83-ae0b91cf9e1d None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:30.025122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78a893-9700-432b-8f83-ae0b91cf9e1d None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:30.063743 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82708f-1e15-421b-86ec-76837834b5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:30.065223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82708f-1e15-421b-86ec-76837834b5c0 None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:30.065739 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82708f-1e15-421b-86ec-76837834b5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:30.066218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82708f-1e15-421b-86ec-76837834b5c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:30.067178 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82708f-1e15-421b-86ec-76837834b5c0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:30.068844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82708f-1e15-421b-86ec-76837834b5c0 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:30.088838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 15/31] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Jul 21 08:18:29 2022] POST /identity/v3/roles => generated 225 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:30.088838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbad6f0-3e01-4a4e-b029-e21da10ad673 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:30.088838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbad6f0-3e01-4a4e-b029-e21da10ad673 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:30.088838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbad6f0-3e01-4a4e-b029-e21da10ad673 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:30.088838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 16/32] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:30.088838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbad6f0-3e01-4a4e-b029-e21da10ad673 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:30.231204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbad6f0-3e01-4a4e-b029-e21da10ad673 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:30.267655 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:30.279241 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302c4d5-a5df-4fe1-83d4-91ece437c127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:30.280997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302c4d5-a5df-4fe1-83d4-91ece437c127 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:30.281593 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302c4d5-a5df-4fe1-83d4-91ece437c127 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:30.282083 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302c4d5-a5df-4fe1-83d4-91ece437c127 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:30.283642 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302c4d5-a5df-4fe1-83d4-91ece437c127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:30.285543 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302c4d5-a5df-4fe1-83d4-91ece437c127 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:30.287432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 17/33] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:30.289051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e54ed-447e-4c9e-9de5-17e6614bbcbf None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:30.289561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e54ed-447e-4c9e-9de5-17e6614bbcbf None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:30.290040 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e54ed-447e-4c9e-9de5-17e6614bbcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:30.308896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-6c1e54ed-447e-4c9e-9de5-17e6614bbcbf None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:30.309185 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 17/34] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Jul 21 08:18:29 2022] POST /identity/v3/roles => generated 219 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:30.311132 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-6c1e54ed-447e-4c9e-9de5-17e6614bbcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:30.322758 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82708f-1e15-421b-86ec-76837834b5c0 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:30.398204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 18/35] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:30.414421 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:30.422897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e54ed-447e-4c9e-9de5-17e6614bbcbf None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:30.554113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82708f-1e15-421b-86ec-76837834b5c0 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:30.579818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e54ed-447e-4c9e-9de5-17e6614bbcbf None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:30.611245 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d63c2-b50c-4f40-a2ad-7bff983c0546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:30.612443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d63c2-b50c-4f40-a2ad-7bff983c0546 None admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:30.612942 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d63c2-b50c-4f40-a2ad-7bff983c0546 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:30.613202 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:30.614811 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d63c2-b50c-4f40-a2ad-7bff983c0546 None admin] PATH_INFO: `/v3/domains/default/users/1854e64df6074ad496a8d7112fa61f3e/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:30.617550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d63c2-b50c-4f40-a2ad-7bff983c0546 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1854e64df6074ad496a8d7112fa61f3e, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:30.619449 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d63c2-b50c-4f40-a2ad-7bff983c0546 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:30.631037 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54dda53-2460-430a-89bc-a6a541b0d591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:30.632193 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dda53-2460-430a-89bc-a6a541b0d591 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:30.632717 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dda53-2460-430a-89bc-a6a541b0d591 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:30.633226 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dda53-2460-430a-89bc-a6a541b0d591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:30.645755 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54dda53-2460-430a-89bc-a6a541b0d591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:30.647618 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54dda53-2460-430a-89bc-a6a541b0d591 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:30.669104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-d54dda53-2460-430a-89bc-a6a541b0d591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:18:30.669104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:30.669104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:30.669104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:30.669104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:30.669104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:30.669104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:30.669104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:30.669104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:30.669104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:30.669104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:30.669104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:30.669104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:18:30.669104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:18:30.669104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:18:30.670075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:18:30.670075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:30.670075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:30.670075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:30.670075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:30.670075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:30.670075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:30.670075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:30.670075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:30.670075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:30.670075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:30.670075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:30.670075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:30.670075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:30.670075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:30.670075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:30.670075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:30.670944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:18:30.670944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:18:30.670944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:18:30.670944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:18:30.672170 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 19/36] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:18:30.677881 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54dda53-2460-430a-89bc-a6a541b0d591 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:30.733609 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 18/37] 10.222.0.57 () {58 vars in 1361 bytes} [Thu Jul 21 08:18:30 2022] PUT /identity/v3/domains/default/users/1854e64df6074ad496a8d7112fa61f3e/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:18:30.735116 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db624a-adf8-4595-9a32-a758f562bda0 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:30.735420 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db624a-adf8-4595-9a32-a758f562bda0 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:30.735704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db624a-adf8-4595-9a32-a758f562bda0 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:30.741593 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 19/38] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:30.743722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6511-cbd7-40bf-a5f8-7aeeded4ed29 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:30.744074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6511-cbd7-40bf-a5f8-7aeeded4ed29 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:30.744413 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a6511-cbd7-40bf-a5f8-7aeeded4ed29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:30.768447 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-6d7a6511-cbd7-40bf-a5f8-7aeeded4ed29 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:30.770258 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-6d7a6511-cbd7-40bf-a5f8-7aeeded4ed29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:30.805929 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54dda53-2460-430a-89bc-a6a541b0d591 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:30.845150 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c9657-64fa-4291-9b5c-b1de3b687b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:30.845865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c9657-64fa-4291-9b5c-b1de3b687b61 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:30.846156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c9657-64fa-4291-9b5c-b1de3b687b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:30.846439 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c9657-64fa-4291-9b5c-b1de3b687b61 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:30.847184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c9657-64fa-4291-9b5c-b1de3b687b61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:30.847497 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c9657-64fa-4291-9b5c-b1de3b687b61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:30.848918 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797c9657-64fa-4291-9b5c-b1de3b687b61 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:30.856631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 20/39] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:18:30.870845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25d886-ab0c-47e6-85de-8710fc5deb64 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:30.871046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 20/40] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:30.871140 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25d886-ab0c-47e6-85de-8710fc5deb64 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:30.871422 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25d886-ab0c-47e6-85de-8710fc5deb64 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:30.872917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 21/41] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:30.879196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a203e-bb72-4560-ae71-05c33ad3fac0 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:30.879492 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a203e-bb72-4560-ae71-05c33ad3fac0 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:30.879809 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a203e-bb72-4560-ae71-05c33ad3fac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:30.882140 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25d886-ab0c-47e6-85de-8710fc5deb64 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:30.900492 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-3b4a203e-bb72-4560-ae71-05c33ad3fac0 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:30.901710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-3b4a203e-bb72-4560-ae71-05c33ad3fac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:30.911179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:30.934448 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:30.996410 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25d886-ab0c-47e6-85de-8710fc5deb64 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:31.035840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d6bf6-07c5-40b9-92b8-9099a24d0fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:31.036518 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d6bf6-07c5-40b9-92b8-9099a24d0fcb None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:31.036808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d6bf6-07c5-40b9-92b8-9099a24d0fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:31.037089 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d6bf6-07c5-40b9-92b8-9099a24d0fcb None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:31.037860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d6bf6-07c5-40b9-92b8-9099a24d0fcb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:31.039361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d6bf6-07c5-40b9-92b8-9099a24d0fcb None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:31.081348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 21/42] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:31.081975 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a203e-bb72-4560-ae71-05c33ad3fac0 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:31.174923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 22/43] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 08:18:30 2022] POST /identity/v3/projects => generated 301 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:31.175842 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d6bf6-07c5-40b9-92b8-9099a24d0fcb None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:31.201676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a203e-bb72-4560-ae71-05c33ad3fac0 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:31.250882 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25458b13-ca6d-4ab1-99a5-fd81d2ca70d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:31.252310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25458b13-ca6d-4ab1-99a5-fd81d2ca70d4 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:31.253457 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25458b13-ca6d-4ab1-99a5-fd81d2ca70d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:31.253990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25458b13-ca6d-4ab1-99a5-fd81d2ca70d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:31.256140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25458b13-ca6d-4ab1-99a5-fd81d2ca70d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:31.258957 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25458b13-ca6d-4ab1-99a5-fd81d2ca70d4 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:31.260953 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 22/44] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:31.266551 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25458b13-ca6d-4ab1-99a5-fd81d2ca70d4 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:31.277974 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:31.311059 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d6bf6-07c5-40b9-92b8-9099a24d0fcb None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:31.319449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:31.362385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c1617-9d04-464c-8160-70128d049e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:31.362576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c1617-9d04-464c-8160-70128d049e82 None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:31.362891 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c1617-9d04-464c-8160-70128d049e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:31.364122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c1617-9d04-464c-8160-70128d049e82 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:31.364938 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c1617-9d04-464c-8160-70128d049e82 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:31.366418 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c1617-9d04-464c-8160-70128d049e82 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:31.398910 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25458b13-ca6d-4ab1-99a5-fd81d2ca70d4 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:31.429762 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 23/45] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Jul 21 08:18:31 2022] POST /identity/v3/roles => generated 223 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:31.437044 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd829d8-30f8-455a-a97b-25780ad71b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:31.438132 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd829d8-30f8-455a-a97b-25780ad71b03 None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:31.438614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd829d8-30f8-455a-a97b-25780ad71b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:31.439084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd829d8-30f8-455a-a97b-25780ad71b03 None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:31.440030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd829d8-30f8-455a-a97b-25780ad71b03 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:31.441904 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd829d8-30f8-455a-a97b-25780ad71b03 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:31.528172 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 23/46] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 08:18:31 2022] POST /identity/v3/projects => generated 312 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:32.801904 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7681d07-ca45-4cd8-8431-560fd5dd32dd None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:32.802400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7681d07-ca45-4cd8-8431-560fd5dd32dd None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:32.802480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7681d07-ca45-4cd8-8431-560fd5dd32dd None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:32.803829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 24/47] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:32.809223 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c489421-ce7b-4ad0-8bfa-f3cba180d2d2 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:32.809618 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c489421-ce7b-4ad0-8bfa-f3cba180d2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:32.809946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c489421-ce7b-4ad0-8bfa-f3cba180d2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:32.826496 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-5c489421-ce7b-4ad0-8bfa-f3cba180d2d2 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:32.827744 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5c489421-ce7b-4ad0-8bfa-f3cba180d2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:32.892237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 24/48] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:32.915092 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7681d07-ca45-4cd8-8431-560fd5dd32dd None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:33.015390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7681d07-ca45-4cd8-8431-560fd5dd32dd None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:33.048076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe9633-44f1-4805-b3e9-8773491cfdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:33.048855 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe9633-44f1-4805-b3e9-8773491cfdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:33.049142 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe9633-44f1-4805-b3e9-8773491cfdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:33.049423 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe9633-44f1-4805-b3e9-8773491cfdc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:33.053037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:33.061411 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afe9633-44f1-4805-b3e9-8773491cfdc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:33.070276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-5afe9633-44f1-4805-b3e9-8773491cfdc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:33.070276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:33.070276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:33.070276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:33.070276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:33.070276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:33.070276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:33.070276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:33.070276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:33.070276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:33.070276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:33.070276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:33.070276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:33.070276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:33.070276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:33.070276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:33.071690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:33.071690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:33.071690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:33.071690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:33.071690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:33.071690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:33.071690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:33.071690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:33.071690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:33.071690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:33.071690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:33.071690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:33.071690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:33.071690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:33.071690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:33.071690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:33.072766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:33.072766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:33.072766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:33.072766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:33.072766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:33.072766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:33.072766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:33.072766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:33.072766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:33.072766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:33.072766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:33.072766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:18:33.072766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 25/49] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:18:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:33.077871 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c489421-ce7b-4ad0-8bfa-f3cba180d2d2 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:33.095971 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:33.174434 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c489421-ce7b-4ad0-8bfa-f3cba180d2d2 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:33.207600 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c004712-bb7f-499e-9c11-96140890d64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:33.208266 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c004712-bb7f-499e-9c11-96140890d64f None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:33.208549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c004712-bb7f-499e-9c11-96140890d64f None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:33.208825 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c004712-bb7f-499e-9c11-96140890d64f None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:33.209608 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c004712-bb7f-499e-9c11-96140890d64f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:33.209973 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c004712-bb7f-499e-9c11-96140890d64f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:33.211326 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c004712-bb7f-499e-9c11-96140890d64f None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:33.219747 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 25/50] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:33.225364 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe9633-44f1-4805-b3e9-8773491cfdc1 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:33.322402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe9633-44f1-4805-b3e9-8773491cfdc1 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:33.355741 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3d139-f56c-438c-af55-730a16acc974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:33.356605 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3d139-f56c-438c-af55-730a16acc974 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:33.356893 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3d139-f56c-438c-af55-730a16acc974 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:33.357174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3d139-f56c-438c-af55-730a16acc974 None admin] PATH_INFO: `/v3/users/1854e64df6074ad496a8d7112fa61f3e` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:33.358439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3d139-f56c-438c-af55-730a16acc974 None admin] RBAC: Authorizing `identity:get_user(user_id=1854e64df6074ad496a8d7112fa61f3e)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:33.359903 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3d139-f56c-438c-af55-730a16acc974 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:33.361567 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 26/51] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:33 2022] GET /identity/v3/users/1854e64df6074ad496a8d7112fa61f3e => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:33.366924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c004712-bb7f-499e-9c11-96140890d64f None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:33.444678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:33.466099 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c004712-bb7f-499e-9c11-96140890d64f None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:33.498602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c762da9-9017-4e98-ab5c-6aa5262ce11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:33.499904 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c762da9-9017-4e98-ab5c-6aa5262ce11b None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:33.500187 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c762da9-9017-4e98-ab5c-6aa5262ce11b None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:33.500463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c762da9-9017-4e98-ab5c-6aa5262ce11b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:33.501666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c762da9-9017-4e98-ab5c-6aa5262ce11b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:33.503116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c762da9-9017-4e98-ab5c-6aa5262ce11b None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:33.504718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 26/52] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:33.510549 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3d139-f56c-438c-af55-730a16acc974 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:33.570903 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:33.585781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dc134-d969-42be-a29d-4a28db920365 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:33.585781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dc134-d969-42be-a29d-4a28db920365 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:33.585781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dc134-d969-42be-a29d-4a28db920365 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:33.585781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 27/53] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:18:33.585781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b438b-7ed0-4b2d-8b5d-5f9fd230884a None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:33.585781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b438b-7ed0-4b2d-8b5d-5f9fd230884a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:33.586199 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b438b-7ed0-4b2d-8b5d-5f9fd230884a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:33.601443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-828b438b-7ed0-4b2d-8b5d-5f9fd230884a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:33.602925 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-828b438b-7ed0-4b2d-8b5d-5f9fd230884a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:33.609324 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3d139-f56c-438c-af55-730a16acc974 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:33.643406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b8143-add7-4451-8c9f-17b742a0972b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:33.644058 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b8143-add7-4451-8c9f-17b742a0972b None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:33.644348 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b8143-add7-4451-8c9f-17b742a0972b None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:33.644632 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b8143-add7-4451-8c9f-17b742a0972b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:33.645472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b8143-add7-4451-8c9f-17b742a0972b None admin] RBAC: Adding query filter params (role.id=beed8caad097496292e544146859df5c, scope.domain.id=default, user.id=1854e64df6074ad496a8d7112fa61f3e) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:33.645818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b8143-add7-4451-8c9f-17b742a0972b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:33.647277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b8143-add7-4451-8c9f-17b742a0972b None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:33.655194 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 27/54] 10.222.0.57 () {56 vars in 1322 bytes} [Thu Jul 21 08:18:33 2022] GET /identity/v3/role_assignments?user.id=1854e64df6074ad496a8d7112fa61f3e&scope.domain.id=default&role.id=beed8caad097496292e544146859df5c => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:33.670352 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 28/55] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:18:33.694087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b8143-add7-4451-8c9f-17b742a0972b None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:33.808620 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b8143-add7-4451-8c9f-17b742a0972b None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:33.835413 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:33.849180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447154e-772d-4aac-9478-0a700706f79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:33.849180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447154e-772d-4aac-9478-0a700706f79b None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:33.849180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447154e-772d-4aac-9478-0a700706f79b None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:33.849180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447154e-772d-4aac-9478-0a700706f79b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:33.849545 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447154e-772d-4aac-9478-0a700706f79b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:33.849694 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447154e-772d-4aac-9478-0a700706f79b None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:33.851316 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 28/56] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:33.857195 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b438b-7ed0-4b2d-8b5d-5f9fd230884a None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:33.932156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:33.954348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b438b-7ed0-4b2d-8b5d-5f9fd230884a None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:33.987652 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d14fc8-9409-4565-bc13-ebc500f1a664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:33.988304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d14fc8-9409-4565-bc13-ebc500f1a664 None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:33.988587 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d14fc8-9409-4565-bc13-ebc500f1a664 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:33.988865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d14fc8-9409-4565-bc13-ebc500f1a664 None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:33.989588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d14fc8-9409-4565-bc13-ebc500f1a664 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:33.991048 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d14fc8-9409-4565-bc13-ebc500f1a664 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:34.071482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 29/57] 10.222.0.57 () {60 vars in 1140 bytes} [Thu Jul 21 08:18:33 2022] POST /identity/v3/projects => generated 298 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:36.097946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b751330-726d-4075-9eab-8df60493fbbb None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:36.098434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b751330-726d-4075-9eab-8df60493fbbb None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:36.098434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b751330-726d-4075-9eab-8df60493fbbb None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:36.099800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 29/58] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:36.105114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c74c3-ceb4-444c-bbe3-4905ec617201 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:36.105499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c74c3-ceb4-444c-bbe3-4905ec617201 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:36.105716 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c74c3-ceb4-444c-bbe3-4905ec617201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:36.122184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-544c74c3-ceb4-444c-bbe3-4905ec617201 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:36.123393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-544c74c3-ceb4-444c-bbe3-4905ec617201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:36.188609 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 30/59] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:36.213115 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b751330-726d-4075-9eab-8df60493fbbb None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:36.419620 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b751330-726d-4075-9eab-8df60493fbbb None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:36.452662 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6eff5a-f743-4d9c-8f17-43576613f047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:36.453441 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6eff5a-f743-4d9c-8f17-43576613f047 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:36.453761 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6eff5a-f743-4d9c-8f17-43576613f047 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:36.454039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6eff5a-f743-4d9c-8f17-43576613f047 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:36.455222 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6eff5a-f743-4d9c-8f17-43576613f047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:36.456655 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6eff5a-f743-4d9c-8f17-43576613f047 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:36.458295 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 30/60] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:36.464189 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c74c3-ceb4-444c-bbe3-4905ec617201 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:36.520532 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:36.559773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c74c3-ceb4-444c-bbe3-4905ec617201 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:36.593647 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6059c60-2d1b-4c0c-97b1-16269a31666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:36.594308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6059c60-2d1b-4c0c-97b1-16269a31666a None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:36.594595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6059c60-2d1b-4c0c-97b1-16269a31666a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:36.594874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6059c60-2d1b-4c0c-97b1-16269a31666a None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:36.595575 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6059c60-2d1b-4c0c-97b1-16269a31666a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:36.597025 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6059c60-2d1b-4c0c-97b1-16269a31666a None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:36.704526 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 31/61] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 08:18:36 2022] POST /identity/v3/users => generated 275 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:39.879896 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2714082-9d46-4809-aa78-a8e484676cad None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:39.880396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2714082-9d46-4809-aa78-a8e484676cad None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:39.880501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2714082-9d46-4809-aa78-a8e484676cad None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:39.881884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 31/62] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:39.887177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c14cb-7e32-444e-aaca-f1cf2242c0d8 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:39.887979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c14cb-7e32-444e-aaca-f1cf2242c0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:39.888462 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c14cb-7e32-444e-aaca-f1cf2242c0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:39.895469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdbff1-7798-41a0-b71b-3d1ed46dab6a None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:39.895764 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdbff1-7798-41a0-b71b-3d1ed46dab6a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:39.896052 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdbff1-7798-41a0-b71b-3d1ed46dab6a None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:39.897561 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 32/63] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:18:39.902447 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e97ef-d2d0-46a2-8ae6-3833123c9c7a None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:39.902986 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e97ef-d2d0-46a2-8ae6-3833123c9c7a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:39.903623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e97ef-d2d0-46a2-8ae6-3833123c9c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:39.913624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-897c14cb-7e32-444e-aaca-f1cf2242c0d8 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:39.914826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-897c14cb-7e32-444e-aaca-f1cf2242c0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:39.921759 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-b44e97ef-d2d0-46a2-8ae6-3833123c9c7a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:39.923290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b44e97ef-d2d0-46a2-8ae6-3833123c9c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:40.028376 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:40.037805 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 32/64] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:40.042308 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 33/65] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:18:40.081396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c14cb-7e32-444e-aaca-f1cf2242c0d8 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:40.085333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e97ef-d2d0-46a2-8ae6-3833123c9c7a None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:40.158765 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:40.221844 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c14cb-7e32-444e-aaca-f1cf2242c0d8 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:40.235714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e97ef-d2d0-46a2-8ae6-3833123c9c7a None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:40.261151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a071ab-1ae4-45a4-a372-f265773f601b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:40.262357 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a071ab-1ae4-45a4-a372-f265773f601b None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:40.262887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a071ab-1ae4-45a4-a372-f265773f601b None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:40.263359 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a071ab-1ae4-45a4-a372-f265773f601b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:40.275030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a071ab-1ae4-45a4-a372-f265773f601b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:40.279822 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d93d95d-bca5-4ab9-9207-0cdbdf5ce776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:40.280557 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93d95d-bca5-4ab9-9207-0cdbdf5ce776 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:40.280844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93d95d-bca5-4ab9-9207-0cdbdf5ce776 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:40.281124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d93d95d-bca5-4ab9-9207-0cdbdf5ce776 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:40.285477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-b5a071ab-1ae4-45a4-a372-f265773f601b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:18:40.285477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:40.285477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:40.285477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:40.285477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:40.285477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:40.285477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:40.285477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:40.285477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:40.285477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:40.285477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:40.285477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:40.285477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:40.285477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:40.285477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:40.285477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:40.286345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:40.286345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:40.286345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:40.286345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:40.286345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:40.286345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:40.286345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:40.286345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:40.286345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:40.286345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:40.286345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:40.286345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:40.286345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:40.286345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:40.286345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:40.286345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:40.287118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:40.287118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:40.287118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:40.287118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:40.287118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:40.287118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:40.287118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:40.287118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:40.287118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:40.287118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:40.287118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:18:40.287118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:18:40.289980 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 33/66] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:40.291400 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5e706-a2d8-49a6-a5bc-bcc3b74dfb6d None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:40.291864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5e706-a2d8-49a6-a5bc-bcc3b74dfb6d None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:40.292340 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5e706-a2d8-49a6-a5bc-bcc3b74dfb6d None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:40.293680 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d93d95d-bca5-4ab9-9207-0cdbdf5ce776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:40.294014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 34/67] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:40.295114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5e706-a2d8-49a6-a5bc-bcc3b74dfb6d None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:40.307266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-9d93d95d-bca5-4ab9-9207-0cdbdf5ce776 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:40.307266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:40.307266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:40.307266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:40.307266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:40.307266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:40.307266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:40.307266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:40.307266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:40.307266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:40.307266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:40.307266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:40.307266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:40.307266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:40.307266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:40.307266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:40.308154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:40.308154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:40.308154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:40.308154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:40.308154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:40.308154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:40.308154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:40.308154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:40.308154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:40.308154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:40.308154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:40.308154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:40.308154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:40.308154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:40.308154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:40.308154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:40.308916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:40.308916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:40.308916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:40.308916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:40.308916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:40.308916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:40.308916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:40.308916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:40.308916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:40.308916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:40.308916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:40.308916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:18:40.308916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 34/68] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:18:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:40.310177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd623c-61fc-4e63-95f8-2329d548db22 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:40.310177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd623c-61fc-4e63-95f8-2329d548db22 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:40.310400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd623c-61fc-4e63-95f8-2329d548db22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:40.333912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-a7bd623c-61fc-4e63-95f8-2329d548db22 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:40.335790 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a7bd623c-61fc-4e63-95f8-2329d548db22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:40.394036 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:40.410240 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5e706-a2d8-49a6-a5bc-bcc3b74dfb6d None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:40.412607 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:40.421556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 35/69] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:40.421556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd623c-61fc-4e63-95f8-2329d548db22 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:40.445239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b99c3b-6120-4e51-90d5-9c2876986892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:40.446022 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b99c3b-6120-4e51-90d5-9c2876986892 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:40.446317 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b99c3b-6120-4e51-90d5-9c2876986892 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:40.446595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b99c3b-6120-4e51-90d5-9c2876986892 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:40.447350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b99c3b-6120-4e51-90d5-9c2876986892 None admin] RBAC: Adding query filter params (name=member) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:40.447659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b99c3b-6120-4e51-90d5-9c2876986892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:40.449051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b99c3b-6120-4e51-90d5-9c2876986892 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:40.459407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 35/70] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:18:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:40.460737 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fbf02-5802-4b1a-b038-306b6b4a19cd None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:40.461036 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fbf02-5802-4b1a-b038-306b6b4a19cd None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:40.461319 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fbf02-5802-4b1a-b038-306b6b4a19cd None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:40.463938 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 36/71] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:40.463938 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fbf02-5802-4b1a-b038-306b6b4a19cd None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:40.533074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd623c-61fc-4e63-95f8-2329d548db22 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:40.566886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a07c61-6651-42b9-b7f2-17367bbc9ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:40.567556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a07c61-6651-42b9-b7f2-17367bbc9ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:40.567844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a07c61-6651-42b9-b7f2-17367bbc9ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:40.567976 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fbf02-5802-4b1a-b038-306b6b4a19cd None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:40.568120 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a07c61-6651-42b9-b7f2-17367bbc9ea5 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:40.568882 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a07c61-6651-42b9-b7f2-17367bbc9ea5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:40.569194 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a07c61-6651-42b9-b7f2-17367bbc9ea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:40.570619 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a07c61-6651-42b9-b7f2-17367bbc9ea5 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:40.582751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 36/72] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:40.582751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a07c61-6651-42b9-b7f2-17367bbc9ea5 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:40.603609 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32faa38b-47ef-41cb-bbf8-316683675ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:40.604400 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faa38b-47ef-41cb-bbf8-316683675ddf None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:40.604683 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faa38b-47ef-41cb-bbf8-316683675ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:40.604959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32faa38b-47ef-41cb-bbf8-316683675ddf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:40.606188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32faa38b-47ef-41cb-bbf8-316683675ddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:40.607641 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32faa38b-47ef-41cb-bbf8-316683675ddf None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:40.609269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 37/73] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:40.610493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30896a43-d26b-4b44-9188-3cf23b4b6041 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:40.610789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30896a43-d26b-4b44-9188-3cf23b4b6041 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:40.611074 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30896a43-d26b-4b44-9188-3cf23b4b6041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:40.626848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-30896a43-d26b-4b44-9188-3cf23b4b6041 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:40.628052 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-30896a43-d26b-4b44-9188-3cf23b4b6041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:40.631715 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:40.655586 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:40.686391 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a07c61-6651-42b9-b7f2-17367bbc9ea5 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:40.694799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 38/74] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:40.696082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b322ef-c942-4dee-8991-5650fb818691 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:40.696371 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b322ef-c942-4dee-8991-5650fb818691 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:40.696652 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b322ef-c942-4dee-8991-5650fb818691 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:40.698019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 39/75] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:40.698702 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b322ef-c942-4dee-8991-5650fb818691 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:40.722740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5de610-88d8-4271-ab59-c26160446f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:40.723609 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5de610-88d8-4271-ab59-c26160446f56 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:40.724128 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5de610-88d8-4271-ab59-c26160446f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:40.724128 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5de610-88d8-4271-ab59-c26160446f56 None admin] PATH_INFO: `/v3/users/69fe4d5dce224172895110b1387bdbed` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:40.739133 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5de610-88d8-4271-ab59-c26160446f56 None admin] RBAC: Authorizing `identity:get_user(user_id=69fe4d5dce224172895110b1387bdbed)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:40.740601 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5de610-88d8-4271-ab59-c26160446f56 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:40.746790 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 37/76] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:40 2022] GET /identity/v3/users/69fe4d5dce224172895110b1387bdbed => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:40.746790 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5de610-88d8-4271-ab59-c26160446f56 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:40.805318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b322ef-c942-4dee-8991-5650fb818691 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:40.838866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e03bff-b867-4a08-a399-90765269790b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:40.839741 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e03bff-b867-4a08-a399-90765269790b None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:40.840029 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e03bff-b867-4a08-a399-90765269790b None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:40.840117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5de610-88d8-4271-ab59-c26160446f56 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:40.840309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e03bff-b867-4a08-a399-90765269790b None admin] PATH_INFO: `/v3/users/1854e64df6074ad496a8d7112fa61f3e` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:40.841516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e03bff-b867-4a08-a399-90765269790b None admin] RBAC: Authorizing `identity:get_user(user_id=1854e64df6074ad496a8d7112fa61f3e)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:40.842892 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:40.843560 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e03bff-b867-4a08-a399-90765269790b None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:40.845188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 40/77] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:40 2022] GET /identity/v3/users/1854e64df6074ad496a8d7112fa61f3e => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:40.845188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2372ca-217a-4e56-8ff2-7176fe75a2a2 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:40.845188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2372ca-217a-4e56-8ff2-7176fe75a2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:40.845188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2372ca-217a-4e56-8ff2-7176fe75a2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:40.862962 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-2f2372ca-217a-4e56-8ff2-7176fe75a2a2 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:40.864158 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2f2372ca-217a-4e56-8ff2-7176fe75a2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:40.876035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce89ab6-c4fd-4fe2-ade6-817383a48858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:40.876709 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce89ab6-c4fd-4fe2-ade6-817383a48858 None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:40.876999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce89ab6-c4fd-4fe2-ade6-817383a48858 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:40.877282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce89ab6-c4fd-4fe2-ade6-817383a48858 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:40.878042 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce89ab6-c4fd-4fe2-ade6-817383a48858 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:40.879565 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce89ab6-c4fd-4fe2-ade6-817383a48858 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:40.890449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:40.929676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 41/78] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:40.930480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2372ca-217a-4e56-8ff2-7176fe75a2a2 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:40.984550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 38/79] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 08:18:40 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:40.985393 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce89ab6-c4fd-4fe2-ade6-817383a48858 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:41.034551 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2372ca-217a-4e56-8ff2-7176fe75a2a2 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:41.076246 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e9bfe-73a8-4590-9872-364034922310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:41.078196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e9bfe-73a8-4590-9872-364034922310 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:41.078890 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e9bfe-73a8-4590-9872-364034922310 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:41.079782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e9bfe-73a8-4590-9872-364034922310 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:41.093451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e9bfe-73a8-4590-9872-364034922310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:41.101845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-e18e9bfe-73a8-4590-9872-364034922310 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:18:41.101845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:41.101845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:41.101845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:41.101845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:41.101845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:41.101845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:41.101845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:41.101845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:41.101845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:41.101845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:41.101845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:41.101845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:41.101845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:41.101845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:41.101845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:41.103031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:41.103031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:41.103031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:41.103031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:41.103031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:41.103031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:41.103031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:41.103031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:41.103031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:41.103031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:41.103031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:41.103031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:41.103031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:41.103031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:41.103031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:41.103031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:41.103818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:41.103818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:41.103818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:41.103818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:41.103818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:41.103818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:41.103818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:41.103818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:41.103818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:41.103818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:41.103818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:18:41.103818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:18:41.103818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 42/80] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:41.104460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e9bfe-73a8-4590-9872-364034922310 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:41.128002 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce89ab6-c4fd-4fe2-ade6-817383a48858 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:41.170929 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:41.181511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90b767-e18c-4421-9fbc-5637510b77f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:41.185488 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90b767-e18c-4421-9fbc-5637510b77f1 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:41.185488 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90b767-e18c-4421-9fbc-5637510b77f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:41.185488 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90b767-e18c-4421-9fbc-5637510b77f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:41.216568 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:41.270807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90b767-e18c-4421-9fbc-5637510b77f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:41.271011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e9bfe-73a8-4590-9872-364034922310 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:41.272474 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd90b767-e18c-4421-9fbc-5637510b77f1 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:41.313397 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836df5c-4779-4c41-a52d-7f827aa105b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:41.314118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836df5c-4779-4c41-a52d-7f827aa105b0 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:41.314411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836df5c-4779-4c41-a52d-7f827aa105b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:41.314693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836df5c-4779-4c41-a52d-7f827aa105b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:41.387969 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 39/81] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:18:41.389315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90b767-e18c-4421-9fbc-5637510b77f1 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:41.389963 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836df5c-4779-4c41-a52d-7f827aa105b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:41.391622 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836df5c-4779-4c41-a52d-7f827aa105b0 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:41.417291 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:41.467422 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:41.508867 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 43/82] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:18:41.514199 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836df5c-4779-4c41-a52d-7f827aa105b0 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:41.521796 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90b767-e18c-4421-9fbc-5637510b77f1 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:41.558594 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07dd44-e840-4921-a5bd-f54dcea505a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:41.559700 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07dd44-e840-4921-a5bd-f54dcea505a2 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:41.560204 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07dd44-e840-4921-a5bd-f54dcea505a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:41.560719 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07dd44-e840-4921-a5bd-f54dcea505a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:41.579615 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07dd44-e840-4921-a5bd-f54dcea505a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:41.591156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-6d07dd44-e840-4921-a5bd-f54dcea505a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:18:41.591156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:41.591156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:41.591156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:41.591156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:41.591156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:41.591156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:41.591156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:41.591156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:41.591156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:41.591156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:41.591156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:41.591156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:41.591156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:41.591156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:41.591156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:41.592070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:41.592070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:41.592070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:41.592070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:41.592070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:41.592070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:41.592070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:41.592070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:41.592070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:41.592070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:41.592070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:41.592070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:41.592070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:41.592070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:41.592070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:41.592070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:41.592835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:41.592835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:41.592835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:41.592835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:41.592835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:41.592835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:41.592835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:41.592835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:41.592835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:41.592835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:41.592835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:18:41.592835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:18:41.595188 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 40/83] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:18:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:41.600257 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07dd44-e840-4921-a5bd-f54dcea505a2 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:41.651136 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836df5c-4779-4c41-a52d-7f827aa105b0 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:41.678608 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:41.688187 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47789f-d464-4d28-a1c8-8a13f40344fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:41.689185 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47789f-d464-4d28-a1c8-8a13f40344fd None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:41.689603 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47789f-d464-4d28-a1c8-8a13f40344fd None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:41.690018 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47789f-d464-4d28-a1c8-8a13f40344fd None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:41.690882 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47789f-d464-4d28-a1c8-8a13f40344fd None admin] RBAC: Adding query filter params (name=member) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:41.691294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47789f-d464-4d28-a1c8-8a13f40344fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:41.692770 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47789f-d464-4d28-a1c8-8a13f40344fd None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:41.701422 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 44/84] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:18:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:41.702364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47789f-d464-4d28-a1c8-8a13f40344fd None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:41.714714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07dd44-e840-4921-a5bd-f54dcea505a2 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:41.744060 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:41.763503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee624b-8315-4c5a-9ad8-011dbfe43c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:41.765315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee624b-8315-4c5a-9ad8-011dbfe43c8a None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:41.765804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee624b-8315-4c5a-9ad8-011dbfe43c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:41.766510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee624b-8315-4c5a-9ad8-011dbfe43c8a None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:41.768139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee624b-8315-4c5a-9ad8-011dbfe43c8a None admin] RBAC: Authorizing `identity:get_project(project_id=5b12104d6dfe4464b0c1b5738679bdb1)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:41.770443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee624b-8315-4c5a-9ad8-011dbfe43c8a None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:41.773731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 41/85] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:41 2022] GET /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:41.775402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee624b-8315-4c5a-9ad8-011dbfe43c8a None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:41.819028 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47789f-d464-4d28-a1c8-8a13f40344fd None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:41.855818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637db50-ce9a-4d64-ac32-f9002bd74729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:41.856833 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637db50-ce9a-4d64-ac32-f9002bd74729 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:41.857223 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637db50-ce9a-4d64-ac32-f9002bd74729 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:41.857671 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637db50-ce9a-4d64-ac32-f9002bd74729 None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:41.859513 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637db50-ce9a-4d64-ac32-f9002bd74729 None admin] RBAC: Authorizing `identity:get_project(project_id=5b12104d6dfe4464b0c1b5738679bdb1)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:41.861076 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637db50-ce9a-4d64-ac32-f9002bd74729 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:41.867807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 45/86] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:41 2022] GET /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:41.867807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637db50-ce9a-4d64-ac32-f9002bd74729 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:41.922092 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee624b-8315-4c5a-9ad8-011dbfe43c8a None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:41.925231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:41.970698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce653c0-f88a-4f18-8ad1-736546b602ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:41.972104 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce653c0-f88a-4f18-8ad1-736546b602ae None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:41.972392 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce653c0-f88a-4f18-8ad1-736546b602ae None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:41.972671 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce653c0-f88a-4f18-8ad1-736546b602ae None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:41.973688 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce653c0-f88a-4f18-8ad1-736546b602ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:41.974003 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce653c0-f88a-4f18-8ad1-736546b602ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:41.975396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce653c0-f88a-4f18-8ad1-736546b602ae None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:41.980065 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637db50-ce9a-4d64-ac32-f9002bd74729 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:41.984816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 42/87] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:18:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:41.985783 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce653c0-f88a-4f18-8ad1-736546b602ae None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:42.026435 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb87bb0-bc01-4235-a9ce-1b3cf6260ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:42.028131 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb87bb0-bc01-4235-a9ce-1b3cf6260ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:42.028624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb87bb0-bc01-4235-a9ce-1b3cf6260ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:42.030059 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb87bb0-bc01-4235-a9ce-1b3cf6260ca7 None admin] PATH_INFO: `/v3/users/69fe4d5dce224172895110b1387bdbed` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:42.031771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb87bb0-bc01-4235-a9ce-1b3cf6260ca7 None admin] RBAC: Authorizing `identity:get_user(user_id=69fe4d5dce224172895110b1387bdbed)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:42.034459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb87bb0-bc01-4235-a9ce-1b3cf6260ca7 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:42.036779 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:42.038058 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 46/88] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:41 2022] GET /identity/v3/users/69fe4d5dce224172895110b1387bdbed => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:42.039036 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb87bb0-bc01-4235-a9ce-1b3cf6260ca7 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:42.091957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce653c0-f88a-4f18-8ad1-736546b602ae None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:42.128504 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e619d-ddc1-4f53-b1a5-a204aca50c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:42.129160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e619d-ddc1-4f53-b1a5-a204aca50c92 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:42.129629 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e619d-ddc1-4f53-b1a5-a204aca50c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:42.129926 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e619d-ddc1-4f53-b1a5-a204aca50c92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:42.130768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e619d-ddc1-4f53-b1a5-a204aca50c92 None admin] RBAC: Adding query filter params (role.id=80c590b37af34bca8dee5f7c87a38999, scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1, user.id=69fe4d5dce224172895110b1387bdbed) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:42.131085 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e619d-ddc1-4f53-b1a5-a204aca50c92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:42.132535 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e619d-ddc1-4f53-b1a5-a204aca50c92 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:42.140020 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 43/89] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:41 2022] GET /identity/v3/role_assignments?user.id=69fe4d5dce224172895110b1387bdbed&scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1&role.id=80c590b37af34bca8dee5f7c87a38999 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:42.140737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e619d-ddc1-4f53-b1a5-a204aca50c92 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:42.182323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb87bb0-bc01-4235-a9ce-1b3cf6260ca7 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:42.206033 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:42.221374 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea569a-cd0f-4b6a-a423-9b0350035e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:42.222171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea569a-cd0f-4b6a-a423-9b0350035e00 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:42.222378 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea569a-cd0f-4b6a-a423-9b0350035e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:42.222750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea569a-cd0f-4b6a-a423-9b0350035e00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:42.223708 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea569a-cd0f-4b6a-a423-9b0350035e00 None admin] RBAC: Adding query filter params (role.id=beed8caad097496292e544146859df5c, scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1, user.id=1854e64df6074ad496a8d7112fa61f3e) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:42.225672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea569a-cd0f-4b6a-a423-9b0350035e00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:42.225672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea569a-cd0f-4b6a-a423-9b0350035e00 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:42.232355 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 47/90] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:42 2022] GET /identity/v3/role_assignments?user.id=1854e64df6074ad496a8d7112fa61f3e&scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1&role.id=beed8caad097496292e544146859df5c => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:42.233132 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea569a-cd0f-4b6a-a423-9b0350035e00 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:42.316175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e619d-ddc1-4f53-b1a5-a204aca50c92 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:42.364953 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:42.407894 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f005a6c-b339-4a6c-8090-61bc49c1e635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:42.409740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f005a6c-b339-4a6c-8090-61bc49c1e635 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:42.410032 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f005a6c-b339-4a6c-8090-61bc49c1e635 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:42.410317 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f005a6c-b339-4a6c-8090-61bc49c1e635 None admin] PATH_INFO: `/v3/users/69fe4d5dce224172895110b1387bdbed` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:42.411826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f005a6c-b339-4a6c-8090-61bc49c1e635 None admin] RBAC: Authorizing `identity:get_user(user_id=69fe4d5dce224172895110b1387bdbed)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:42.413327 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f005a6c-b339-4a6c-8090-61bc49c1e635 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:42.419628 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 44/91] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:42 2022] GET /identity/v3/users/69fe4d5dce224172895110b1387bdbed => generated 275 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:42.420595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f005a6c-b339-4a6c-8090-61bc49c1e635 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:42.501103 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea569a-cd0f-4b6a-a423-9b0350035e00 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:42.538976 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5fff5-6f68-494e-9963-034fba731a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:42.539630 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5fff5-6f68-494e-9963-034fba731a82 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:42.539918 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5fff5-6f68-494e-9963-034fba731a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:42.540200 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e5fff5-6f68-494e-9963-034fba731a82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:42.612256 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f005a6c-b339-4a6c-8090-61bc49c1e635 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:42.613936 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:42.630813 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5fff5-6f68-494e-9963-034fba731a82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:42.632310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e5fff5-6f68-494e-9963-034fba731a82 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:42.722240 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc86d6-8c78-4b14-851b-a83e7579fa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:42.722914 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc86d6-8c78-4b14-851b-a83e7579fa4d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:42.723211 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc86d6-8c78-4b14-851b-a83e7579fa4d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:42.723498 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc86d6-8c78-4b14-851b-a83e7579fa4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:42.740641 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 48/92] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:18:42.746368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5fff5-6f68-494e-9963-034fba731a82 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:42.874261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:42.883169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:42.889266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc86d6-8c78-4b14-851b-a83e7579fa4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:42.893887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e5fff5-6f68-494e-9963-034fba731a82 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:42.899231 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc86d6-8c78-4b14-851b-a83e7579fa4d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:42.954331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e955fa0-a342-4e43-a0dc-7fd5250e0a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:42.955270 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e955fa0-a342-4e43-a0dc-7fd5250e0a92 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:42.955555 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e955fa0-a342-4e43-a0dc-7fd5250e0a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:42.955831 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e955fa0-a342-4e43-a0dc-7fd5250e0a92 None admin] PATH_INFO: `/v3/projects/c97540e09d58425b892e19cc7ceca2e5` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:42.957112 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e955fa0-a342-4e43-a0dc-7fd5250e0a92 None admin] RBAC: Authorizing `identity:get_project(project_id=c97540e09d58425b892e19cc7ceca2e5)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:42.958618 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e955fa0-a342-4e43-a0dc-7fd5250e0a92 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:42.960656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 49/93] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:42 2022] GET /identity/v3/projects/c97540e09d58425b892e19cc7ceca2e5 => generated 312 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:42.966309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e955fa0-a342-4e43-a0dc-7fd5250e0a92 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:43.060005 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 45/94] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:18:43.067742 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc86d6-8c78-4b14-851b-a83e7579fa4d None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:43.197073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e955fa0-a342-4e43-a0dc-7fd5250e0a92 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:43.221883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:43.263995 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc86d6-8c78-4b14-851b-a83e7579fa4d None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:43.281613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67274f82-9708-45e2-ae1f-75c3d25a599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:43.282554 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67274f82-9708-45e2-ae1f-75c3d25a599a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:43.282554 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67274f82-9708-45e2-ae1f-75c3d25a599a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:43.282842 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67274f82-9708-45e2-ae1f-75c3d25a599a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:43.283694 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67274f82-9708-45e2-ae1f-75c3d25a599a None admin] RBAC: Adding query filter params (role.id=80c590b37af34bca8dee5f7c87a38999, scope.project.id=c97540e09d58425b892e19cc7ceca2e5, user.id=69fe4d5dce224172895110b1387bdbed) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:43.284016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67274f82-9708-45e2-ae1f-75c3d25a599a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:43.285502 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67274f82-9708-45e2-ae1f-75c3d25a599a None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:43.303820 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 50/95] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:42 2022] GET /identity/v3/role_assignments?user.id=69fe4d5dce224172895110b1387bdbed&scope.project.id=c97540e09d58425b892e19cc7ceca2e5&role.id=80c590b37af34bca8dee5f7c87a38999 => generated 259 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:43.339239 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886c48b-a02c-4768-854d-189fb6d38b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:43.340454 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886c48b-a02c-4768-854d-189fb6d38b1f None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:43.340958 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886c48b-a02c-4768-854d-189fb6d38b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:43.341433 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886c48b-a02c-4768-854d-189fb6d38b1f None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:43.343456 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886c48b-a02c-4768-854d-189fb6d38b1f None admin] RBAC: Authorizing `identity:get_project(project_id=5b12104d6dfe4464b0c1b5738679bdb1)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:43.345216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886c48b-a02c-4768-854d-189fb6d38b1f None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:43.352008 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 46/96] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:43 2022] GET /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:43.353639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67274f82-9708-45e2-ae1f-75c3d25a599a None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:43.385455 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:43.498397 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67274f82-9708-45e2-ae1f-75c3d25a599a None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:43.540192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4fafb-aacf-48a4-9165-02f5adb507d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:43.540907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4fafb-aacf-48a4-9165-02f5adb507d9 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:43.541245 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4fafb-aacf-48a4-9165-02f5adb507d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:43.541608 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4fafb-aacf-48a4-9165-02f5adb507d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:43.542599 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4fafb-aacf-48a4-9165-02f5adb507d9 None admin] RBAC: Adding query filter params (role.id=f6c74bb34f9c4b0faaf6a21007abcaa5, scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1, user.id=69fe4d5dce224172895110b1387bdbed) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:43.542917 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4fafb-aacf-48a4-9165-02f5adb507d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:43.544516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4fafb-aacf-48a4-9165-02f5adb507d9 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:43.552185 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 51/97] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:43 2022] GET /identity/v3/role_assignments?user.id=69fe4d5dce224172895110b1387bdbed&scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1&role.id=f6c74bb34f9c4b0faaf6a21007abcaa5 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:43.691077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e52cf1-b382-49cb-a7be-33b64015268f None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:43.691401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e52cf1-b382-49cb-a7be-33b64015268f None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:43.691655 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e52cf1-b382-49cb-a7be-33b64015268f None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:43.693066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 47/98] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:43.698664 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6ead3-a84d-4244-a4c5-a407484d2f9a None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:43.698955 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6ead3-a84d-4244-a4c5-a407484d2f9a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:43.699292 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b6ead3-a84d-4244-a4c5-a407484d2f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:43.714579 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcf091-69af-43cf-8be5-8069872a2aef None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:43.714888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcf091-69af-43cf-8be5-8069872a2aef None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:43.715153 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abcf091-69af-43cf-8be5-8069872a2aef None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:43.716794 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 48/99] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:43.722693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-a0b6ead3-a84d-4244-a4c5-a407484d2f9a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:43.723971 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-a0b6ead3-a84d-4244-a4c5-a407484d2f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:43.727937 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e1436-4f1b-4b98-849e-21e0c9ffd42e None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:43.728222 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e1436-4f1b-4b98-849e-21e0c9ffd42e None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:43.728496 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e1436-4f1b-4b98-849e-21e0c9ffd42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:43.759189 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-c67e1436-4f1b-4b98-849e-21e0c9ffd42e None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:43.762708 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c67e1436-4f1b-4b98-849e-21e0c9ffd42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:43.803524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 52/100] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:43.860393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6ead3-a84d-4244-a4c5-a407484d2f9a None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:43.877105 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:43.879566 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 49/101] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:43.919366 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e1436-4f1b-4b98-849e-21e0c9ffd42e None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:43.990791 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b6ead3-a84d-4244-a4c5-a407484d2f9a None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:44.033417 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512e410-7421-4aa9-89fb-72d0be4f9afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:44.034634 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512e410-7421-4aa9-89fb-72d0be4f9afe None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:44.035116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512e410-7421-4aa9-89fb-72d0be4f9afe None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:44.035589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512e410-7421-4aa9-89fb-72d0be4f9afe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:44.037234 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512e410-7421-4aa9-89fb-72d0be4f9afe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:44.039189 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512e410-7421-4aa9-89fb-72d0be4f9afe None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:44.042300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 53/102] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:44.051177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512e410-7421-4aa9-89fb-72d0be4f9afe None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:44.147533 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:44.161928 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:44.177615 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e1436-4f1b-4b98-849e-21e0c9ffd42e None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:44.184181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512e410-7421-4aa9-89fb-72d0be4f9afe None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:44.224919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be09356-628d-4c11-9b92-99b654206203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:44.226063 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09356-628d-4c11-9b92-99b654206203 None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:44.226591 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09356-628d-4c11-9b92-99b654206203 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:44.227133 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09356-628d-4c11-9b92-99b654206203 None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:44.228293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be09356-628d-4c11-9b92-99b654206203 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:44.230263 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be09356-628d-4c11-9b92-99b654206203 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:44.247434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dc4be-f4db-412c-b642-3f85af971a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:44.249247 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dc4be-f4db-412c-b642-3f85af971a41 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:44.249950 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dc4be-f4db-412c-b642-3f85af971a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:44.256174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dc4be-f4db-412c-b642-3f85af971a41 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:44.262265 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0dc4be-f4db-412c-b642-3f85af971a41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:44.271282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-cd0dc4be-f4db-412c-b642-3f85af971a41 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:18:44.271282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:44.271282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:44.271282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:44.271282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:44.271282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:44.271282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:44.271282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:44.271282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:44.271282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:44.271282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:44.271282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:44.271282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:44.271282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:44.271282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:44.271282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:44.272107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:44.272107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:44.272107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:44.272107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:44.272107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:44.272107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:44.272107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:44.272107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:44.272107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:44.272107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:44.272107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:44.272107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:44.272107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:44.272107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:44.272107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:44.272107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:44.273448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:44.273448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:44.273448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:44.273448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:44.273448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:44.273448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:44.273448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:44.273448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:44.273448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:44.273448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:44.273448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:18:44.273448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:18:44.275722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 50/103] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:18:44.282553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dc4be-f4db-412c-b642-3f85af971a41 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:44.321258 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 54/104] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 08:18:44 2022] POST /identity/v3/projects => generated 302 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:44.442830 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dc4be-f4db-412c-b642-3f85af971a41 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:44.502327 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcff84-392c-47a1-a670-1c730e848155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:44.502930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcff84-392c-47a1-a670-1c730e848155 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:44.503227 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcff84-392c-47a1-a670-1c730e848155 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:44.503514 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcff84-392c-47a1-a670-1c730e848155 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:44.504286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebcff84-392c-47a1-a670-1c730e848155 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:44.504606 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebcff84-392c-47a1-a670-1c730e848155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:44.506088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebcff84-392c-47a1-a670-1c730e848155 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:44.515340 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 51/105] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:18:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:44.521295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be09356-628d-4c11-9b92-99b654206203 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:44.716442 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be09356-628d-4c11-9b92-99b654206203 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:44.767709 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:44.773381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef5b1a-496e-4d0d-9906-b3f34df6e4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:44.774299 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef5b1a-496e-4d0d-9906-b3f34df6e4fd None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:44.774583 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef5b1a-496e-4d0d-9906-b3f34df6e4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:44.774851 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef5b1a-496e-4d0d-9906-b3f34df6e4fd None admin] PATH_INFO: `/v3/users/a5fca4865c6a4402b146ba8da2300331` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:44.800949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef5b1a-496e-4d0d-9906-b3f34df6e4fd None admin] RBAC: Authorizing `identity:get_user(user_id=a5fca4865c6a4402b146ba8da2300331)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:44.802474 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef5b1a-496e-4d0d-9906-b3f34df6e4fd None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:44.804575 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 55/106] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:44 2022] GET /identity/v3/users/a5fca4865c6a4402b146ba8da2300331 => generated 289 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:44.810202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcff84-392c-47a1-a670-1c730e848155 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:44.814672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:44.965009 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcff84-392c-47a1-a670-1c730e848155 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:44.977699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f0834-a919-45dc-aad9-31aa318aee69 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:44.977994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f0834-a919-45dc-aad9-31aa318aee69 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:44.978276 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f0834-a919-45dc-aad9-31aa318aee69 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:44.979661 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 56/107] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:18:44.985883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612c24a-a2e5-4891-aa6f-2cb4e76f38f6 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:44.986177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612c24a-a2e5-4891-aa6f-2cb4e76f38f6 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:44.986460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612c24a-a2e5-4891-aa6f-2cb4e76f38f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:45.015417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f70a39-a9c6-4fe5-8741-f19f8983e2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:45.016002 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f70a39-a9c6-4fe5-8741-f19f8983e2ab None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:45.016290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f70a39-a9c6-4fe5-8741-f19f8983e2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:45.016574 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f70a39-a9c6-4fe5-8741-f19f8983e2ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:45.018905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-d612c24a-a2e5-4891-aa6f-2cb4e76f38f6 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:45.020121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-d612c24a-a2e5-4891-aa6f-2cb4e76f38f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:45.176607 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f70a39-a9c6-4fe5-8741-f19f8983e2ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:45.178164 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f70a39-a9c6-4fe5-8741-f19f8983e2ab None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:45.180972 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:45.203296 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 57/108] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:18:45.239120 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612c24a-a2e5-4891-aa6f-2cb4e76f38f6 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:45.410272 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 52/109] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:18:45.416149 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f70a39-a9c6-4fe5-8741-f19f8983e2ab None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:45.444119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612c24a-a2e5-4891-aa6f-2cb4e76f38f6 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:45.477867 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:45.526735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5c087-529c-4973-badc-5b1f4d5a9eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:45.527553 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5c087-529c-4973-badc-5b1f4d5a9eef None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:45.527846 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5c087-529c-4973-badc-5b1f4d5a9eef None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:45.528133 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5c087-529c-4973-badc-5b1f4d5a9eef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:45.546437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f70a39-a9c6-4fe5-8741-f19f8983e2ab None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:45.561987 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:45.581294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5c087-529c-4973-badc-5b1f4d5a9eef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:45.589005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-a2d5c087-529c-4973-badc-5b1f4d5a9eef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:45.589005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:45.589005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:45.589005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:45.589005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:45.589005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:45.589005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:45.589005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:45.589005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:45.589005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:45.589005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:45.589005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:45.589005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:45.589005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:45.589005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:45.589005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:45.589899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:45.589899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:45.589899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:45.589899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:45.589899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:45.589899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:45.589899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:45.589899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:45.589899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:45.589899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:45.589899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:45.589899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:45.589899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:45.589899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:45.589899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:45.589899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:45.590680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:45.590680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:45.590680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:45.590680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:45.590680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:45.590680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:45.590680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:45.590680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:45.590680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:45.590680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:45.590680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:45.590680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:18:45.590680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 58/110] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:18:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:45.592704 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8f5bf-cdce-4fe4-9b5c-7dcfdcf1bed5 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:45.592704 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8f5bf-cdce-4fe4-9b5c-7dcfdcf1bed5 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:45.592704 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8f5bf-cdce-4fe4-9b5c-7dcfdcf1bed5 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:45.593396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef58c4-ab88-4566-98a0-e7c067f0a387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:45.594379 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef58c4-ab88-4566-98a0-e7c067f0a387 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:45.594664 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef58c4-ab88-4566-98a0-e7c067f0a387 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:45.594937 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef58c4-ab88-4566-98a0-e7c067f0a387 None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:45.596202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef58c4-ab88-4566-98a0-e7c067f0a387 None admin] RBAC: Authorizing `identity:get_project(project_id=5b12104d6dfe4464b0c1b5738679bdb1)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:45.597680 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef58c4-ab88-4566-98a0-e7c067f0a387 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:45.599758 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 53/111] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:45 2022] GET /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:45.600571 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef58c4-ab88-4566-98a0-e7c067f0a387 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:45.606812 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 59/112] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:45 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:45.616766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8f5bf-cdce-4fe4-9b5c-7dcfdcf1bed5 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:45.800648 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef58c4-ab88-4566-98a0-e7c067f0a387 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:45.804897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8f5bf-cdce-4fe4-9b5c-7dcfdcf1bed5 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:45.870697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a50342-6c67-46f2-b9c6-21f59b7d850c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:45.871732 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeea6dd-5762-4953-bc43-cb6debb656d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:45.872394 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeea6dd-5762-4953-bc43-cb6debb656d8 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:45.872680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeea6dd-5762-4953-bc43-cb6debb656d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:45.872963 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeea6dd-5762-4953-bc43-cb6debb656d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:45.873865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeea6dd-5762-4953-bc43-cb6debb656d8 None admin] RBAC: Adding query filter params (role.id=0b6428c4b6694007a2af55aa5d143e27, scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1, user.id=a5fca4865c6a4402b146ba8da2300331) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:45.874181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeea6dd-5762-4953-bc43-cb6debb656d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:45.875646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeea6dd-5762-4953-bc43-cb6debb656d8 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:45.877949 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a50342-6c67-46f2-b9c6-21f59b7d850c None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:45.878247 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a50342-6c67-46f2-b9c6-21f59b7d850c None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:45.878594 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a50342-6c67-46f2-b9c6-21f59b7d850c None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:45.879444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a50342-6c67-46f2-b9c6-21f59b7d850c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:45.879762 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a50342-6c67-46f2-b9c6-21f59b7d850c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:45.881146 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a50342-6c67-46f2-b9c6-21f59b7d850c None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:45.881878 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 60/113] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:45 2022] GET /identity/v3/role_assignments?user.id=a5fca4865c6a4402b146ba8da2300331&scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1&role.id=0b6428c4b6694007a2af55aa5d143e27 => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:45.883484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523ffa8-277d-4fee-abad-c405ea7917a2 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:45.883783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523ffa8-277d-4fee-abad-c405ea7917a2 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:45.884067 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523ffa8-277d-4fee-abad-c405ea7917a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:45.899270 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 54/114] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:45.903534 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-1523ffa8-277d-4fee-abad-c405ea7917a2 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:45.905400 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-1523ffa8-277d-4fee-abad-c405ea7917a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:45.905943 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a50342-6c67-46f2-b9c6-21f59b7d850c None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:45.981889 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:46.009831 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:46.043089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 61/115] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:46.072700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523ffa8-277d-4fee-abad-c405ea7917a2 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:46.122597 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a50342-6c67-46f2-b9c6-21f59b7d850c None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:46.189244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16809cce-901d-4ef6-a2ef-802b12101050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:46.190950 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16809cce-901d-4ef6-a2ef-802b12101050 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:46.191431 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16809cce-901d-4ef6-a2ef-802b12101050 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:46.191898 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16809cce-901d-4ef6-a2ef-802b12101050 None admin] PATH_INFO: `/v3/users/1854e64df6074ad496a8d7112fa61f3e` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:46.193321 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16809cce-901d-4ef6-a2ef-802b12101050 None admin] RBAC: Authorizing `identity:get_user(user_id=1854e64df6074ad496a8d7112fa61f3e)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:46.194976 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16809cce-901d-4ef6-a2ef-802b12101050 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:46.196821 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 55/116] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:45 2022] GET /identity/v3/users/1854e64df6074ad496a8d7112fa61f3e => generated 247 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:46.202880 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16809cce-901d-4ef6-a2ef-802b12101050 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:46.273297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523ffa8-277d-4fee-abad-c405ea7917a2 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:46.337583 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d1c2f-3868-4be3-aafe-832b6ad87197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:46.338778 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d1c2f-3868-4be3-aafe-832b6ad87197 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:46.339273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d1c2f-3868-4be3-aafe-832b6ad87197 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:46.339722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d1c2f-3868-4be3-aafe-832b6ad87197 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:46.362517 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d1c2f-3868-4be3-aafe-832b6ad87197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:46.371281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-0f7d1c2f-3868-4be3-aafe-832b6ad87197 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:18:46.371281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:46.371281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:46.371281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:46.371281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:46.371281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:46.371281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:46.371281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:46.371281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:46.371281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:46.371281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:46.371281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:46.371281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:46.371281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:46.371281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:46.371281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:46.372159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:46.372159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:46.372159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:46.372159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:46.372159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:46.372159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:46.372159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:46.372159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:46.372159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:46.372159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:46.372159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:46.372159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:46.372159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:46.372159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:46.372159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:46.372159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:46.372915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:46.372915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:46.372915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:46.372915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:46.372915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:46.372915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:46.372915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:46.372915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:46.372915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:46.372915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:46.372915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:18:46.372915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:18:46.374922 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:46.375691 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 62/117] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:46.381558 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef5878-3086-48f4-a4d3-df41f56665a7 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:46.381558 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef5878-3086-48f4-a4d3-df41f56665a7 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:46.381558 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef5878-3086-48f4-a4d3-df41f56665a7 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:46.381814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16809cce-901d-4ef6-a2ef-802b12101050 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:46.381894 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 63/118] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:46.381894 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6d86f-3f5f-4980-8235-54047d1fd702 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:46.381894 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6d86f-3f5f-4980-8235-54047d1fd702 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:46.381894 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6d86f-3f5f-4980-8235-54047d1fd702 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:46.381894 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 64/119] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:46.384813 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1129f-1d6f-47e3-a663-ca11ad30c5ea None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:46.385110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1129f-1d6f-47e3-a663-ca11ad30c5ea None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:46.385396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1129f-1d6f-47e3-a663-ca11ad30c5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:46.409422 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-47f1129f-1d6f-47e3-a663-ca11ad30c5ea None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:46.411276 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-47f1129f-1d6f-47e3-a663-ca11ad30c5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:46.420842 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db747d-34ee-4219-a485-c5289d460e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:46.421871 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db747d-34ee-4219-a485-c5289d460e71 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:46.422234 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db747d-34ee-4219-a485-c5289d460e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:46.422633 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db747d-34ee-4219-a485-c5289d460e71 None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:46.424087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db747d-34ee-4219-a485-c5289d460e71 None admin] RBAC: Authorizing `identity:get_project(project_id=5b12104d6dfe4464b0c1b5738679bdb1)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:46.425564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db747d-34ee-4219-a485-c5289d460e71 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:46.427786 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 56/120] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:46 2022] GET /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:46.428579 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db747d-34ee-4219-a485-c5289d460e71 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:46.441416 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:46.495133 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 65/121] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:46.496542 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582abc6-8917-4f57-87b0-da6216d484f4 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:46.496836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582abc6-8917-4f57-87b0-da6216d484f4 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:46.497140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582abc6-8917-4f57-87b0-da6216d484f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:46.514349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-7582abc6-8917-4f57-87b0-da6216d484f4 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:46.515917 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-7582abc6-8917-4f57-87b0-da6216d484f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:46.552776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db747d-34ee-4219-a485-c5289d460e71 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:46.587324 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 66/122] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:46.593724 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582abc6-8917-4f57-87b0-da6216d484f4 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:46.596270 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ae53a-9cf4-4777-9b3b-9745bc01b779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:46.597170 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ae53a-9cf4-4777-9b3b-9745bc01b779 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:46.597723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ae53a-9cf4-4777-9b3b-9745bc01b779 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:46.598304 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ae53a-9cf4-4777-9b3b-9745bc01b779 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:46.599262 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ae53a-9cf4-4777-9b3b-9745bc01b779 None admin] RBAC: Adding query filter params (name=member) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:46.599864 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ae53a-9cf4-4777-9b3b-9745bc01b779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:46.601452 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ae53a-9cf4-4777-9b3b-9745bc01b779 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:46.615849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 57/123] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:18:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:46.616973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ae53a-9cf4-4777-9b3b-9745bc01b779 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:46.650504 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:46.682093 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:46.690827 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582abc6-8917-4f57-87b0-da6216d484f4 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:46.726532 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ae53a-9cf4-4777-9b3b-9745bc01b779 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:46.730055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04b578-2332-46ba-8766-7495ffd7c103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:46.730774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04b578-2332-46ba-8766-7495ffd7c103 None admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:46.731057 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04b578-2332-46ba-8766-7495ffd7c103 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:46.731336 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04b578-2332-46ba-8766-7495ffd7c103 None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1/users/1854e64df6074ad496a8d7112fa61f3e/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:46.733391 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04b578-2332-46ba-8766-7495ffd7c103 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b12104d6dfe4464b0c1b5738679bdb1, user_id=1854e64df6074ad496a8d7112fa61f3e, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:46.734953 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04b578-2332-46ba-8766-7495ffd7c103 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:46.764618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d141676-be25-45d5-b700-a9b83299385f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:46.765701 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d141676-be25-45d5-b700-a9b83299385f None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:46.766187 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d141676-be25-45d5-b700-a9b83299385f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:46.766682 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d141676-be25-45d5-b700-a9b83299385f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:46.778182 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d141676-be25-45d5-b700-a9b83299385f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:46.786849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-1d141676-be25-45d5-b700-a9b83299385f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:18:46.786849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:46.786849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:46.786849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:46.786849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:46.786849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:46.786849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:46.786849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:46.786849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:46.786849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:46.786849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:46.786849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:46.786849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:46.786849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:46.786849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:46.786849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:46.787697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:46.787697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:46.787697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:46.787697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:46.787697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:46.787697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:46.787697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:46.787697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:46.787697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:46.787697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:46.787697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:46.787697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:46.787697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:46.787697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:46.787697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:46.787697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:46.788438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:46.788438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:46.788438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:46.788438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:46.788438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:46.788438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:46.788438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:46.788438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:46.788438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:46.788438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:46.788438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:18:46.788438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:18:46.789942 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 58/124] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:46.790610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d141676-be25-45d5-b700-a9b83299385f None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:46.810074 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 67/125] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:18:46 2022] PUT /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1/users/1854e64df6074ad496a8d7112fa61f3e/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:18:46.811197 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04b578-2332-46ba-8766-7495ffd7c103 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:46.933671 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04b578-2332-46ba-8766-7495ffd7c103 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:46.938033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:46.951310 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d141676-be25-45d5-b700-a9b83299385f None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:46.985894 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed5cc9-6e2b-4f95-8c9e-ae9f21793c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:46.986734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed5cc9-6e2b-4f95-8c9e-ae9f21793c42 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:46.987024 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed5cc9-6e2b-4f95-8c9e-ae9f21793c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:46.987306 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed5cc9-6e2b-4f95-8c9e-ae9f21793c42 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:47.011793 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ed5cc9-6e2b-4f95-8c9e-ae9f21793c42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:47.013354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bf4a7-1c93-4af9-ab40-be4fbdb82bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:47.014266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bf4a7-1c93-4af9-ab40-be4fbdb82bbd None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:47.014555 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bf4a7-1c93-4af9-ab40-be4fbdb82bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:47.014834 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334bf4a7-1c93-4af9-ab40-be4fbdb82bbd None admin] PATH_INFO: `/v3/users/69fe4d5dce224172895110b1387bdbed` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:47.018510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334bf4a7-1c93-4af9-ab40-be4fbdb82bbd None admin] RBAC: Authorizing `identity:get_user(user_id=69fe4d5dce224172895110b1387bdbed)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:47.021443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334bf4a7-1c93-4af9-ab40-be4fbdb82bbd None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:47.023477 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 59/126] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:46 2022] GET /identity/v3/users/69fe4d5dce224172895110b1387bdbed => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:47.028257 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bf4a7-1c93-4af9-ab40-be4fbdb82bbd None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:47.031118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-92ed5cc9-6e2b-4f95-8c9e-ae9f21793c42 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:18:47.031118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:47.031118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:47.031118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:47.031118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:47.031118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:47.031118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:47.031118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:47.031118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:47.031118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:47.031118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:47.031118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:47.031118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:47.031118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:47.031118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:47.031118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:47.031997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:47.031997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:47.031997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:47.031997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:47.031997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:47.031997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:47.031997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:47.031997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:47.031997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:47.031997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:47.031997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:47.031997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:47.031997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:47.031997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:47.031997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:47.031997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:47.033174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:47.033174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:47.033174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:47.033174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:47.033174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:47.033174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:47.033174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:47.033174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:47.033174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:47.033174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:47.033174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:18:47.033174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:18:47.033174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 68/127] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:18:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:47.034082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed5cc9-6e2b-4f95-8c9e-ae9f21793c42 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:47.063756 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:47.158563 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334bf4a7-1c93-4af9-ab40-be4fbdb82bbd None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:47.177752 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed5cc9-6e2b-4f95-8c9e-ae9f21793c42 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:47.203712 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f318032-87f0-491e-9000-348e87c5f6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:47.204972 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f318032-87f0-491e-9000-348e87c5f6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:47.205406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f318032-87f0-491e-9000-348e87c5f6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:47.205983 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f318032-87f0-491e-9000-348e87c5f6e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:47.206932 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f318032-87f0-491e-9000-348e87c5f6e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:47.207555 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f318032-87f0-491e-9000-348e87c5f6e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:47.209122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f318032-87f0-491e-9000-348e87c5f6e8 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:47.218656 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 60/128] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:18:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:47.219746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f318032-87f0-491e-9000-348e87c5f6e8 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:47.225823 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd201a8-d6c0-4707-894f-0091ca299e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:47.228069 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd201a8-d6c0-4707-894f-0091ca299e00 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:47.228360 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd201a8-d6c0-4707-894f-0091ca299e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:47.228643 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd201a8-d6c0-4707-894f-0091ca299e00 None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:47.234267 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd201a8-d6c0-4707-894f-0091ca299e00 None admin] RBAC: Authorizing `identity:get_project(project_id=5b12104d6dfe4464b0c1b5738679bdb1)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:47.235745 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd201a8-d6c0-4707-894f-0091ca299e00 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:47.237787 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 69/129] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:47 2022] GET /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:47.238573 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd201a8-d6c0-4707-894f-0091ca299e00 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:47.255655 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:47.336586 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:47.360644 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd201a8-d6c0-4707-894f-0091ca299e00 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:47.406241 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e26f0e-8cbc-4959-b823-563d1e9e64ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:47.407371 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e26f0e-8cbc-4959-b823-563d1e9e64ba None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:47.410949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e26f0e-8cbc-4959-b823-563d1e9e64ba None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:47.411388 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e26f0e-8cbc-4959-b823-563d1e9e64ba None admin] PATH_INFO: `/v3/users/69fe4d5dce224172895110b1387bdbed` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:47.413850 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e26f0e-8cbc-4959-b823-563d1e9e64ba None admin] RBAC: Authorizing `identity:get_user(user_id=69fe4d5dce224172895110b1387bdbed)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:47.415521 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e26f0e-8cbc-4959-b823-563d1e9e64ba None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:47.418863 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 70/130] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:47 2022] GET /identity/v3/users/69fe4d5dce224172895110b1387bdbed => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:47.420228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e26f0e-8cbc-4959-b823-563d1e9e64ba None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:47.432160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f318032-87f0-491e-9000-348e87c5f6e8 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:47.477861 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c52cdc-5980-45fe-be9a-3977f8ed96b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:47.479468 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c52cdc-5980-45fe-be9a-3977f8ed96b9 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:47.479907 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c52cdc-5980-45fe-be9a-3977f8ed96b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:47.480631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c52cdc-5980-45fe-be9a-3977f8ed96b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:47.481560 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c52cdc-5980-45fe-be9a-3977f8ed96b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:47.482249 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c52cdc-5980-45fe-be9a-3977f8ed96b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:47.484750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c52cdc-5980-45fe-be9a-3977f8ed96b9 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:47.495985 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 61/131] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:18:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:47.497355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c52cdc-5980-45fe-be9a-3977f8ed96b9 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:47.550979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e26f0e-8cbc-4959-b823-563d1e9e64ba None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:47.594944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d5584-4c45-4f4b-bcd0-b677b6a88c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:47.596378 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d5584-4c45-4f4b-bcd0-b677b6a88c75 None admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:47.596674 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d5584-4c45-4f4b-bcd0-b677b6a88c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:47.596961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d5584-4c45-4f4b-bcd0-b677b6a88c75 None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1/users/69fe4d5dce224172895110b1387bdbed/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:47.599541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:47.600638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d5584-4c45-4f4b-bcd0-b677b6a88c75 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b12104d6dfe4464b0c1b5738679bdb1, user_id=69fe4d5dce224172895110b1387bdbed, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:47.602910 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d5584-4c45-4f4b-bcd0-b677b6a88c75 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:47.620028 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c52cdc-5980-45fe-be9a-3977f8ed96b9 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:47.655906 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281e541-2c38-4f1b-a232-93d4b87dd1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:47.656764 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281e541-2c38-4f1b-a232-93d4b87dd1cb None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:47.657052 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281e541-2c38-4f1b-a232-93d4b87dd1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:47.657331 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281e541-2c38-4f1b-a232-93d4b87dd1cb None admin] PATH_INFO: `/v3/projects/c97540e09d58425b892e19cc7ceca2e5` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:47.658550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281e541-2c38-4f1b-a232-93d4b87dd1cb None admin] RBAC: Authorizing `identity:get_project(project_id=c97540e09d58425b892e19cc7ceca2e5)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:47.660071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281e541-2c38-4f1b-a232-93d4b87dd1cb None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:47.661808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 62/132] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:47 2022] GET /identity/v3/projects/c97540e09d58425b892e19cc7ceca2e5 => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:47.663243 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15cb43-cb22-480c-a0d2-a2b48b6100b3 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:47.663706 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15cb43-cb22-480c-a0d2-a2b48b6100b3 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:47.664110 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15cb43-cb22-480c-a0d2-a2b48b6100b3 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:47.665461 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 63/133] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:47.666306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15cb43-cb22-480c-a0d2-a2b48b6100b3 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:47.705575 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 71/134] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:18:47 2022] PUT /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1/users/69fe4d5dce224172895110b1387bdbed/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:18:47.707728 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d5584-4c45-4f4b-bcd0-b677b6a88c75 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:47.724607 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:47.849381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15cb43-cb22-480c-a0d2-a2b48b6100b3 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:47.903011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e51f92-a890-4035-a841-0adb1b222c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:47.904750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e51f92-a890-4035-a841-0adb1b222c0d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:47.905245 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e51f92-a890-4035-a841-0adb1b222c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:47.905773 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e51f92-a890-4035-a841-0adb1b222c0d None admin] PATH_INFO: `/v3/users/69fe4d5dce224172895110b1387bdbed` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:47.907249 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e51f92-a890-4035-a841-0adb1b222c0d None admin] RBAC: Authorizing `identity:get_user(user_id=69fe4d5dce224172895110b1387bdbed)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:47.908925 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e51f92-a890-4035-a841-0adb1b222c0d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:47.910873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 64/135] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:47 2022] GET /identity/v3/users/69fe4d5dce224172895110b1387bdbed => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:47.912262 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cb5fa-19aa-49c4-bb06-4de17aa62dad None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:47.912760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cb5fa-19aa-49c4-bb06-4de17aa62dad None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:47.913261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cb5fa-19aa-49c4-bb06-4de17aa62dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:47.918935 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d5584-4c45-4f4b-bcd0-b677b6a88c75 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:47.931201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-de1cb5fa-19aa-49c4-bb06-4de17aa62dad None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:47.932701 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-de1cb5fa-19aa-49c4-bb06-4de17aa62dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:47.948924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:47.960274 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a95b0-9235-4da2-b455-833930e04628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:47.961621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a95b0-9235-4da2-b455-833930e04628 None admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:47.962134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a95b0-9235-4da2-b455-833930e04628 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:47.962624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a95b0-9235-4da2-b455-833930e04628 None admin] PATH_INFO: `/v3/projects/c97540e09d58425b892e19cc7ceca2e5/users/69fe4d5dce224172895110b1387bdbed/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:47.965626 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a95b0-9235-4da2-b455-833930e04628 None admin] RBAC: Authorizing `identity:create_grant(project_id=c97540e09d58425b892e19cc7ceca2e5, user_id=69fe4d5dce224172895110b1387bdbed, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:47.967850 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a95b0-9235-4da2-b455-833930e04628 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:48.018469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 65/136] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:48.019726 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cb5fa-19aa-49c4-bb06-4de17aa62dad None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:48.061226 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 72/137] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:18:47 2022] PUT /identity/v3/projects/c97540e09d58425b892e19cc7ceca2e5/users/69fe4d5dce224172895110b1387bdbed/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:18:48.080185 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a95b0-9235-4da2-b455-833930e04628 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:48.218938 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:48.221536 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cb5fa-19aa-49c4-bb06-4de17aa62dad None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:48.264121 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd73551-3dc4-4409-9317-19ceb7fcd4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:48.265232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd73551-3dc4-4409-9317-19ceb7fcd4cd None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:48.265539 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd73551-3dc4-4409-9317-19ceb7fcd4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:48.265825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd73551-3dc4-4409-9317-19ceb7fcd4cd None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:48.267310 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd73551-3dc4-4409-9317-19ceb7fcd4cd None admin] RBAC: Authorizing `identity:get_project(project_id=5b12104d6dfe4464b0c1b5738679bdb1)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:48.269219 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd73551-3dc4-4409-9317-19ceb7fcd4cd None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:48.271076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 66/138] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:48 2022] GET /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:48.277064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd73551-3dc4-4409-9317-19ceb7fcd4cd None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:48.287791 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a95b0-9235-4da2-b455-833930e04628 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:48.305614 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:48.329351 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d5fcb-3166-43f1-9fea-dd3125c22f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:48.330518 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d5fcb-3166-43f1-9fea-dd3125c22f2d None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:48.330967 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d5fcb-3166-43f1-9fea-dd3125c22f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:48.334699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d5fcb-3166-43f1-9fea-dd3125c22f2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:48.334699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d5fcb-3166-43f1-9fea-dd3125c22f2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:48.334699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d5fcb-3166-43f1-9fea-dd3125c22f2d None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:48.336605 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 73/139] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:48.342489 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d5fcb-3166-43f1-9fea-dd3125c22f2d None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:48.398986 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd73551-3dc4-4409-9317-19ceb7fcd4cd None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:48.437096 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d979c-18aa-417e-88b4-fcbc418b6f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:48.438116 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d979c-18aa-417e-88b4-fcbc418b6f8f None admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:48.438502 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d979c-18aa-417e-88b4-fcbc418b6f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:48.438860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d979c-18aa-417e-88b4-fcbc418b6f8f None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1/users/69fe4d5dce224172895110b1387bdbed/roles/f6c74bb34f9c4b0faaf6a21007abcaa5` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:48.441358 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d979c-18aa-417e-88b4-fcbc418b6f8f None admin] RBAC: Authorizing `identity:create_grant(project_id=5b12104d6dfe4464b0c1b5738679bdb1, user_id=69fe4d5dce224172895110b1387bdbed, role_id=f6c74bb34f9c4b0faaf6a21007abcaa5)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:48.442919 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d979c-18aa-417e-88b4-fcbc418b6f8f None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:48.483692 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d5fcb-3166-43f1-9fea-dd3125c22f2d None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:48.515441 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 67/140] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:18:48 2022] PUT /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1/users/69fe4d5dce224172895110b1387bdbed/roles/f6c74bb34f9c4b0faaf6a21007abcaa5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:18:48.518078 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9329fe4-e279-4fa7-9f47-2f075d605945 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:48.518674 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9329fe4-e279-4fa7-9f47-2f075d605945 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:48.519167 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9329fe4-e279-4fa7-9f47-2f075d605945 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:48.520981 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 68/141] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:48.527688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176aa4e8-2342-4557-8065-664689179208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:48.528112 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5d027-a294-4049-9b0a-325acce56460 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:48.528380 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aa4e8-2342-4557-8065-664689179208 None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:48.528669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aa4e8-2342-4557-8065-664689179208 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:48.528953 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176aa4e8-2342-4557-8065-664689179208 None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:48.529480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5d027-a294-4049-9b0a-325acce56460 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:48.529863 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176aa4e8-2342-4557-8065-664689179208 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:48.530345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b5d027-a294-4049-9b0a-325acce56460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:48.531536 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176aa4e8-2342-4557-8065-664689179208 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:48.546355 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:48.554689 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-84b5d027-a294-4049-9b0a-325acce56460 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:48.556410 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-84b5d027-a294-4049-9b0a-325acce56460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:48.638478 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 69/142] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:18:48.662919 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5d027-a294-4049-9b0a-325acce56460 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:48.672266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:48.723534 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 74/143] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 08:18:48 2022] POST /identity/v3/users => generated 283 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:48.781730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b5d027-a294-4049-9b0a-325acce56460 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:48.821238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc452264-99ce-4c4f-8c89-2d7329c1788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:48.822139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc452264-99ce-4c4f-8c89-2d7329c1788e None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:48.822431 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc452264-99ce-4c4f-8c89-2d7329c1788e None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:48.822714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc452264-99ce-4c4f-8c89-2d7329c1788e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:48.837246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc452264-99ce-4c4f-8c89-2d7329c1788e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:48.846228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-fc452264-99ce-4c4f-8c89-2d7329c1788e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:18:48.846228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:48.846228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:48.846228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:48.846228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:48.846228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:48.846228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:48.846228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:48.846228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:48.846228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:48.846228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:48.846228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:48.846228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:48.846228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:48.846228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:48.846228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:48.847160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:48.847160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:48.847160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:48.847160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:48.847160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:48.847160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:48.847160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:48.847160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:48.847160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:48.847160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:48.847160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:48.847160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:48.847160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:48.847160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:48.847160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:48.847160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:48.847930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:48.847930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:48.847930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:48.847930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:48.847930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:48.847930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:48.847930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:48.847930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:48.847930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:48.847930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:48.847930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:18:48.847930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:18:48.847930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 70/144] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:18:48.853962 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176aa4e8-2342-4557-8065-664689179208 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:48.964175 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176aa4e8-2342-4557-8065-664689179208 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:49.001452 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a9a25-7951-49d9-922c-5954326baf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:49.002194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a9a25-7951-49d9-922c-5954326baf35 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:49.002485 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a9a25-7951-49d9-922c-5954326baf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:49.002769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a9a25-7951-49d9-922c-5954326baf35 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:49.003528 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a9a25-7951-49d9-922c-5954326baf35 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:49.003838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a9a25-7951-49d9-922c-5954326baf35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:49.005275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a9a25-7951-49d9-922c-5954326baf35 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:49.014916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 75/145] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:18:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:49.020547 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc452264-99ce-4c4f-8c89-2d7329c1788e None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:49.109405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:49.146307 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc452264-99ce-4c4f-8c89-2d7329c1788e None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:49.181201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0effa9a-e241-4ca5-88de-2db719adee6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:49.182118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0effa9a-e241-4ca5-88de-2db719adee6c None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:49.183140 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0effa9a-e241-4ca5-88de-2db719adee6c None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:49.183428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0effa9a-e241-4ca5-88de-2db719adee6c None admin] PATH_INFO: `/v3/users/a5fca4865c6a4402b146ba8da2300331` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:49.184729 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0effa9a-e241-4ca5-88de-2db719adee6c None admin] RBAC: Authorizing `identity:get_user(user_id=a5fca4865c6a4402b146ba8da2300331)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:49.187042 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0effa9a-e241-4ca5-88de-2db719adee6c None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:49.189102 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 71/146] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:49 2022] GET /identity/v3/users/a5fca4865c6a4402b146ba8da2300331 => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:49.194505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a9a25-7951-49d9-922c-5954326baf35 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:49.263198 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:49.303675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a9a25-7951-49d9-922c-5954326baf35 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:49.340247 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd7032-3ebe-4715-9509-7d54c30fc3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:49.348044 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd7032-3ebe-4715-9509-7d54c30fc3ee None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:49.348044 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd7032-3ebe-4715-9509-7d54c30fc3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:49.348044 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd7032-3ebe-4715-9509-7d54c30fc3ee None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:49.348044 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd7032-3ebe-4715-9509-7d54c30fc3ee None admin] RBAC: Authorizing `identity:get_project(project_id=5b12104d6dfe4464b0c1b5738679bdb1)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:49.348044 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd7032-3ebe-4715-9509-7d54c30fc3ee None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:49.348044 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 76/147] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:49 2022] GET /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:49.351989 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0effa9a-e241-4ca5-88de-2db719adee6c None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:49.459518 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0effa9a-e241-4ca5-88de-2db719adee6c None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:49.495348 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febbd50-7b4e-4976-a91c-8ddebc7f5e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:49.496257 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febbd50-7b4e-4976-a91c-8ddebc7f5e42 None admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:49.496547 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febbd50-7b4e-4976-a91c-8ddebc7f5e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:49.496830 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febbd50-7b4e-4976-a91c-8ddebc7f5e42 None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1/users/a5fca4865c6a4402b146ba8da2300331/roles/0b6428c4b6694007a2af55aa5d143e27` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:49.500058 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd6fbf-1fa8-4cc1-b64d-4d7856be1344 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:49.500355 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd6fbf-1fa8-4cc1-b64d-4d7856be1344 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:49.500634 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cd6fbf-1fa8-4cc1-b64d-4d7856be1344 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:49.502165 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 77/148] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:49.502607 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febbd50-7b4e-4976-a91c-8ddebc7f5e42 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b12104d6dfe4464b0c1b5738679bdb1, user_id=a5fca4865c6a4402b146ba8da2300331, role_id=0b6428c4b6694007a2af55aa5d143e27)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:49.504079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febbd50-7b4e-4976-a91c-8ddebc7f5e42 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:49.506502 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:49.523084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a8fb7-af29-4485-8cd7-9412f8630b06 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:49.523084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a8fb7-af29-4485-8cd7-9412f8630b06 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:49.523084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a8fb7-af29-4485-8cd7-9412f8630b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:49.537432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-043a8fb7-af29-4485-8cd7-9412f8630b06 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:49.538700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-043a8fb7-af29-4485-8cd7-9412f8630b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:49.591508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 72/149] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:18:49 2022] PUT /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1/users/a5fca4865c6a4402b146ba8da2300331/roles/0b6428c4b6694007a2af55aa5d143e27 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:18:49.631673 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 78/150] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:49.658769 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febbd50-7b4e-4976-a91c-8ddebc7f5e42 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:49.806174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febbd50-7b4e-4976-a91c-8ddebc7f5e42 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:49.849299 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f8e8d-ecf4-4bde-b968-e6ced2e39cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:49.850149 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f8e8d-ecf4-4bde-b968-e6ced2e39cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:49.850448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f8e8d-ecf4-4bde-b968-e6ced2e39cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:49.850730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f8e8d-ecf4-4bde-b968-e6ced2e39cf0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:49.870946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f8e8d-ecf4-4bde-b968-e6ced2e39cf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:49.879281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-8b7f8e8d-ecf4-4bde-b968-e6ced2e39cf0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:49.879281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:49.879281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:49.879281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:49.879281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:49.879281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:49.879281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:49.879281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:49.879281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:49.879281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:49.879281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:49.879281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:49.879281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:49.879281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:49.879281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:49.879281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:49.880168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:49.880168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:49.880168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:49.880168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:49.880168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:49.880168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:49.880168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:49.880168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:49.880168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:49.880168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:49.880168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:49.880168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:49.880168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:49.880168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:49.880168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:49.880168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:49.880991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:49.880991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:49.880991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:49.880991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:49.880991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:49.880991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:49.880991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:49.880991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:49.880991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:49.880991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:49.880991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:49.880991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:18:49.880991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 73/151] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:18:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:49.887110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a8fb7-af29-4485-8cd7-9412f8630b06 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:49.981919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:50.039355 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a8fb7-af29-4485-8cd7-9412f8630b06 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:50.082325 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634154b-cd7b-4cdb-a721-619088936646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:50.086307 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634154b-cd7b-4cdb-a721-619088936646 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:50.089776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634154b-cd7b-4cdb-a721-619088936646 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:50.089776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634154b-cd7b-4cdb-a721-619088936646 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:50.089776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634154b-cd7b-4cdb-a721-619088936646 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:50.089776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634154b-cd7b-4cdb-a721-619088936646 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:50.089776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634154b-cd7b-4cdb-a721-619088936646 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:50.103220 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 79/152] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:50.110603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f8e8d-ecf4-4bde-b968-e6ced2e39cf0 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:50.194078 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:50.245067 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f8e8d-ecf4-4bde-b968-e6ced2e39cf0 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:50.286249 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8e862-a381-4bba-89c2-2f0b21bfe0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:50.287130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8e862-a381-4bba-89c2-2f0b21bfe0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:50.287412 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8e862-a381-4bba-89c2-2f0b21bfe0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:50.287686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8e862-a381-4bba-89c2-2f0b21bfe0c4 None admin] PATH_INFO: `/v3/users/1854e64df6074ad496a8d7112fa61f3e` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:50.289655 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8e862-a381-4bba-89c2-2f0b21bfe0c4 None admin] RBAC: Authorizing `identity:get_user(user_id=1854e64df6074ad496a8d7112fa61f3e)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:50.291127 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8e862-a381-4bba-89c2-2f0b21bfe0c4 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:50.292994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 74/153] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:50 2022] GET /identity/v3/users/1854e64df6074ad496a8d7112fa61f3e => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:50.299324 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634154b-cd7b-4cdb-a721-619088936646 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:50.423150 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634154b-cd7b-4cdb-a721-619088936646 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:50.441937 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:50.459615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4347662-b6c9-407f-ba87-9891698469be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:50.460328 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4347662-b6c9-407f-ba87-9891698469be None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:50.460620 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4347662-b6c9-407f-ba87-9891698469be None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:50.460901 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4347662-b6c9-407f-ba87-9891698469be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:50.511151 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4eea7-ae1c-44cf-a20e-d3b4e6c9e2e3 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:50.511682 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4eea7-ae1c-44cf-a20e-d3b4e6c9e2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:50.511770 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4eea7-ae1c-44cf-a20e-d3b4e6c9e2e3 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:50.513210 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 75/154] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:50.518749 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377d9d9-880a-4295-a9c3-61277a737bf9 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:50.519329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377d9d9-880a-4295-a9c3-61277a737bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:50.519809 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7377d9d9-880a-4295-a9c3-61277a737bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:50.538566 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4347662-b6c9-407f-ba87-9891698469be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:50.539961 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-7377d9d9-880a-4295-a9c3-61277a737bf9 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:50.540275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4347662-b6c9-407f-ba87-9891698469be None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:50.541637 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7377d9d9-880a-4295-a9c3-61277a737bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:50.620920 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 76/155] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:18:50.647051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 80/156] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:18:50.648394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377d9d9-880a-4295-a9c3-61277a737bf9 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:50.658976 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4347662-b6c9-407f-ba87-9891698469be None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:50.677978 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:50.734883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:50.800050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4347662-b6c9-407f-ba87-9891698469be None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:50.832558 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7377d9d9-880a-4295-a9c3-61277a737bf9 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:50.850516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0389331-389a-46d8-8cd7-b68d22596e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:50.851545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0389331-389a-46d8-8cd7-b68d22596e6d None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:50.851978 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0389331-389a-46d8-8cd7-b68d22596e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:50.852611 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0389331-389a-46d8-8cd7-b68d22596e6d None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:50.854103 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0389331-389a-46d8-8cd7-b68d22596e6d None admin] RBAC: Authorizing `identity:get_project(project_id=5b12104d6dfe4464b0c1b5738679bdb1)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:50.855714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0389331-389a-46d8-8cd7-b68d22596e6d None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:50.862044 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 81/157] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:50 2022] GET /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:50.867627 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0389331-389a-46d8-8cd7-b68d22596e6d None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:50.910294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4e6f4-ff42-4339-8f8c-7050af35ecd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:50.911116 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4e6f4-ff42-4339-8f8c-7050af35ecd8 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:50.911406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4e6f4-ff42-4339-8f8c-7050af35ecd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:50.911686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4e6f4-ff42-4339-8f8c-7050af35ecd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:50.930689 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4e6f4-ff42-4339-8f8c-7050af35ecd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:50.944395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-60e4e6f4-ff42-4339-8f8c-7050af35ecd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:18:50.944395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:50.944395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:50.944395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:50.944395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:50.944395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:50.944395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:50.944395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:50.944395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:50.944395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:50.944395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:50.944395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:50.944395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:50.944395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:50.944395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:50.944395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:50.945320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:50.945320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:50.945320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:50.945320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:50.945320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:50.945320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:50.945320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:50.945320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:50.945320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:50.945320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:50.945320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:50.945320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:50.945320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:50.945320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:50.945320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:50.945320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:50.946135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:50.946135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:50.946135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:50.946135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:50.946135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:50.946135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:50.946135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:50.946135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:50.946135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:50.946135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:50.946135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:18:50.946135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:18:50.946135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 77/158] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:50.954452 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4e6f4-ff42-4339-8f8c-7050af35ecd8 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:50.997582 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:51.021144 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0389331-389a-46d8-8cd7-b68d22596e6d None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:51.067307 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f674a1-11a1-4205-b130-3138f015f643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:51.068093 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f674a1-11a1-4205-b130-3138f015f643 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:51.068447 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f674a1-11a1-4205-b130-3138f015f643 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:51.068800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f674a1-11a1-4205-b130-3138f015f643 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:51.070532 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f674a1-11a1-4205-b130-3138f015f643 None admin] RBAC: Adding query filter params (role.id=beed8caad097496292e544146859df5c, scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1, user.id=1854e64df6074ad496a8d7112fa61f3e) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:51.070532 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f674a1-11a1-4205-b130-3138f015f643 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:51.072965 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f674a1-11a1-4205-b130-3138f015f643 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:51.084031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 82/159] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:50 2022] GET /identity/v3/role_assignments?user.id=1854e64df6074ad496a8d7112fa61f3e&scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1&role.id=beed8caad097496292e544146859df5c => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:51.110552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4e6f4-ff42-4339-8f8c-7050af35ecd8 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:51.141945 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:51.164557 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f16ee8-618a-4807-a35b-9c44f5ba7297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:51.165235 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f16ee8-618a-4807-a35b-9c44f5ba7297 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:51.165610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f16ee8-618a-4807-a35b-9c44f5ba7297 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:51.165923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f16ee8-618a-4807-a35b-9c44f5ba7297 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:51.166697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f16ee8-618a-4807-a35b-9c44f5ba7297 None admin] RBAC: Adding query filter params (name=member) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:51.167016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f16ee8-618a-4807-a35b-9c44f5ba7297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:51.168418 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f16ee8-618a-4807-a35b-9c44f5ba7297 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:51.178516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 78/160] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:18:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:51.184605 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f674a1-11a1-4205-b130-3138f015f643 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:51.326491 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f674a1-11a1-4205-b130-3138f015f643 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:51.372178 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd20af-1479-40ee-90a8-8fa01ca94620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:51.373756 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd20af-1479-40ee-90a8-8fa01ca94620 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:51.374043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd20af-1479-40ee-90a8-8fa01ca94620 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:51.374320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd20af-1479-40ee-90a8-8fa01ca94620 None admin] PATH_INFO: `/v3/users/69fe4d5dce224172895110b1387bdbed` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:51.375601 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd20af-1479-40ee-90a8-8fa01ca94620 None admin] RBAC: Authorizing `identity:get_user(user_id=69fe4d5dce224172895110b1387bdbed)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:51.377103 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd20af-1479-40ee-90a8-8fa01ca94620 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:51.379167 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 83/161] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:51 2022] GET /identity/v3/users/69fe4d5dce224172895110b1387bdbed => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:51.386660 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f16ee8-618a-4807-a35b-9c44f5ba7297 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:51.515078 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f16ee8-618a-4807-a35b-9c44f5ba7297 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:51.562823 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf9999-b621-4570-a45f-5eec4113ec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:51.563476 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf9999-b621-4570-a45f-5eec4113ec15 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:51.563760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf9999-b621-4570-a45f-5eec4113ec15 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:51.564039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf9999-b621-4570-a45f-5eec4113ec15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:51.616011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:51.646816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf9999-b621-4570-a45f-5eec4113ec15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:51.648311 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf9999-b621-4570-a45f-5eec4113ec15 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:51.768598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 79/162] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:18:51.774596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd20af-1479-40ee-90a8-8fa01ca94620 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:51.811528 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:51.913301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd20af-1479-40ee-90a8-8fa01ca94620 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:51.954411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2621bf-630a-466c-ba8f-d9e04df5faad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:51.955286 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2621bf-630a-466c-ba8f-d9e04df5faad None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:51.955572 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2621bf-630a-466c-ba8f-d9e04df5faad None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:51.955849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2621bf-630a-466c-ba8f-d9e04df5faad None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:51.957066 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2621bf-630a-466c-ba8f-d9e04df5faad None admin] RBAC: Authorizing `identity:get_project(project_id=5b12104d6dfe4464b0c1b5738679bdb1)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:51.958559 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2621bf-630a-466c-ba8f-d9e04df5faad None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:51.960440 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 84/163] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:51 2022] GET /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:51.966655 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf9999-b621-4570-a45f-5eec4113ec15 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:52.080613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:52.116168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf9999-b621-4570-a45f-5eec4113ec15 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:52.159708 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ccbae-cbf7-4079-8128-762d769d789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:52.160373 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ccbae-cbf7-4079-8128-762d769d789e None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:52.160712 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ccbae-cbf7-4079-8128-762d769d789e None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:52.161058 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ccbae-cbf7-4079-8128-762d769d789e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:52.161857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ccbae-cbf7-4079-8128-762d769d789e None admin] RBAC: Adding query filter params (role.id=80c590b37af34bca8dee5f7c87a38999, scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1, user.id=69fe4d5dce224172895110b1387bdbed) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:52.162172 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ccbae-cbf7-4079-8128-762d769d789e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:52.163634 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ccbae-cbf7-4079-8128-762d769d789e None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:52.171255 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 80/164] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:51 2022] GET /identity/v3/role_assignments?user.id=69fe4d5dce224172895110b1387bdbed&scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1&role.id=80c590b37af34bca8dee5f7c87a38999 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:52.180007 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ec16f-4e2f-4547-8e37-7a40b4cce6cd None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:52.180676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ec16f-4e2f-4547-8e37-7a40b4cce6cd None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:52.181160 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ec16f-4e2f-4547-8e37-7a40b4cce6cd None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:52.183052 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 85/165] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:52.200822 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdaf45-393d-4ac9-8e0a-0627f558650e None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:52.201776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdaf45-393d-4ac9-8e0a-0627f558650e None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:52.201959 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccdaf45-393d-4ac9-8e0a-0627f558650e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:52.230553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-dccdaf45-393d-4ac9-8e0a-0627f558650e None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:52.231771 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-dccdaf45-393d-4ac9-8e0a-0627f558650e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:52.322322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 81/166] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:52.358852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ec16f-4e2f-4547-8e37-7a40b4cce6cd None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:52.485553 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:52.525848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ec16f-4e2f-4547-8e37-7a40b4cce6cd None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:52.574251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75d9a3-a997-48b9-a06a-7ed32bc663aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:52.575063 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75d9a3-a997-48b9-a06a-7ed32bc663aa None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:52.575348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75d9a3-a997-48b9-a06a-7ed32bc663aa None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:52.575621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75d9a3-a997-48b9-a06a-7ed32bc663aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:52.587436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75d9a3-a997-48b9-a06a-7ed32bc663aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:52.595902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-cf75d9a3-a997-48b9-a06a-7ed32bc663aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:18:52.595902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:52.595902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:52.595902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:52.595902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:52.595902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:52.595902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:52.595902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:52.595902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:52.595902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:52.595902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:52.595902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:52.595902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:52.595902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:52.595902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:52.595902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:52.596792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:52.596792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:52.596792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:52.596792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:52.596792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:52.596792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:52.596792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:52.596792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:52.596792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:52.596792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:52.596792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:52.596792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:52.596792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:52.596792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:52.596792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:52.596792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:52.597807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:52.597807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:52.597807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:52.597807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:52.597807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:52.597807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:52.597807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:52.597807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:52.597807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:52.597807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:52.597807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:18:52.597807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:18:52.597807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 86/167] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:52.603495 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdaf45-393d-4ac9-8e0a-0627f558650e None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:52.643621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce70dc-39b5-4c6d-b46d-5fb89cb05ec2 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:52.643962 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce70dc-39b5-4c6d-b46d-5fb89cb05ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:52.644183 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce70dc-39b5-4c6d-b46d-5fb89cb05ec2 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:52.645579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 87/168] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:18:52.650850 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2d0f5-fa4b-4918-954e-307ddfeb9a44 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:52.651133 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2d0f5-fa4b-4918-954e-307ddfeb9a44 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:52.651411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d2d0f5-fa4b-4918-954e-307ddfeb9a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:52.671255 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-29d2d0f5-fa4b-4918-954e-307ddfeb9a44 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:52.672754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-29d2d0f5-fa4b-4918-954e-307ddfeb9a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:52.697227 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:52.737239 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccdaf45-393d-4ac9-8e0a-0627f558650e None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:52.778501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23d4ac-1b78-4508-b6cc-d57f4b6a31a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:52.779348 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23d4ac-1b78-4508-b6cc-d57f4b6a31a5 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:52.779724 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23d4ac-1b78-4508-b6cc-d57f4b6a31a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:52.780098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23d4ac-1b78-4508-b6cc-d57f4b6a31a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:52.781004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23d4ac-1b78-4508-b6cc-d57f4b6a31a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:52.781405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23d4ac-1b78-4508-b6cc-d57f4b6a31a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:52.783053 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23d4ac-1b78-4508-b6cc-d57f4b6a31a5 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:52.793348 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 82/169] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:18:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:52.799136 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23d4ac-1b78-4508-b6cc-d57f4b6a31a5 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:52.881983 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 88/170] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:18:52.925477 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23d4ac-1b78-4508-b6cc-d57f4b6a31a5 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:52.968115 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:52.976982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229312a-2d9a-44c3-a2bb-1c1f74c132ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:52.978146 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229312a-2d9a-44c3-a2bb-1c1f74c132ff None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:52.978428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229312a-2d9a-44c3-a2bb-1c1f74c132ff None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:52.978594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2d0f5-fa4b-4918-954e-307ddfeb9a44 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:52.984177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229312a-2d9a-44c3-a2bb-1c1f74c132ff None admin] PATH_INFO: `/v3/users/69fe4d5dce224172895110b1387bdbed` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:52.984177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229312a-2d9a-44c3-a2bb-1c1f74c132ff None admin] RBAC: Authorizing `identity:get_user(user_id=69fe4d5dce224172895110b1387bdbed)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:52.984177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229312a-2d9a-44c3-a2bb-1c1f74c132ff None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:52.984177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 83/171] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:52 2022] GET /identity/v3/users/69fe4d5dce224172895110b1387bdbed => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:52.989348 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229312a-2d9a-44c3-a2bb-1c1f74c132ff None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:53.136208 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229312a-2d9a-44c3-a2bb-1c1f74c132ff None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:53.144972 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:53.176942 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1747d-6ca8-4c93-9d20-bc89c6eef0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:53.177836 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1747d-6ca8-4c93-9d20-bc89c6eef0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:53.178278 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1747d-6ca8-4c93-9d20-bc89c6eef0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:53.178711 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1747d-6ca8-4c93-9d20-bc89c6eef0c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:53.209320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d2d0f5-fa4b-4918-954e-307ddfeb9a44 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:53.264277 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8ae22-11b4-494a-850d-f6a432d181b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:53.265101 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8ae22-11b4-494a-850d-f6a432d181b8 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:53.265387 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8ae22-11b4-494a-850d-f6a432d181b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:53.265690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8ae22-11b4-494a-850d-f6a432d181b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:53.276866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8ae22-11b4-494a-850d-f6a432d181b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:53.285596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-19a8ae22-11b4-494a-850d-f6a432d181b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:18:53.285596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:53.285596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:53.285596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:53.285596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:53.285596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:53.285596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:53.285596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:53.285596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:53.285596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:53.285596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:53.285596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:53.285596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:53.285596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:53.285596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:53.285596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:53.286484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:53.286484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:53.286484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:53.286484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:53.286484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:53.286484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:53.286484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:53.286484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:53.286484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:53.286484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:53.286484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:53.286484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:53.286484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:53.286484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:53.286484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:53.286484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:53.287248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:53.287248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:53.287248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:53.287248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:53.287248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:53.287248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:53.287248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:53.287248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:53.287248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:53.287248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:53.287248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:18:53.287248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:18:53.287248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 89/172] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:18:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:53.288436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f0d42-d81e-4735-81b0-07054e218415 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:53.288703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f0d42-d81e-4735-81b0-07054e218415 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:53.288994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f0d42-d81e-4735-81b0-07054e218415 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:53.290802 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 90/173] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:53.295815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f0d42-d81e-4735-81b0-07054e218415 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:53.315028 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:53.320259 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1747d-6ca8-4c93-9d20-bc89c6eef0c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:53.321761 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1747d-6ca8-4c93-9d20-bc89c6eef0c3 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:53.431362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f0d42-d81e-4735-81b0-07054e218415 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:53.464877 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:53.467179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a0572-e7d6-4752-9d6c-a3eaa73041e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:53.467866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a0572-e7d6-4752-9d6c-a3eaa73041e6 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:53.468159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a0572-e7d6-4752-9d6c-a3eaa73041e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:53.468444 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a0572-e7d6-4752-9d6c-a3eaa73041e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:53.469204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a0572-e7d6-4752-9d6c-a3eaa73041e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:53.469518 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a0572-e7d6-4752-9d6c-a3eaa73041e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:53.470931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a0572-e7d6-4752-9d6c-a3eaa73041e6 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:53.480495 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 91/174] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:18:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:53.481785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396af21-8a11-4b1d-950a-b20200de0729 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:53.484995 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396af21-8a11-4b1d-950a-b20200de0729 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:53.484995 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396af21-8a11-4b1d-950a-b20200de0729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:53.513057 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-0396af21-8a11-4b1d-950a-b20200de0729 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:53.514626 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-0396af21-8a11-4b1d-950a-b20200de0729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:53.519643 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 84/175] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:18:53.520518 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1747d-6ca8-4c93-9d20-bc89c6eef0c3 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:53.588801 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 92/176] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:53.590097 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396af21-8a11-4b1d-950a-b20200de0729 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:53.693786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396af21-8a11-4b1d-950a-b20200de0729 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:53.721968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:53.735640 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35078e-e97c-4301-987d-2b6d61a8e8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:53.736792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35078e-e97c-4301-987d-2b6d61a8e8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:53.737256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35078e-e97c-4301-987d-2b6d61a8e8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:53.737755 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35078e-e97c-4301-987d-2b6d61a8e8b3 None admin] PATH_INFO: `/v3/projects/c97540e09d58425b892e19cc7ceca2e5` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:53.745882 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35078e-e97c-4301-987d-2b6d61a8e8b3 None admin] RBAC: Authorizing `identity:get_project(project_id=c97540e09d58425b892e19cc7ceca2e5)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:53.748630 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35078e-e97c-4301-987d-2b6d61a8e8b3 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:53.758784 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 93/177] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:53 2022] GET /identity/v3/projects/c97540e09d58425b892e19cc7ceca2e5 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:53.759885 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35078e-e97c-4301-987d-2b6d61a8e8b3 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:53.794049 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:53.802697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1747d-6ca8-4c93-9d20-bc89c6eef0c3 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:53.853878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977f847-5fbc-46a5-a0b7-73c822c3a589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:53.855051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977f847-5fbc-46a5-a0b7-73c822c3a589 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:53.855335 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977f847-5fbc-46a5-a0b7-73c822c3a589 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:53.855612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5977f847-5fbc-46a5-a0b7-73c822c3a589 None admin] PATH_INFO: `/v3/users/69fe4d5dce224172895110b1387bdbed` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:53.858121 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977f847-5fbc-46a5-a0b7-73c822c3a589 None admin] RBAC: Authorizing `identity:get_user(user_id=69fe4d5dce224172895110b1387bdbed)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:53.859902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5977f847-5fbc-46a5-a0b7-73c822c3a589 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:53.862366 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 85/178] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:53 2022] GET /identity/v3/users/69fe4d5dce224172895110b1387bdbed => generated 275 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:53.863049 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977f847-5fbc-46a5-a0b7-73c822c3a589 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:53.902055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35078e-e97c-4301-987d-2b6d61a8e8b3 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:53.944157 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b049fa8-4bc5-49cf-aee4-6f20f5faf2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:53.945028 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b049fa8-4bc5-49cf-aee4-6f20f5faf2ea None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:53.945320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b049fa8-4bc5-49cf-aee4-6f20f5faf2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:53.945634 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b049fa8-4bc5-49cf-aee4-6f20f5faf2ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:53.956296 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b049fa8-4bc5-49cf-aee4-6f20f5faf2ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:53.964143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-3b049fa8-4bc5-49cf-aee4-6f20f5faf2ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:53.964143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:53.964143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:53.964143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:53.964143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:53.964143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:53.964143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:53.964143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:53.964143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:53.964143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:53.964143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:53.964143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:53.964143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:53.964143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:53.964143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:53.964143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:53.965055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:53.965055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:53.965055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:53.965055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:53.965055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:53.965055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:53.965055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:53.965055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:53.965055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:53.965055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:53.965055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:53.965055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:53.965055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:53.965055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:53.965055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:53.965055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:53.965866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:53.965866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:53.965866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:53.965866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:53.965866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:53.965866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:53.965866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:53.965866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:53.965866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:53.965866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:53.965866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:53.965866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:18:53.965866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 94/179] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:18:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:53.967828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb5029-e779-4a05-80e7-e55f4cae55d7 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:53.967828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb5029-e779-4a05-80e7-e55f4cae55d7 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:53.967828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb5029-e779-4a05-80e7-e55f4cae55d7 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:53.969043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 95/180] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:53.970087 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239bafb-c329-4445-8fa0-7001d5fbe842 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:53.970366 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239bafb-c329-4445-8fa0-7001d5fbe842 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:53.970643 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239bafb-c329-4445-8fa0-7001d5fbe842 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:53.971863 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 96/181] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:53.974331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239bafb-c329-4445-8fa0-7001d5fbe842 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:53.974439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5977f847-5fbc-46a5-a0b7-73c822c3a589 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:54.009776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41219c36-62b8-4c2d-8779-cc2fecb742db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:54.010425 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41219c36-62b8-4c2d-8779-cc2fecb742db None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:54.010700 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41219c36-62b8-4c2d-8779-cc2fecb742db None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:54.010969 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41219c36-62b8-4c2d-8779-cc2fecb742db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:54.011795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41219c36-62b8-4c2d-8779-cc2fecb742db None admin] RBAC: Adding query filter params (role.id=80c590b37af34bca8dee5f7c87a38999, scope.project.id=c97540e09d58425b892e19cc7ceca2e5, user.id=69fe4d5dce224172895110b1387bdbed) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:54.012103 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41219c36-62b8-4c2d-8779-cc2fecb742db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:54.013573 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41219c36-62b8-4c2d-8779-cc2fecb742db None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:54.019938 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 86/182] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:53 2022] GET /identity/v3/role_assignments?user.id=69fe4d5dce224172895110b1387bdbed&scope.project.id=c97540e09d58425b892e19cc7ceca2e5&role.id=80c590b37af34bca8dee5f7c87a38999 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:54.021140 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690d9a6-7448-49d8-9cd4-4aa5e38b57b8 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:54.021423 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690d9a6-7448-49d8-9cd4-4aa5e38b57b8 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:54.021726 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690d9a6-7448-49d8-9cd4-4aa5e38b57b8 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:54.023133 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 87/183] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:54.023662 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690d9a6-7448-49d8-9cd4-4aa5e38b57b8 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:54.043570 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:54.057440 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:54.100234 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239bafb-c329-4445-8fa0-7001d5fbe842 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:54.137152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690d9a6-7448-49d8-9cd4-4aa5e38b57b8 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:54.140213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb44ce-97ab-4c3c-a2b6-23559600a5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:54.141074 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb44ce-97ab-4c3c-a2b6-23559600a5ee None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:54.141311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb44ce-97ab-4c3c-a2b6-23559600a5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:54.141735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb44ce-97ab-4c3c-a2b6-23559600a5ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:54.179546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b5a47-ad0b-422e-bf6a-9bb97e63085c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:54.180569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b5a47-ad0b-422e-bf6a-9bb97e63085c None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:54.180569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b5a47-ad0b-422e-bf6a-9bb97e63085c None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:54.180762 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b5a47-ad0b-422e-bf6a-9bb97e63085c None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:54.181514 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b5a47-ad0b-422e-bf6a-9bb97e63085c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:54.182307 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b5a47-ad0b-422e-bf6a-9bb97e63085c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:54.183747 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b5a47-ad0b-422e-bf6a-9bb97e63085c None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:54.193323 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 88/184] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:54.194798 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f70d3-8f3a-4218-babd-6872c700aa01 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:54.195099 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f70d3-8f3a-4218-babd-6872c700aa01 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:54.195458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f70d3-8f3a-4218-babd-6872c700aa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:54.219134 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-8c5f70d3-8f3a-4218-babd-6872c700aa01 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:54.220335 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-8c5f70d3-8f3a-4218-babd-6872c700aa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:54.240757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb44ce-97ab-4c3c-a2b6-23559600a5ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:54.242267 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb44ce-97ab-4c3c-a2b6-23559600a5ee None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:54.287700 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 89/185] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:54.289036 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d94584-fbb6-4898-a154-0536ddf9d190 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:54.289322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d94584-fbb6-4898-a154-0536ddf9d190 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:54.289626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d94584-fbb6-4898-a154-0536ddf9d190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:54.293783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:54.318615 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-98d94584-fbb6-4898-a154-0536ddf9d190 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:54.319790 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-98d94584-fbb6-4898-a154-0536ddf9d190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:54.336448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:54.340990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 97/186] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:18:54.342923 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f28ed-aef5-4458-9655-716038d47aef None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:54.343276 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f28ed-aef5-4458-9655-716038d47aef None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:54.343524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f28ed-aef5-4458-9655-716038d47aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:54.359843 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-c25f28ed-aef5-4458-9655-716038d47aef None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:54.361056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-c25f28ed-aef5-4458-9655-716038d47aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:54.387483 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 90/187] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:54.388150 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d94584-fbb6-4898-a154-0536ddf9d190 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:54.433855 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 98/188] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:54.434686 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f28ed-aef5-4458-9655-716038d47aef None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:54.489251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d94584-fbb6-4898-a154-0536ddf9d190 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:54.516007 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:54.523547 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f22a38-3f76-4a10-a154-7db941fc6c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:54.524410 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f22a38-3f76-4a10-a154-7db941fc6c50 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:54.524687 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f22a38-3f76-4a10-a154-7db941fc6c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:54.524962 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f22a38-3f76-4a10-a154-7db941fc6c50 None admin] PATH_INFO: `/v3/users/cbca1598008e4ec3874722cde271d730` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:54.533052 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f28ed-aef5-4458-9655-716038d47aef None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:54.537857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f22a38-3f76-4a10-a154-7db941fc6c50 None admin] RBAC: Authorizing `identity:get_user(user_id=cbca1598008e4ec3874722cde271d730)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:54.540475 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f22a38-3f76-4a10-a154-7db941fc6c50 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:54.540998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 91/189] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:54 2022] GET /identity/v3/users/cbca1598008e4ec3874722cde271d730 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:54.541781 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f22a38-3f76-4a10-a154-7db941fc6c50 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:54.555119 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:54.566608 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f10981-9897-4d46-b9a9-ee9ecd074a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:54.567393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f10981-9897-4d46-b9a9-ee9ecd074a70 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:54.567671 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f10981-9897-4d46-b9a9-ee9ecd074a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:54.567945 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f10981-9897-4d46-b9a9-ee9ecd074a70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:54.569104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f10981-9897-4d46-b9a9-ee9ecd074a70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:54.570595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f10981-9897-4d46-b9a9-ee9ecd074a70 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:54.573810 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 99/190] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:54.573810 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f10981-9897-4d46-b9a9-ee9ecd074a70 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:54.647528 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f22a38-3f76-4a10-a154-7db941fc6c50 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:54.674679 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f10981-9897-4d46-b9a9-ee9ecd074a70 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:54.681327 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f4df0-ee3b-4009-bee4-d731458235f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:54.682228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f4df0-ee3b-4009-bee4-d731458235f5 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:54.682506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f4df0-ee3b-4009-bee4-d731458235f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:54.682773 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f4df0-ee3b-4009-bee4-d731458235f5 None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:54.683949 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f4df0-ee3b-4009-bee4-d731458235f5 None admin] RBAC: Authorizing `identity:get_project(project_id=5b12104d6dfe4464b0c1b5738679bdb1)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:54.685909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f4df0-ee3b-4009-bee4-d731458235f5 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:54.687596 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 92/191] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:54 2022] GET /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:54.688347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f4df0-ee3b-4009-bee4-d731458235f5 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:54.709718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462bbc6-ba13-4e7b-aa41-90c860015d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:54.710516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462bbc6-ba13-4e7b-aa41-90c860015d38 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:54.710803 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462bbc6-ba13-4e7b-aa41-90c860015d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:54.711073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462bbc6-ba13-4e7b-aa41-90c860015d38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:54.721196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462bbc6-ba13-4e7b-aa41-90c860015d38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:54.729453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-8462bbc6-ba13-4e7b-aa41-90c860015d38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:18:54.729453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:54.729453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:54.729453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:54.729453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:54.729453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:54.729453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:54.729453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:54.729453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:54.729453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:54.729453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:54.729453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:54.729453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:54.729453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:54.729453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:54.729453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:54.730402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:54.730402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:54.730402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:54.730402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:54.730402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:54.730402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:54.730402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:54.730402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:54.730402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:54.730402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:54.730402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:54.730402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:54.730402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:54.730402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:54.730402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:54.730402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:54.731192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:54.731192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:54.731192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:54.731192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:54.731192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:54.731192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:54.731192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:54.731192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:54.731192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:54.731192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:54.731192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:18:54.731192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:18:54.731192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 100/192] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:18:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:54.731839 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462bbc6-ba13-4e7b-aa41-90c860015d38 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:54.745043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:54.771088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:54.791211 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f4df0-ee3b-4009-bee4-d731458235f5 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:54.825304 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c38cb6-b54b-4436-8370-6de8fff8f5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:54.826134 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c38cb6-b54b-4436-8370-6de8fff8f5fe None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:54.826418 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c38cb6-b54b-4436-8370-6de8fff8f5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:54.826691 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c38cb6-b54b-4436-8370-6de8fff8f5fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:54.832011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462bbc6-ba13-4e7b-aa41-90c860015d38 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:54.836498 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c38cb6-b54b-4436-8370-6de8fff8f5fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:54.844066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-53c38cb6-b54b-4436-8370-6de8fff8f5fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:18:54.844066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:54.844066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:54.844066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:54.844066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:54.844066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:54.844066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:54.844066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:54.844066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:54.844066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:54.844066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:54.844066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:54.844066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:54.844066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:54.844066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:54.844066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:54.845113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:54.845113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:54.845113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:54.845113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:54.845113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:54.845113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:54.845113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:54.845113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:54.845113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:54.845113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:54.845113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:54.845113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:54.845113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:54.845113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:54.845113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:54.845113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:54.846144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:54.846144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:54.846144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:54.846144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:54.846144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:54.846144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:54.846144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:54.846144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:54.846144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:54.846144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:54.846144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:18:54.846144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:18:54.846144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 93/193] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:54.846144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c38cb6-b54b-4436-8370-6de8fff8f5fe None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:54.872437 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13b98c-a70b-435f-bef0-16a3e0d10a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:54.873720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13b98c-a70b-435f-bef0-16a3e0d10a67 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:54.874001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13b98c-a70b-435f-bef0-16a3e0d10a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:54.874272 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13b98c-a70b-435f-bef0-16a3e0d10a67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:54.942617 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13b98c-a70b-435f-bef0-16a3e0d10a67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:54.944080 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13b98c-a70b-435f-bef0-16a3e0d10a67 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:54.951611 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c38cb6-b54b-4436-8370-6de8fff8f5fe None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:54.955342 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:54.985425 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75f73d-d0e9-4cf6-89ca-b6b3ee1c3d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:54.986115 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75f73d-d0e9-4cf6-89ca-b6b3ee1c3d10 None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:54.986401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75f73d-d0e9-4cf6-89ca-b6b3ee1c3d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:54.986679 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75f73d-d0e9-4cf6-89ca-b6b3ee1c3d10 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:54.987388 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75f73d-d0e9-4cf6-89ca-b6b3ee1c3d10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:54.988901 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75f73d-d0e9-4cf6-89ca-b6b3ee1c3d10 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:54.997251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:55.041868 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 101/194] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:18:55.042683 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13b98c-a70b-435f-bef0-16a3e0d10a67 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:55.092342 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 94/195] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 08:18:54 2022] POST /identity/v3/users => generated 297 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:55.093815 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75f73d-d0e9-4cf6-89ca-b6b3ee1c3d10 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:55.152277 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13b98c-a70b-435f-bef0-16a3e0d10a67 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:55.164709 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:55.194309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c09e7-a00e-4bf8-a42f-5715a0df88bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:55.195208 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c09e7-a00e-4bf8-a42f-5715a0df88bb None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:55.195667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c09e7-a00e-4bf8-a42f-5715a0df88bb None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:55.195940 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c09e7-a00e-4bf8-a42f-5715a0df88bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:55.196785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c09e7-a00e-4bf8-a42f-5715a0df88bb None admin] RBAC: Adding query filter params (role.id=f6c74bb34f9c4b0faaf6a21007abcaa5, scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1, user.id=69fe4d5dce224172895110b1387bdbed) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:55.197390 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c09e7-a00e-4bf8-a42f-5715a0df88bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:55.198940 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c09e7-a00e-4bf8-a42f-5715a0df88bb None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:55.213572 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 102/196] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:55 2022] GET /identity/v3/role_assignments?user.id=69fe4d5dce224172895110b1387bdbed&scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1&role.id=f6c74bb34f9c4b0faaf6a21007abcaa5 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:55.213572 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c09e7-a00e-4bf8-a42f-5715a0df88bb None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:55.226706 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75f73d-d0e9-4cf6-89ca-b6b3ee1c3d10 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:55.272298 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd6b06-cda4-46c4-8941-da41570e3101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:55.272298 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd6b06-cda4-46c4-8941-da41570e3101 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:55.272298 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd6b06-cda4-46c4-8941-da41570e3101 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:55.274253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd6b06-cda4-46c4-8941-da41570e3101 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:55.275465 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd6b06-cda4-46c4-8941-da41570e3101 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:55.276038 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd6b06-cda4-46c4-8941-da41570e3101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:55.279485 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd6b06-cda4-46c4-8941-da41570e3101 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:55.291140 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 95/197] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:18:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:55.292038 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd6b06-cda4-46c4-8941-da41570e3101 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:55.351407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c09e7-a00e-4bf8-a42f-5715a0df88bb None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:55.369792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:55.394544 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc52ecf-2b77-470a-8f34-56407efb3f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:55.395209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc52ecf-2b77-470a-8f34-56407efb3f62 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:55.395493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc52ecf-2b77-470a-8f34-56407efb3f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:55.395823 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc52ecf-2b77-470a-8f34-56407efb3f62 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:55.396743 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc52ecf-2b77-470a-8f34-56407efb3f62 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:55.397044 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc52ecf-2b77-470a-8f34-56407efb3f62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:55.398947 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc52ecf-2b77-470a-8f34-56407efb3f62 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:55.410148 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 103/198] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:18:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:55.410785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc52ecf-2b77-470a-8f34-56407efb3f62 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:55.432290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd6b06-cda4-46c4-8941-da41570e3101 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:55.471593 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:55.478431 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1052975-efeb-482a-a742-13a6b4f2af3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:55.479466 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1052975-efeb-482a-a742-13a6b4f2af3b None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:55.479752 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1052975-efeb-482a-a742-13a6b4f2af3b None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:55.480404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1052975-efeb-482a-a742-13a6b4f2af3b None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:55.482165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1052975-efeb-482a-a742-13a6b4f2af3b None admin] RBAC: Authorizing `identity:get_project(project_id=f5e21a6b8db94073b1c84a6d986af044)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:55.483825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1052975-efeb-482a-a742-13a6b4f2af3b None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:55.485955 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 96/199] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:55 2022] GET /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:55.486751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1052975-efeb-482a-a742-13a6b4f2af3b None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:55.558596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc52ecf-2b77-470a-8f34-56407efb3f62 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:55.603854 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30438f9-aa55-4d9d-a140-fb78cbbdc109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:55.606570 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30438f9-aa55-4d9d-a140-fb78cbbdc109 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:55.607858 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30438f9-aa55-4d9d-a140-fb78cbbdc109 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:55.608320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30438f9-aa55-4d9d-a140-fb78cbbdc109 None admin] PATH_INFO: `/v3/users/cbca1598008e4ec3874722cde271d730` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:55.610351 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30438f9-aa55-4d9d-a140-fb78cbbdc109 None admin] RBAC: Authorizing `identity:get_user(user_id=cbca1598008e4ec3874722cde271d730)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:55.612584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30438f9-aa55-4d9d-a140-fb78cbbdc109 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:55.615049 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 104/200] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:55 2022] GET /identity/v3/users/cbca1598008e4ec3874722cde271d730 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:55.619535 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30438f9-aa55-4d9d-a140-fb78cbbdc109 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:55.629718 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1052975-efeb-482a-a742-13a6b4f2af3b None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:55.659992 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:55.674349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b45dc1-1d2e-4ac8-8c7e-9a0155cda15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:55.675564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b45dc1-1d2e-4ac8-8c7e-9a0155cda15d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:55.675852 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b45dc1-1d2e-4ac8-8c7e-9a0155cda15d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:55.676305 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b45dc1-1d2e-4ac8-8c7e-9a0155cda15d None admin] PATH_INFO: `/v3/users/a5fca4865c6a4402b146ba8da2300331` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:55.677712 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b45dc1-1d2e-4ac8-8c7e-9a0155cda15d None admin] RBAC: Authorizing `identity:get_user(user_id=a5fca4865c6a4402b146ba8da2300331)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:55.679734 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b45dc1-1d2e-4ac8-8c7e-9a0155cda15d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:55.682047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 97/201] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:55 2022] GET /identity/v3/users/a5fca4865c6a4402b146ba8da2300331 => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:55.683048 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b45dc1-1d2e-4ac8-8c7e-9a0155cda15d None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:55.759120 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30438f9-aa55-4d9d-a140-fb78cbbdc109 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:55.762822 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:55.808319 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc05fd-77d5-42fc-9c30-6930a04ab6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:55.809931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc05fd-77d5-42fc-9c30-6930a04ab6bc None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:55.811084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc05fd-77d5-42fc-9c30-6930a04ab6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:55.811752 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc05fd-77d5-42fc-9c30-6930a04ab6bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:55.813002 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc05fd-77d5-42fc-9c30-6930a04ab6bc None admin] RBAC: Adding query filter params (role.id=beed8caad097496292e544146859df5c, scope.project.id=f5e21a6b8db94073b1c84a6d986af044, user.id=cbca1598008e4ec3874722cde271d730) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:55.813983 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc05fd-77d5-42fc-9c30-6930a04ab6bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:55.815955 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc05fd-77d5-42fc-9c30-6930a04ab6bc None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:55.816791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b45dc1-1d2e-4ac8-8c7e-9a0155cda15d None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:55.828030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 105/202] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:55 2022] GET /identity/v3/role_assignments?user.id=cbca1598008e4ec3874722cde271d730&scope.project.id=f5e21a6b8db94073b1c84a6d986af044&role.id=beed8caad097496292e544146859df5c => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:55.829459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc05fd-77d5-42fc-9c30-6930a04ab6bc None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:55.890812 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e79021-8378-4d75-b6b8-589d343889a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:55.891707 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e79021-8378-4d75-b6b8-589d343889a9 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:55.892097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e79021-8378-4d75-b6b8-589d343889a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:55.892480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e79021-8378-4d75-b6b8-589d343889a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:55.989904 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:56.006082 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e79021-8378-4d75-b6b8-589d343889a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:56.024263 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e79021-8378-4d75-b6b8-589d343889a9 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:56.049718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc05fd-77d5-42fc-9c30-6930a04ab6bc None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:56.110822 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49bf86-fa29-471a-a176-b4db42c3a1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:56.111542 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49bf86-fa29-471a-a176-b4db42c3a1ee None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:56.114776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49bf86-fa29-471a-a176-b4db42c3a1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:56.115141 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49bf86-fa29-471a-a176-b4db42c3a1ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:56.217924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:56.234754 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 98/203] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:18:56.240641 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e79021-8378-4d75-b6b8-589d343889a9 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:56.288952 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49bf86-fa29-471a-a176-b4db42c3a1ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:56.292830 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49bf86-fa29-471a-a176-b4db42c3a1ee None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:56.368857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:56.379670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e79021-8378-4d75-b6b8-589d343889a9 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:56.430520 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f95851-8e3a-45e9-9ecd-e300c0938a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:56.431908 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f95851-8e3a-45e9-9ecd-e300c0938a8d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:56.434652 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f95851-8e3a-45e9-9ecd-e300c0938a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:56.435667 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f95851-8e3a-45e9-9ecd-e300c0938a8d None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:56.438028 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f95851-8e3a-45e9-9ecd-e300c0938a8d None admin] RBAC: Authorizing `identity:get_project(project_id=f5e21a6b8db94073b1c84a6d986af044)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:56.440606 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f95851-8e3a-45e9-9ecd-e300c0938a8d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:56.444975 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 99/204] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:56 2022] GET /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:56.450638 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f95851-8e3a-45e9-9ecd-e300c0938a8d None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:56.500629 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 106/205] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:18:56.506487 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49bf86-fa29-471a-a176-b4db42c3a1ee None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:56.634011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:56.650433 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f95851-8e3a-45e9-9ecd-e300c0938a8d None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:56.690465 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49bf86-fa29-471a-a176-b4db42c3a1ee None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:56.712727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b1fea-ec96-4834-8e76-b3130418ce20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:56.713381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b1fea-ec96-4834-8e76-b3130418ce20 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:56.713693 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b1fea-ec96-4834-8e76-b3130418ce20 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:56.713968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b1fea-ec96-4834-8e76-b3130418ce20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:56.714811 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b1fea-ec96-4834-8e76-b3130418ce20 None admin] RBAC: Adding query filter params (role.id=f6c74bb34f9c4b0faaf6a21007abcaa5, scope.project.id=f5e21a6b8db94073b1c84a6d986af044, user.id=cbca1598008e4ec3874722cde271d730) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:56.715123 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b1fea-ec96-4834-8e76-b3130418ce20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:56.716590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b1fea-ec96-4834-8e76-b3130418ce20 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:56.729662 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 100/206] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:56 2022] GET /identity/v3/role_assignments?user.id=cbca1598008e4ec3874722cde271d730&scope.project.id=f5e21a6b8db94073b1c84a6d986af044&role.id=f6c74bb34f9c4b0faaf6a21007abcaa5 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:56.763424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8d904-7007-49f5-bd37-9a6ac9426b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:56.764731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8d904-7007-49f5-bd37-9a6ac9426b04 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:56.765007 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8d904-7007-49f5-bd37-9a6ac9426b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:56.765286 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8d904-7007-49f5-bd37-9a6ac9426b04 None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:56.766526 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8d904-7007-49f5-bd37-9a6ac9426b04 None admin] RBAC: Authorizing `identity:get_project(project_id=5b12104d6dfe4464b0c1b5738679bdb1)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:56.767996 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd8d904-7007-49f5-bd37-9a6ac9426b04 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:56.769726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 107/207] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:56 2022] GET /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:56.776083 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b1fea-ec96-4834-8e76-b3130418ce20 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:56.811322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:56.912026 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b1fea-ec96-4834-8e76-b3130418ce20 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:56.954433 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61627747-de58-45bd-a14f-a50a49a0afd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:56.955092 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61627747-de58-45bd-a14f-a50a49a0afd2 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:56.955372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61627747-de58-45bd-a14f-a50a49a0afd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:56.955647 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61627747-de58-45bd-a14f-a50a49a0afd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:56.956491 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61627747-de58-45bd-a14f-a50a49a0afd2 None admin] RBAC: Adding query filter params (role.id=0b6428c4b6694007a2af55aa5d143e27, scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1, user.id=a5fca4865c6a4402b146ba8da2300331) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:56.956804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61627747-de58-45bd-a14f-a50a49a0afd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:56.958348 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61627747-de58-45bd-a14f-a50a49a0afd2 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:56.964620 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 101/208] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:56 2022] GET /identity/v3/role_assignments?user.id=a5fca4865c6a4402b146ba8da2300331&scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1&role.id=0b6428c4b6694007a2af55aa5d143e27 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:57.536227 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c4de5-473d-4154-8c81-96e4f68729b1 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:57.536727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c4de5-473d-4154-8c81-96e4f68729b1 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:57.536825 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c4de5-473d-4154-8c81-96e4f68729b1 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:57.540713 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 108/209] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:57.540825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0e93f-4eb2-4206-a509-337becc16503 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:57.540825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0e93f-4eb2-4206-a509-337becc16503 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:57.540825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0e93f-4eb2-4206-a509-337becc16503 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:57.540825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 102/210] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:57.544008 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38a257-6335-432c-ab3d-d4802f42220f None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:57.544299 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38a257-6335-432c-ab3d-d4802f42220f None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:57.545111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38a257-6335-432c-ab3d-d4802f42220f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:57.547444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6674f-ad52-4750-8c50-640eb03f8a89 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:57.547935 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6674f-ad52-4750-8c50-640eb03f8a89 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:57.548423 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6674f-ad52-4750-8c50-640eb03f8a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:57.567234 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-da38a257-6335-432c-ab3d-d4802f42220f None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:57.567570 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-da38a257-6335-432c-ab3d-d4802f42220f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:57.567981 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-3ab6674f-ad52-4750-8c50-640eb03f8a89 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:57.569353 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-3ab6674f-ad52-4750-8c50-640eb03f8a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:57.646323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 109/211] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:57.647689 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 103/212] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:57.671283 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38a257-6335-432c-ab3d-d4802f42220f None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:57.672108 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6674f-ad52-4750-8c50-640eb03f8a89 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:57.693277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:57.770014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:57.797641 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38a257-6335-432c-ab3d-d4802f42220f None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:57.797796 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6674f-ad52-4750-8c50-640eb03f8a89 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:57.827922 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348afa0-4220-4041-9dba-7fd2980c48ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:57.829003 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348afa0-4220-4041-9dba-7fd2980c48ce None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:57.829587 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348afa0-4220-4041-9dba-7fd2980c48ce None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:57.830076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348afa0-4220-4041-9dba-7fd2980c48ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:57.832953 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37be81-9746-4577-a107-feee5c7908d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:57.834170 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37be81-9746-4577-a107-feee5c7908d4 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:57.834558 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37be81-9746-4577-a107-feee5c7908d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:57.834952 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37be81-9746-4577-a107-feee5c7908d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:57.836415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37be81-9746-4577-a107-feee5c7908d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:57.838089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37be81-9746-4577-a107-feee5c7908d4 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:57.845587 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 110/213] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:18:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:57.846306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348afa0-4220-4041-9dba-7fd2980c48ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:57.846482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37be81-9746-4577-a107-feee5c7908d4 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:57.854984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-a348afa0-4220-4041-9dba-7fd2980c48ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:18:57.854984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:57.854984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:57.854984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:57.854984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:57.854984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:57.854984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:57.854984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:57.854984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:57.854984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:57.854984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:57.854984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:57.854984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:57.854984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:57.854984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:57.854984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:57.855845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:57.855845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:57.855845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:57.855845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:57.855845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:57.855845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:57.855845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:57.855845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:57.855845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:57.855845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:57.855845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:57.855845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:57.855845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:57.855845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:57.855845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:57.855845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:57.856635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:57.856635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:57.856635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:57.856635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:57.856635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:57.856635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:57.856635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:57.856635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:57.856635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:57.856635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:57.856635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:18:57.856635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:18:57.859634 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 104/214] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:18:57.865730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348afa0-4220-4041-9dba-7fd2980c48ce None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:57.956847 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37be81-9746-4577-a107-feee5c7908d4 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:57.962005 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:57.979661 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348afa0-4220-4041-9dba-7fd2980c48ce None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:57.993541 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa91762-a758-4377-910f-840345536179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:57.994226 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa91762-a758-4377-910f-840345536179 None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:57.994507 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa91762-a758-4377-910f-840345536179 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:57.994784 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa91762-a758-4377-910f-840345536179 None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:57.995591 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa91762-a758-4377-910f-840345536179 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:57.996960 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa91762-a758-4377-910f-840345536179 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:58.003880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:58.019104 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c5036-6ad8-4565-8afa-25fddfa0b959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:58.020346 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c5036-6ad8-4565-8afa-25fddfa0b959 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:58.020346 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c5036-6ad8-4565-8afa-25fddfa0b959 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:58.020346 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c5036-6ad8-4565-8afa-25fddfa0b959 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:58.021110 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c5036-6ad8-4565-8afa-25fddfa0b959 None admin] RBAC: Adding query filter params (name=member) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:58.021418 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c5036-6ad8-4565-8afa-25fddfa0b959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:58.022868 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c5036-6ad8-4565-8afa-25fddfa0b959 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:58.032667 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 105/215] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:18:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:58.038368 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c5036-6ad8-4565-8afa-25fddfa0b959 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:58.105968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 111/216] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 08:18:57 2022] POST /identity/v3/users => generated 297 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:18:58.147678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1cd66-d206-4da8-9d39-9242b53ee3e4 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:58.147678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1cd66-d206-4da8-9d39-9242b53ee3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:58.147678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1cd66-d206-4da8-9d39-9242b53ee3e4 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:58.149547 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 112/217] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:18:58.155805 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b317e0-ee66-4c00-8f6e-e9bda8e9005b None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:58.156113 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b317e0-ee66-4c00-8f6e-e9bda8e9005b None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:58.156373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b317e0-ee66-4c00-8f6e-e9bda8e9005b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:58.166529 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c5036-6ad8-4565-8afa-25fddfa0b959 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:58.175707 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-60b317e0-ee66-4c00-8f6e-e9bda8e9005b None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:58.176990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-60b317e0-ee66-4c00-8f6e-e9bda8e9005b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:58.218100 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2424bda-737c-4c29-ae74-650ed0f89611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:58.219435 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2424bda-737c-4c29-ae74-650ed0f89611 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:58.220001 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2424bda-737c-4c29-ae74-650ed0f89611 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:58.220532 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2424bda-737c-4c29-ae74-650ed0f89611 None admin] PATH_INFO: `/v3/users/34e9c1abcf2248c8a46895df6b54168e` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:58.239588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:58.245814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2424bda-737c-4c29-ae74-650ed0f89611 None admin] RBAC: Authorizing `identity:get_user(user_id=34e9c1abcf2248c8a46895df6b54168e)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:58.247291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2424bda-737c-4c29-ae74-650ed0f89611 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:58.250018 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 106/218] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:58 2022] GET /identity/v3/users/34e9c1abcf2248c8a46895df6b54168e => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:58.255619 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2424bda-737c-4c29-ae74-650ed0f89611 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:58.269615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 113/219] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:58.298258 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b317e0-ee66-4c00-8f6e-e9bda8e9005b None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:58.394667 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2424bda-737c-4c29-ae74-650ed0f89611 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:58.435690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b317e0-ee66-4c00-8f6e-e9bda8e9005b None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:58.437103 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70877d-7335-4f69-bc8d-e0905beebf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:58.438500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70877d-7335-4f69-bc8d-e0905beebf9b None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:58.438500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70877d-7335-4f69-bc8d-e0905beebf9b None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:58.438500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70877d-7335-4f69-bc8d-e0905beebf9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:58.462718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:58.480779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6b21e-8218-4c43-b121-6aa6dea1d172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:58.481650 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6b21e-8218-4c43-b121-6aa6dea1d172 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:58.485966 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6b21e-8218-4c43-b121-6aa6dea1d172 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:58.485966 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6b21e-8218-4c43-b121-6aa6dea1d172 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:58.494825 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6b21e-8218-4c43-b121-6aa6dea1d172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:58.503331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-7bc6b21e-8218-4c43-b121-6aa6dea1d172 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:58.503331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:58.503331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:58.503331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:58.503331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:58.503331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:58.503331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:58.503331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:58.503331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:58.503331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:58.503331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:58.503331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:58.503331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:58.503331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:58.503331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:58.503331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:58.504222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:58.504222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:58.504222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:58.504222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:58.504222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:58.504222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:58.504222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:58.504222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:58.504222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:58.504222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:58.504222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:58.504222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:58.504222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:58.504222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:58.504222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:58.504222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:58.505012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:58.505012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:58.505012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:58.505012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:58.505012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:58.505012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:58.505012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:58.505012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:58.505012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:58.505012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:58.505012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:18:58.505012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:18:58.505012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 114/220] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:18:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:58.511592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6b21e-8218-4c43-b121-6aa6dea1d172 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:58.531505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:58.535618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70877d-7335-4f69-bc8d-e0905beebf9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:58.538165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70877d-7335-4f69-bc8d-e0905beebf9b None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:58.646814 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6b21e-8218-4c43-b121-6aa6dea1d172 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:58.668281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 107/221] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:18:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:18:58.674771 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70877d-7335-4f69-bc8d-e0905beebf9b None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:58.693087 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca848f-5540-4e7f-9c1a-b468d2fa8617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:58.694059 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca848f-5540-4e7f-9c1a-b468d2fa8617 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:58.694354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca848f-5540-4e7f-9c1a-b468d2fa8617 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:58.694643 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca848f-5540-4e7f-9c1a-b468d2fa8617 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:58.695793 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca848f-5540-4e7f-9c1a-b468d2fa8617 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:58.696108 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca848f-5540-4e7f-9c1a-b468d2fa8617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:58.697515 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca848f-5540-4e7f-9c1a-b468d2fa8617 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:58.708483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 115/222] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:18:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:58.718975 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca848f-5540-4e7f-9c1a-b468d2fa8617 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:58.800252 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:58.858441 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca848f-5540-4e7f-9c1a-b468d2fa8617 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:58.880770 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:58.886064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70877d-7335-4f69-bc8d-e0905beebf9b None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:58.928514 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caa8ae-8949-4d57-b9ec-1d4046655ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:58.929663 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caa8ae-8949-4d57-b9ec-1d4046655ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:58.930086 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caa8ae-8949-4d57-b9ec-1d4046655ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:58.930503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4caa8ae-8949-4d57-b9ec-1d4046655ab7 None admin] PATH_INFO: `/v3/users/cbca1598008e4ec3874722cde271d730` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:58.931861 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4caa8ae-8949-4d57-b9ec-1d4046655ab7 None admin] RBAC: Authorizing `identity:get_user(user_id=cbca1598008e4ec3874722cde271d730)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:58.934466 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4caa8ae-8949-4d57-b9ec-1d4046655ab7 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:58.936312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 116/223] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:58 2022] GET /identity/v3/users/cbca1598008e4ec3874722cde271d730 => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:58.942073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caa8ae-8949-4d57-b9ec-1d4046655ab7 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:58.957279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bac8d6-a1da-42d0-a571-d94daccc266d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:58.958396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bac8d6-a1da-42d0-a571-d94daccc266d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:58.958821 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bac8d6-a1da-42d0-a571-d94daccc266d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:58.959258 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bac8d6-a1da-42d0-a571-d94daccc266d None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:58.962353 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bac8d6-a1da-42d0-a571-d94daccc266d None admin] RBAC: Authorizing `identity:get_project(project_id=f5e21a6b8db94073b1c84a6d986af044)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:58.964400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bac8d6-a1da-42d0-a571-d94daccc266d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:58.966835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 108/224] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:58 2022] GET /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044 => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:58.972848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bac8d6-a1da-42d0-a571-d94daccc266d None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:59.074501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bac8d6-a1da-42d0-a571-d94daccc266d None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:59.110692 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86978b99-a95c-4fc5-9864-8a319eab968f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:59.111587 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86978b99-a95c-4fc5-9864-8a319eab968f None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:59.112013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86978b99-a95c-4fc5-9864-8a319eab968f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:59.112428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86978b99-a95c-4fc5-9864-8a319eab968f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:59.113435 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86978b99-a95c-4fc5-9864-8a319eab968f None admin] RBAC: Adding query filter params (role.id=80c590b37af34bca8dee5f7c87a38999, scope.project.id=f5e21a6b8db94073b1c84a6d986af044, user.id=34e9c1abcf2248c8a46895df6b54168e) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:59.113915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86978b99-a95c-4fc5-9864-8a319eab968f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:59.115499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86978b99-a95c-4fc5-9864-8a319eab968f None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:59.121442 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 109/225] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:18:58 2022] GET /identity/v3/role_assignments?user.id=34e9c1abcf2248c8a46895df6b54168e&scope.project.id=f5e21a6b8db94073b1c84a6d986af044&role.id=80c590b37af34bca8dee5f7c87a38999 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:59.129877 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6f9ee-af8f-4c02-a55b-58bde04400ea None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:59.137704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6f9ee-af8f-4c02-a55b-58bde04400ea None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:59.137704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6f9ee-af8f-4c02-a55b-58bde04400ea None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:59.138983 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 110/226] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:18:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:18:59.140956 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81c08a-79e7-4c9d-b1b7-99a9be53e8a4 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:59.141385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81c08a-79e7-4c9d-b1b7-99a9be53e8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:59.142110 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b81c08a-79e7-4c9d-b1b7-99a9be53e8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:59.148801 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4caa8ae-8949-4d57-b9ec-1d4046655ab7 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:59.162990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-2b81c08a-79e7-4c9d-b1b7-99a9be53e8a4 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:18:59.165068 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-2b81c08a-79e7-4c9d-b1b7-99a9be53e8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:18:59.167617 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:59.197587 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:59.220871 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9330b11-dc9d-4497-91e4-2ff5b78eb1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:59.222162 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9330b11-dc9d-4497-91e4-2ff5b78eb1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:59.222705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9330b11-dc9d-4497-91e4-2ff5b78eb1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:59.223208 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9330b11-dc9d-4497-91e4-2ff5b78eb1f6 None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:59.230622 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9330b11-dc9d-4497-91e4-2ff5b78eb1f6 None admin] RBAC: Authorizing `identity:get_project(project_id=f5e21a6b8db94073b1c84a6d986af044)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:59.234590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9330b11-dc9d-4497-91e4-2ff5b78eb1f6 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:59.236656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 117/227] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:58 2022] GET /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044 => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:59.242506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9330b11-dc9d-4497-91e4-2ff5b78eb1f6 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:59.244488 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 111/228] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:18:59.289491 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81c08a-79e7-4c9d-b1b7-99a9be53e8a4 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:59.404778 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9330b11-dc9d-4497-91e4-2ff5b78eb1f6 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:59.440724 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23206c-63dc-4c9b-bd97-421af3b8d7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:59.442075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23206c-63dc-4c9b-bd97-421af3b8d7de None admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:59.442551 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23206c-63dc-4c9b-bd97-421af3b8d7de None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:59.443015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23206c-63dc-4c9b-bd97-421af3b8d7de None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044/users/cbca1598008e4ec3874722cde271d730/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:59.445182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23206c-63dc-4c9b-bd97-421af3b8d7de None admin] RBAC: Authorizing `identity:create_grant(project_id=f5e21a6b8db94073b1c84a6d986af044, user_id=cbca1598008e4ec3874722cde271d730, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:59.446374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b81c08a-79e7-4c9d-b1b7-99a9be53e8a4 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:59.447131 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23206c-63dc-4c9b-bd97-421af3b8d7de None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:59.484275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cb093-67e4-4cd6-b239-8fd65fba088d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:59.485007 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cb093-67e4-4cd6-b239-8fd65fba088d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:59.485289 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cb093-67e4-4cd6-b239-8fd65fba088d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:59.485593 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cb093-67e4-4cd6-b239-8fd65fba088d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:59.496125 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cb093-67e4-4cd6-b239-8fd65fba088d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:18:59.511267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-306cb093-67e4-4cd6-b239-8fd65fba088d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:18:59.511267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:18:59.511267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:18:59.511267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:18:59.511267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:18:59.511267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:18:59.511267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:18:59.511267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:18:59.511267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:18:59.511267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:18:59.511267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:18:59.511267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:18:59.511267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:18:59.511267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:18:59.511267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:18:59.511267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:18:59.518131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:18:59.518131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:18:59.518131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:18:59.518131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:18:59.518131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:18:59.518131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:18:59.518131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:18:59.518131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:18:59.518131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:18:59.518131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:18:59.518131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:18:59.518131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:18:59.518131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:18:59.518131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:18:59.518131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:18:59.518131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:18:59.518951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:18:59.518951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:18:59.518951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:18:59.518951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:18:59.518951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:18:59.518951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:18:59.518951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:18:59.518951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:18:59.518951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:18:59.518951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:18:59.518951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:18:59.518951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:18:59.518951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 112/229] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:18:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:18:59.522114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cb093-67e4-4cd6-b239-8fd65fba088d None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:59.543787 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 118/230] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:18:59 2022] PUT /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044/users/cbca1598008e4ec3874722cde271d730/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:18:59.547889 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:59.638830 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cb093-67e4-4cd6-b239-8fd65fba088d None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:59.676078 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d799d-3323-45cf-af64-3b21be752de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:59.676764 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d799d-3323-45cf-af64-3b21be752de1 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:59.677048 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d799d-3323-45cf-af64-3b21be752de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:59.677323 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d799d-3323-45cf-af64-3b21be752de1 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:59.678131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d799d-3323-45cf-af64-3b21be752de1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:18:59.678439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d799d-3323-45cf-af64-3b21be752de1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:59.679848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d799d-3323-45cf-af64-3b21be752de1 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:59.690012 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 113/231] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:18:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:18:59.696940 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23206c-63dc-4c9b-bd97-421af3b8d7de None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:59.776333 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:18:59.866333 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23206c-63dc-4c9b-bd97-421af3b8d7de None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:18:59.900802 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2d5e1-0909-4094-9de9-62532ad3c2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:18:59.901711 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2d5e1-0909-4094-9de9-62532ad3c2df None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:18:59.901996 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2d5e1-0909-4094-9de9-62532ad3c2df None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:18:59.902271 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2d5e1-0909-4094-9de9-62532ad3c2df None admin] PATH_INFO: `/v3/users/cbca1598008e4ec3874722cde271d730` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:18:59.903469 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2d5e1-0909-4094-9de9-62532ad3c2df None admin] RBAC: Authorizing `identity:get_user(user_id=cbca1598008e4ec3874722cde271d730)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:18:59.904960 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2d5e1-0909-4094-9de9-62532ad3c2df None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:18:59.906928 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 119/232] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:18:59 2022] GET /identity/v3/users/cbca1598008e4ec3874722cde271d730 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:18:59.913284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d799d-3323-45cf-af64-3b21be752de1 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:18:59.999592 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:00.018162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d799d-3323-45cf-af64-3b21be752de1 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:00.057486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da5433-2a5a-4e29-b47d-0ae798ce030b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:00.058552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da5433-2a5a-4e29-b47d-0ae798ce030b None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:00.059094 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da5433-2a5a-4e29-b47d-0ae798ce030b None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:00.059377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da5433-2a5a-4e29-b47d-0ae798ce030b None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:00.061376 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da5433-2a5a-4e29-b47d-0ae798ce030b None admin] RBAC: Authorizing `identity:get_project(project_id=f5e21a6b8db94073b1c84a6d986af044)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:00.063592 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da5433-2a5a-4e29-b47d-0ae798ce030b None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:00.066070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 114/233] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:18:59 2022] GET /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:00.072787 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2d5e1-0909-4094-9de9-62532ad3c2df None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:00.194576 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2d5e1-0909-4094-9de9-62532ad3c2df None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:00.202312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:00.230848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359bdfd-1b64-4798-85a2-be9cbd377c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:00.231781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359bdfd-1b64-4798-85a2-be9cbd377c93 None admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:00.233006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359bdfd-1b64-4798-85a2-be9cbd377c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:00.233295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359bdfd-1b64-4798-85a2-be9cbd377c93 None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044/users/cbca1598008e4ec3874722cde271d730/roles/f6c74bb34f9c4b0faaf6a21007abcaa5` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:00.235639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359bdfd-1b64-4798-85a2-be9cbd377c93 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5e21a6b8db94073b1c84a6d986af044, user_id=cbca1598008e4ec3874722cde271d730, role_id=f6c74bb34f9c4b0faaf6a21007abcaa5)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:00.237115 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359bdfd-1b64-4798-85a2-be9cbd377c93 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:00.333443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 120/234] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:19:00 2022] PUT /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044/users/cbca1598008e4ec3874722cde271d730/roles/f6c74bb34f9c4b0faaf6a21007abcaa5 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:19:00.575148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fe1a1-8b0c-470a-85e0-3426364ae1ee None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:00.576050 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fe1a1-8b0c-470a-85e0-3426364ae1ee None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:00.576277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fe1a1-8b0c-470a-85e0-3426364ae1ee None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:00.577984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 115/235] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:00.583544 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ca6fa-a78b-4991-bd7b-a15a70568012 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:00.583809 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ca6fa-a78b-4991-bd7b-a15a70568012 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:00.584050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ca6fa-a78b-4991-bd7b-a15a70568012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:00.604950 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-790ca6fa-a78b-4991-bd7b-a15a70568012 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:00.606196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-790ca6fa-a78b-4991-bd7b-a15a70568012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:00.691978 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 121/236] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:00.717003 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fe1a1-8b0c-470a-85e0-3426364ae1ee None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:00.870855 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fe1a1-8b0c-470a-85e0-3426364ae1ee None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:00.918376 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846315f-39ea-423e-b64f-573d266c1d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:00.919172 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846315f-39ea-423e-b64f-573d266c1d7b None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:00.919495 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846315f-39ea-423e-b64f-573d266c1d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:00.919771 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846315f-39ea-423e-b64f-573d266c1d7b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:00.938363 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6846315f-39ea-423e-b64f-573d266c1d7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:00.946117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-6846315f-39ea-423e-b64f-573d266c1d7b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:19:00.946117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:00.946117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:00.946117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:00.946117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:00.946117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:00.946117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:00.946117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:00.946117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:00.946117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:00.946117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:00.946117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:00.946117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:00.946117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:00.946117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:00.946117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:00.947177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:00.947177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:00.947177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:00.947177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:00.947177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:00.947177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:00.947177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:00.947177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:00.947177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:00.947177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:00.947177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:00.947177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:00.947177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:00.947177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:00.947177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:00.947177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:00.948181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:00.948181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:00.948181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:00.948181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:00.948181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:00.948181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:00.948181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:00.948181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:00.948181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:00.948181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:00.948181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:19:00.948181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:00.948181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 116/237] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:00.953741 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ca6fa-a78b-4991-bd7b-a15a70568012 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:01.056562 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0c41a-1039-4f4b-a208-1adace991d7c None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:01.057385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0c41a-1039-4f4b-a208-1adace991d7c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:01.057827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0c41a-1039-4f4b-a208-1adace991d7c None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:01.059553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 117/238] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:01.067528 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b76e0-b86c-430d-9ec8-26307e60029b None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:01.068031 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b76e0-b86c-430d-9ec8-26307e60029b None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:01.068456 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b76e0-b86c-430d-9ec8-26307e60029b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:01.102033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-850b76e0-b86c-430d-9ec8-26307e60029b None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:01.103490 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-850b76e0-b86c-430d-9ec8-26307e60029b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:01.109414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:01.112333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:01.121080 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ca6fa-a78b-4991-bd7b-a15a70568012 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:01.186449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c946f8b-e52c-46be-aa6c-92f1e2dceb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:01.187129 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c946f8b-e52c-46be-aa6c-92f1e2dceb37 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:01.187412 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c946f8b-e52c-46be-aa6c-92f1e2dceb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:01.187684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c946f8b-e52c-46be-aa6c-92f1e2dceb37 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:01.188432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c946f8b-e52c-46be-aa6c-92f1e2dceb37 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:01.188737 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c946f8b-e52c-46be-aa6c-92f1e2dceb37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:01.190156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c946f8b-e52c-46be-aa6c-92f1e2dceb37 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:01.211752 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 122/239] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:19:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:01.217974 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 118/240] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:19:01.218384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c946f8b-e52c-46be-aa6c-92f1e2dceb37 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:01.266150 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b76e0-b86c-430d-9ec8-26307e60029b None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:01.389788 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c946f8b-e52c-46be-aa6c-92f1e2dceb37 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:01.393795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b76e0-b86c-430d-9ec8-26307e60029b None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:01.434088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9fe25-247f-4a00-af62-5d56f86ddb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:01.434918 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9fe25-247f-4a00-af62-5d56f86ddb07 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:01.435200 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9fe25-247f-4a00-af62-5d56f86ddb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:01.435471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9fe25-247f-4a00-af62-5d56f86ddb07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:01.437565 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9fe25-247f-4a00-af62-5d56f86ddb07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:01.439019 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9fe25-247f-4a00-af62-5d56f86ddb07 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:01.440625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 119/241] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:01.447116 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9fe25-247f-4a00-af62-5d56f86ddb07 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:01.468547 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882a8c9-6ce6-40eb-8239-d5e04770f8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:01.469417 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882a8c9-6ce6-40eb-8239-d5e04770f8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:01.469720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882a8c9-6ce6-40eb-8239-d5e04770f8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:01.469991 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882a8c9-6ce6-40eb-8239-d5e04770f8c4 None admin] PATH_INFO: `/v3/users/27ae7afb9a6d45b8b533d94b27cf8f5f` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:01.470775 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:01.499185 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882a8c9-6ce6-40eb-8239-d5e04770f8c4 None admin] RBAC: Authorizing `identity:get_user(user_id=27ae7afb9a6d45b8b533d94b27cf8f5f)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:01.500648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882a8c9-6ce6-40eb-8239-d5e04770f8c4 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:01.504415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 123/242] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:19:01 2022] GET /identity/v3/users/27ae7afb9a6d45b8b533d94b27cf8f5f => generated 297 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:01.510796 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882a8c9-6ce6-40eb-8239-d5e04770f8c4 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:01.536935 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:01.651170 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9fe25-247f-4a00-af62-5d56f86ddb07 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:01.710271 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882a8c9-6ce6-40eb-8239-d5e04770f8c4 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:01.715667 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4345d-45d7-4244-bc3d-23f213ca215a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:01.716394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4345d-45d7-4244-bc3d-23f213ca215a None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:01.716678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4345d-45d7-4244-bc3d-23f213ca215a None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:01.716956 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4345d-45d7-4244-bc3d-23f213ca215a None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:01.717713 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4345d-45d7-4244-bc3d-23f213ca215a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:01.719183 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4345d-45d7-4244-bc3d-23f213ca215a None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:01.768830 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79e250-4684-4658-a5e4-b98e47a94ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:01.769488 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79e250-4684-4658-a5e4-b98e47a94ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:01.769818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79e250-4684-4658-a5e4-b98e47a94ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:01.770152 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79e250-4684-4658-a5e4-b98e47a94ad4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:01.836536 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 120/243] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 08:19:01 2022] POST /identity/v3/users => generated 293 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:19:01.843830 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b2074-dc43-4255-bae7-233348084756 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:01.843830 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b2074-dc43-4255-bae7-233348084756 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:01.843830 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b2074-dc43-4255-bae7-233348084756 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:01.843830 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 121/244] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:01.846928 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc54e6-928a-4be9-87d3-ef988487c932 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:01.847240 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc54e6-928a-4be9-87d3-ef988487c932 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:01.847499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc54e6-928a-4be9-87d3-ef988487c932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:01.862633 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79e250-4684-4658-a5e4-b98e47a94ad4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:01.865106 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79e250-4684-4658-a5e4-b98e47a94ad4 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:01.869162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-ebdc54e6-928a-4be9-87d3-ef988487c932 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:01.869162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ebdc54e6-928a-4be9-87d3-ef988487c932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:01.906571 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:01.995794 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:02.007312 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 122/245] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:02.052503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc54e6-928a-4be9-87d3-ef988487c932 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:02.054142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 124/246] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:19:02.065339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79e250-4684-4658-a5e4-b98e47a94ad4 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:02.190359 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc54e6-928a-4be9-87d3-ef988487c932 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:02.207105 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79e250-4684-4658-a5e4-b98e47a94ad4 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:02.230896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:02.234538 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27d4ef-4ed5-407a-939c-3bf001e50671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:02.235333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27d4ef-4ed5-407a-939c-3bf001e50671 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:02.235611 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27d4ef-4ed5-407a-939c-3bf001e50671 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:02.236253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27d4ef-4ed5-407a-939c-3bf001e50671 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:02.248707 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27d4ef-4ed5-407a-939c-3bf001e50671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:02.253859 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d895d-c13f-4cd1-b72d-c16860e56907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:02.254730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d895d-c13f-4cd1-b72d-c16860e56907 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:02.255009 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d895d-c13f-4cd1-b72d-c16860e56907 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:02.255288 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d895d-c13f-4cd1-b72d-c16860e56907 None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:02.256489 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d895d-c13f-4cd1-b72d-c16860e56907 None admin] RBAC: Authorizing `identity:get_project(project_id=f5e21a6b8db94073b1c84a6d986af044)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:02.256873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-2b27d4ef-4ed5-407a-939c-3bf001e50671 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:02.256873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:02.256873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:02.256873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:02.256873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:02.256873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:02.256873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:02.256873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:02.256873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:02.256873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:02.256873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:02.256873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:02.256873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:02.256873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:02.256873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:02.256873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:02.257819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:02.257819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:02.257819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:02.257819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:02.257819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:02.257819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:02.257819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:02.257819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:02.257819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:02.257819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:02.257819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:02.257819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:02.257819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:02.257819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:02.257819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:02.257819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:02.258602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:02.258602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:02.258602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:02.258602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:02.258602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:02.258602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:02.258602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:02.258602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:02.258602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:02.258602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:02.258602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:02.258602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:02.258602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 123/247] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:02.259238 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d895d-c13f-4cd1-b72d-c16860e56907 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:02.259302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473daa8-8a43-412e-aa18-fd8d923412ed None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:02.259898 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473daa8-8a43-412e-aa18-fd8d923412ed None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:02.259898 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473daa8-8a43-412e-aa18-fd8d923412ed None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:02.265545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 125/248] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:02 2022] GET /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:02.265756 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 124/249] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:02.267761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccb9c5-1b60-4964-b7c9-dd6b7f8f8487 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:02.268075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccb9c5-1b60-4964-b7c9-dd6b7f8f8487 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:02.268523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fccb9c5-1b60-4964-b7c9-dd6b7f8f8487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:02.271471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473daa8-8a43-412e-aa18-fd8d923412ed None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:02.298999 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-5fccb9c5-1b60-4964-b7c9-dd6b7f8f8487 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:02.300296 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5fccb9c5-1b60-4964-b7c9-dd6b7f8f8487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:02.336122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:02.382940 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 126/250] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:19:02.383891 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccb9c5-1b60-4964-b7c9-dd6b7f8f8487 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:02.392276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473daa8-8a43-412e-aa18-fd8d923412ed None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:02.434382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed4108-d415-4b3c-af0d-9aeaea486622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:02.435394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed4108-d415-4b3c-af0d-9aeaea486622 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:02.435860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed4108-d415-4b3c-af0d-9aeaea486622 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:02.436339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed4108-d415-4b3c-af0d-9aeaea486622 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:02.437277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed4108-d415-4b3c-af0d-9aeaea486622 None admin] RBAC: Adding query filter params (name=member) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:02.437798 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed4108-d415-4b3c-af0d-9aeaea486622 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:02.439370 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed4108-d415-4b3c-af0d-9aeaea486622 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:02.448679 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 125/251] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:19:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:02.449737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed4108-d415-4b3c-af0d-9aeaea486622 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:02.498212 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fccb9c5-1b60-4964-b7c9-dd6b7f8f8487 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:02.513334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:02.535808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc886b-297b-4e16-a61d-b5ff4f030e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:02.536473 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc886b-297b-4e16-a61d-b5ff4f030e72 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:02.536756 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc886b-297b-4e16-a61d-b5ff4f030e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:02.537033 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc886b-297b-4e16-a61d-b5ff4f030e72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:02.537909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc886b-297b-4e16-a61d-b5ff4f030e72 None admin] RBAC: Adding query filter params (role.id=0b6428c4b6694007a2af55aa5d143e27, scope.project.id=f5e21a6b8db94073b1c84a6d986af044, user.id=27ae7afb9a6d45b8b533d94b27cf8f5f) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:02.538225 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc886b-297b-4e16-a61d-b5ff4f030e72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:02.539676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc886b-297b-4e16-a61d-b5ff4f030e72 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:02.546229 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 127/252] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:19:02 2022] GET /identity/v3/role_assignments?user.id=27ae7afb9a6d45b8b533d94b27cf8f5f&scope.project.id=f5e21a6b8db94073b1c84a6d986af044&role.id=0b6428c4b6694007a2af55aa5d143e27 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:02.546871 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc886b-297b-4e16-a61d-b5ff4f030e72 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:02.583671 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed4108-d415-4b3c-af0d-9aeaea486622 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:02.603242 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:02.639409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fffba-a495-4223-8f1a-3b999b416d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:02.640956 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fffba-a495-4223-8f1a-3b999b416d19 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:02.641460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fffba-a495-4223-8f1a-3b999b416d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:02.646019 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fffba-a495-4223-8f1a-3b999b416d19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:02.663323 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fffba-a495-4223-8f1a-3b999b416d19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:02.663901 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc886b-297b-4e16-a61d-b5ff4f030e72 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:02.672355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-1e2fffba-a495-4223-8f1a-3b999b416d19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:19:02.672355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:02.672355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:02.672355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:02.672355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:02.672355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:02.672355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:02.672355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:02.672355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:02.672355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:02.672355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:02.672355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:02.672355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:02.672355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:02.672355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:02.672355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:02.673314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:02.673314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:02.673314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:02.673314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:02.673314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:02.673314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:02.673314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:02.673314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:02.673314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:02.673314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:02.673314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:02.673314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:02.673314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:02.673314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:02.673314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:02.673314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:02.674174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:02.674174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:02.674174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:02.674174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:02.674174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:02.674174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:02.674174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:02.674174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:02.674174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:02.674174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:02.674174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:19:02.674174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:02.683575 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 126/253] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:19:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:02.689596 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fffba-a495-4223-8f1a-3b999b416d19 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:02.702089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34487c53-82ea-4116-bc4a-75d22ae66e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:02.703485 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34487c53-82ea-4116-bc4a-75d22ae66e88 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:02.703485 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34487c53-82ea-4116-bc4a-75d22ae66e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:02.703485 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34487c53-82ea-4116-bc4a-75d22ae66e88 None admin] PATH_INFO: `/v3/users/34e9c1abcf2248c8a46895df6b54168e` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:02.704669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34487c53-82ea-4116-bc4a-75d22ae66e88 None admin] RBAC: Authorizing `identity:get_user(user_id=34e9c1abcf2248c8a46895df6b54168e)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:02.706232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34487c53-82ea-4116-bc4a-75d22ae66e88 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:02.708371 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 128/254] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:19:02 2022] GET /identity/v3/users/34e9c1abcf2248c8a46895df6b54168e => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:02.715428 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34487c53-82ea-4116-bc4a-75d22ae66e88 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:02.777930 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:02.834130 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34487c53-82ea-4116-bc4a-75d22ae66e88 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:02.872715 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e62eb-3a4c-4475-9554-98fa2991ef6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:02.873697 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e62eb-3a4c-4475-9554-98fa2991ef6c None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:02.874083 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e62eb-3a4c-4475-9554-98fa2991ef6c None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:02.874402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e62eb-3a4c-4475-9554-98fa2991ef6c None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:02.875642 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e62eb-3a4c-4475-9554-98fa2991ef6c None admin] RBAC: Authorizing `identity:get_project(project_id=f5e21a6b8db94073b1c84a6d986af044)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:02.877111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e62eb-3a4c-4475-9554-98fa2991ef6c None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:02.879420 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 129/255] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:02 2022] GET /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:02.880744 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf67d1-4bed-46b5-9941-c96b4f018d2a None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:02.881035 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf67d1-4bed-46b5-9941-c96b4f018d2a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:02.881314 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf67d1-4bed-46b5-9941-c96b4f018d2a None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:02.883134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 130/256] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:02.888503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf67d1-4bed-46b5-9941-c96b4f018d2a None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:02.975558 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fffba-a495-4223-8f1a-3b999b416d19 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:02.998828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf67d1-4bed-46b5-9941-c96b4f018d2a None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:03.015307 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:03.035895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ad746-6187-41a6-9ab3-a1e1961ba2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:03.036795 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ad746-6187-41a6-9ab3-a1e1961ba2e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:03.037077 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ad746-6187-41a6-9ab3-a1e1961ba2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:03.037353 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ad746-6187-41a6-9ab3-a1e1961ba2e3 None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044/users/34e9c1abcf2248c8a46895df6b54168e/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:03.039892 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ad746-6187-41a6-9ab3-a1e1961ba2e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5e21a6b8db94073b1c84a6d986af044, user_id=34e9c1abcf2248c8a46895df6b54168e, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:03.041993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ad746-6187-41a6-9ab3-a1e1961ba2e3 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:03.063304 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19725c1-b2ac-476f-b362-fa352dcc37c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:03.064207 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19725c1-b2ac-476f-b362-fa352dcc37c7 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:03.064655 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19725c1-b2ac-476f-b362-fa352dcc37c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:03.064998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19725c1-b2ac-476f-b362-fa352dcc37c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:03.065908 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19725c1-b2ac-476f-b362-fa352dcc37c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:03.066331 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19725c1-b2ac-476f-b362-fa352dcc37c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:03.067915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19725c1-b2ac-476f-b362-fa352dcc37c7 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:03.078351 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 127/257] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:03.080052 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e3f00-a381-459a-aa8e-fbc96f1b3da1 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:03.080407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e3f00-a381-459a-aa8e-fbc96f1b3da1 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:03.080797 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e3f00-a381-459a-aa8e-fbc96f1b3da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:03.098695 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-a66e3f00-a381-459a-aa8e-fbc96f1b3da1 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:03.100072 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a66e3f00-a381-459a-aa8e-fbc96f1b3da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:03.129116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 131/258] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:19:02 2022] PUT /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044/users/34e9c1abcf2248c8a46895df6b54168e/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:19:03.134153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ad746-6187-41a6-9ab3-a1e1961ba2e3 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:03.153896 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:03.248870 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 128/259] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:03.297669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e3f00-a381-459a-aa8e-fbc96f1b3da1 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:03.308091 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ad746-6187-41a6-9ab3-a1e1961ba2e3 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:03.345082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e38e88-2b83-4094-ad59-33697f059ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:03.346033 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e38e88-2b83-4094-ad59-33697f059ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:03.346362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e38e88-2b83-4094-ad59-33697f059ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:03.346641 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e38e88-2b83-4094-ad59-33697f059ff9 None admin] PATH_INFO: `/v3/users/cbca1598008e4ec3874722cde271d730` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:03.347906 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e38e88-2b83-4094-ad59-33697f059ff9 None admin] RBAC: Authorizing `identity:get_user(user_id=cbca1598008e4ec3874722cde271d730)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:03.349468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e38e88-2b83-4094-ad59-33697f059ff9 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:03.351600 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 132/260] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:19:03 2022] GET /identity/v3/users/cbca1598008e4ec3874722cde271d730 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:03.358175 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e38e88-2b83-4094-ad59-33697f059ff9 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:03.427114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:03.470472 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e38e88-2b83-4094-ad59-33697f059ff9 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:03.507917 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61164614-1ccb-426e-ab35-20e6f276a8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:03.508606 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61164614-1ccb-426e-ab35-20e6f276a8de None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:03.508894 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61164614-1ccb-426e-ab35-20e6f276a8de None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:03.509166 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61164614-1ccb-426e-ab35-20e6f276a8de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:03.553301 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e3f00-a381-459a-aa8e-fbc96f1b3da1 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:03.600544 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61164614-1ccb-426e-ab35-20e6f276a8de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:03.600888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54d722-7215-4507-8099-25b9f75d84f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:03.601417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54d722-7215-4507-8099-25b9f75d84f2 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:03.601728 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54d722-7215-4507-8099-25b9f75d84f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:03.602309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61164614-1ccb-426e-ab35-20e6f276a8de None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:03.602476 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54d722-7215-4507-8099-25b9f75d84f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:03.615994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e54d722-7215-4507-8099-25b9f75d84f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:03.626107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-0e54d722-7215-4507-8099-25b9f75d84f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:19:03.626107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:03.626107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:03.626107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:03.626107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:03.626107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:03.626107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:03.626107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:03.626107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:03.626107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:03.626107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:03.626107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:03.626107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:03.626107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:03.626107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:03.626107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:03.627224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:03.627224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:03.627224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:03.627224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:03.627224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:03.627224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:03.627224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:03.627224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:03.627224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:03.627224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:03.627224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:03.627224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:03.627224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:03.627224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:03.627224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:03.627224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:03.628124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:03.628124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:03.628124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:03.628124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:03.628124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:03.628124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:03.628124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:03.628124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:03.628124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:03.628124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:03.628124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:19:03.628124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:03.628124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 129/261] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:19:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:03.634007 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54d722-7215-4507-8099-25b9f75d84f2 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:03.662335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:03.687593 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:03.773897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 133/262] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:19:03.779722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61164614-1ccb-426e-ab35-20e6f276a8de None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:03.799232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e54d722-7215-4507-8099-25b9f75d84f2 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:03.843300 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c57514-586e-4dfd-a750-a45a1ce3d2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:03.844512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c57514-586e-4dfd-a750-a45a1ce3d2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:03.844939 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c57514-586e-4dfd-a750-a45a1ce3d2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:03.845620 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c57514-586e-4dfd-a750-a45a1ce3d2c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:03.846988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c57514-586e-4dfd-a750-a45a1ce3d2c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:03.847570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c57514-586e-4dfd-a750-a45a1ce3d2c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:03.849495 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c57514-586e-4dfd-a750-a45a1ce3d2c9 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:03.865557 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 130/263] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:03.867901 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c57514-586e-4dfd-a750-a45a1ce3d2c9 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:03.945876 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61164614-1ccb-426e-ab35-20e6f276a8de None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:03.986976 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c57514-586e-4dfd-a750-a45a1ce3d2c9 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:04.012638 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:04.025015 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eec9e4-cce3-4992-be4a-0763bc0d4781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:04.026337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eec9e4-cce3-4992-be4a-0763bc0d4781 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:04.026786 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eec9e4-cce3-4992-be4a-0763bc0d4781 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:04.027355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eec9e4-cce3-4992-be4a-0763bc0d4781 None admin] PATH_INFO: `/v3/users/cbca1598008e4ec3874722cde271d730` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:04.029277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eec9e4-cce3-4992-be4a-0763bc0d4781 None admin] RBAC: Authorizing `identity:get_user(user_id=cbca1598008e4ec3874722cde271d730)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:04.032455 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eec9e4-cce3-4992-be4a-0763bc0d4781 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:04.037721 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 131/264] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:19:03 2022] GET /identity/v3/users/cbca1598008e4ec3874722cde271d730 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:04.039730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eec9e4-cce3-4992-be4a-0763bc0d4781 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:04.066007 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a8021-5f05-4d76-95a5-7517b685de12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:04.066938 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a8021-5f05-4d76-95a5-7517b685de12 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:04.067210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a8021-5f05-4d76-95a5-7517b685de12 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:04.067483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a8021-5f05-4d76-95a5-7517b685de12 None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:04.068755 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a8021-5f05-4d76-95a5-7517b685de12 None admin] RBAC: Authorizing `identity:get_project(project_id=f5e21a6b8db94073b1c84a6d986af044)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:04.070363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a8021-5f05-4d76-95a5-7517b685de12 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:04.072671 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 134/265] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:03 2022] GET /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044 => generated 302 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:04.078232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a8021-5f05-4d76-95a5-7517b685de12 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:04.100588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:04.165342 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eec9e4-cce3-4992-be4a-0763bc0d4781 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:04.204174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443c0cb-adfc-4fbd-9e19-4e2b011d47a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:04.205466 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443c0cb-adfc-4fbd-9e19-4e2b011d47a4 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:04.206015 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443c0cb-adfc-4fbd-9e19-4e2b011d47a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:04.206490 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443c0cb-adfc-4fbd-9e19-4e2b011d47a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:04.249900 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:04.293119 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443c0cb-adfc-4fbd-9e19-4e2b011d47a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:04.300028 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443c0cb-adfc-4fbd-9e19-4e2b011d47a4 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:04.346884 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a8021-5f05-4d76-95a5-7517b685de12 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:04.387167 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43883468-9f3c-4273-888b-29f55a8cbdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:04.388856 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43883468-9f3c-4273-888b-29f55a8cbdd3 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:04.389341 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43883468-9f3c-4273-888b-29f55a8cbdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:04.389857 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43883468-9f3c-4273-888b-29f55a8cbdd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:04.390899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43883468-9f3c-4273-888b-29f55a8cbdd3 None admin] RBAC: Adding query filter params (role.id=beed8caad097496292e544146859df5c, scope.project.id=f5e21a6b8db94073b1c84a6d986af044, user.id=cbca1598008e4ec3874722cde271d730) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:04.391408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43883468-9f3c-4273-888b-29f55a8cbdd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:04.393038 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43883468-9f3c-4273-888b-29f55a8cbdd3 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:04.400700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 135/266] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:19:04 2022] GET /identity/v3/role_assignments?user.id=cbca1598008e4ec3874722cde271d730&scope.project.id=f5e21a6b8db94073b1c84a6d986af044&role.id=beed8caad097496292e544146859df5c => generated 608 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:04.494618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 132/267] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:19:04.500701 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43883468-9f3c-4273-888b-29f55a8cbdd3 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:04.615061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:04.643572 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43883468-9f3c-4273-888b-29f55a8cbdd3 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:04.679842 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf3829f-08d8-4c23-9256-c792ebfac190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:04.681090 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3829f-08d8-4c23-9256-c792ebfac190 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:04.681624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3829f-08d8-4c23-9256-c792ebfac190 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:04.682112 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf3829f-08d8-4c23-9256-c792ebfac190 None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:04.683521 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3829f-08d8-4c23-9256-c792ebfac190 None admin] RBAC: Authorizing `identity:get_project(project_id=f5e21a6b8db94073b1c84a6d986af044)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:04.685779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf3829f-08d8-4c23-9256-c792ebfac190 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:04.688042 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 136/268] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:04 2022] GET /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:04.693576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443c0cb-adfc-4fbd-9e19-4e2b011d47a4 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:04.802493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:04.852498 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443c0cb-adfc-4fbd-9e19-4e2b011d47a4 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:04.903636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b6c72-2f19-4189-872d-4a3f2ccfe4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:04.904303 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b6c72-2f19-4189-872d-4a3f2ccfe4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:04.904588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b6c72-2f19-4189-872d-4a3f2ccfe4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:04.904913 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b6c72-2f19-4189-872d-4a3f2ccfe4a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:04.905790 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b6c72-2f19-4189-872d-4a3f2ccfe4a7 None admin] RBAC: Adding query filter params (role.id=f6c74bb34f9c4b0faaf6a21007abcaa5, scope.project.id=f5e21a6b8db94073b1c84a6d986af044, user.id=cbca1598008e4ec3874722cde271d730) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:04.906152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b6c72-2f19-4189-872d-4a3f2ccfe4a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:04.907603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b6c72-2f19-4189-872d-4a3f2ccfe4a7 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:04.916760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 133/269] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:19:04 2022] GET /identity/v3/role_assignments?user.id=cbca1598008e4ec3874722cde271d730&scope.project.id=f5e21a6b8db94073b1c84a6d986af044&role.id=f6c74bb34f9c4b0faaf6a21007abcaa5 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:04.948809 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e99c74-8ef6-4110-9d75-cca46d4993df None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:04.948809 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e99c74-8ef6-4110-9d75-cca46d4993df None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:04.948809 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e99c74-8ef6-4110-9d75-cca46d4993df None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:04.949600 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 137/270] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:04.956217 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63bead-d00c-42df-9190-681d94fdedc3 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:04.956511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63bead-d00c-42df-9190-681d94fdedc3 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:04.956790 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63bead-d00c-42df-9190-681d94fdedc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:04.981230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-dc63bead-d00c-42df-9190-681d94fdedc3 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:04.982992 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-dc63bead-d00c-42df-9190-681d94fdedc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:05.078058 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 134/271] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:05.124042 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e99c74-8ef6-4110-9d75-cca46d4993df None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:05.261226 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e99c74-8ef6-4110-9d75-cca46d4993df None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:05.302539 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc35d6-612a-46d2-b7a4-5217f07e812b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:05.303396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc35d6-612a-46d2-b7a4-5217f07e812b None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:05.303676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc35d6-612a-46d2-b7a4-5217f07e812b None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:05.303950 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc35d6-612a-46d2-b7a4-5217f07e812b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:05.315194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc35d6-612a-46d2-b7a4-5217f07e812b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:05.323054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-9bfc35d6-612a-46d2-b7a4-5217f07e812b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:05.323054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:05.323054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:05.323054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:05.323054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:05.323054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:05.323054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:05.323054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:05.323054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:05.323054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:05.323054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:05.323054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:05.323054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:05.323054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:05.323054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:05.323054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:05.323933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:05.323933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:05.323933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:05.323933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:05.323933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:05.323933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:05.323933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:05.323933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:05.323933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:05.323933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:05.323933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:05.323933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:05.323933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:05.323933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:05.323933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:05.323933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:05.325114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:05.325114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:05.325114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:05.325114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:05.325114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:05.325114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:05.325114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:05.325114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:05.325114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:05.325114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:05.325114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:05.325114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:05.325114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 138/272] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:05.331474 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63bead-d00c-42df-9190-681d94fdedc3 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:05.387333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:05.445298 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63bead-d00c-42df-9190-681d94fdedc3 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:05.458361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70da4d-5f32-4b44-8e6d-bd8bcc9eca39 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:05.458854 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70da4d-5f32-4b44-8e6d-bd8bcc9eca39 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:05.458954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70da4d-5f32-4b44-8e6d-bd8bcc9eca39 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:05.460532 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 139/273] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:05.467204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c8dd2-0ddf-4fcb-98df-395c3e27bd7e None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:05.467493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c8dd2-0ddf-4fcb-98df-395c3e27bd7e None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:05.467770 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c8dd2-0ddf-4fcb-98df-395c3e27bd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:05.484470 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4fa32-408e-493c-b934-a5f4cadfa79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:05.485621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4fa32-408e-493c-b934-a5f4cadfa79d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:05.486083 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4fa32-408e-493c-b934-a5f4cadfa79d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:05.486185 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:05.486667 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4fa32-408e-493c-b934-a5f4cadfa79d None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:05.487631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4fa32-408e-493c-b934-a5f4cadfa79d None admin] RBAC: Adding query filter params (name=member) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:05.488123 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4fa32-408e-493c-b934-a5f4cadfa79d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:05.489732 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4fa32-408e-493c-b934-a5f4cadfa79d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:05.494466 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-875c8dd2-0ddf-4fcb-98df-395c3e27bd7e None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:05.495677 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-875c8dd2-0ddf-4fcb-98df-395c3e27bd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:05.500987 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 135/274] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:19:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:05.505050 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4fa32-408e-493c-b934-a5f4cadfa79d None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:05.579947 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 140/275] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:05.604578 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c8dd2-0ddf-4fcb-98df-395c3e27bd7e None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:05.621621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4fa32-408e-493c-b934-a5f4cadfa79d None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:05.636524 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:05.656907 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82cda7e-9a2f-4941-88d3-e1b339ef54de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:05.657802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cda7e-9a2f-4941-88d3-e1b339ef54de None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:05.658096 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cda7e-9a2f-4941-88d3-e1b339ef54de None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:05.658369 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82cda7e-9a2f-4941-88d3-e1b339ef54de None admin] PATH_INFO: `/v3/users/8a90874a11ec473580d46f2e8e9e4767` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:05.672102 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cda7e-9a2f-4941-88d3-e1b339ef54de None admin] RBAC: Authorizing `identity:get_user(user_id=8a90874a11ec473580d46f2e8e9e4767)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:05.673706 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82cda7e-9a2f-4941-88d3-e1b339ef54de None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:05.680338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 136/276] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:19:05 2022] GET /identity/v3/users/8a90874a11ec473580d46f2e8e9e4767 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:05.680338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8ed21-ea1b-41f6-a2fe-1bef4f7a52d8 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:05.680338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8ed21-ea1b-41f6-a2fe-1bef4f7a52d8 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:05.680338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8ed21-ea1b-41f6-a2fe-1bef4f7a52d8 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:05.680338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 137/277] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:05.681254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8ed21-ea1b-41f6-a2fe-1bef4f7a52d8 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:05.730232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c8dd2-0ddf-4fcb-98df-395c3e27bd7e None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:05.763767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:05.769696 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7085625-583d-435f-b1d3-bbb645d06e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:05.770490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7085625-583d-435f-b1d3-bbb645d06e5b None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:05.770768 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7085625-583d-435f-b1d3-bbb645d06e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:05.771035 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7085625-583d-435f-b1d3-bbb645d06e5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:05.772503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7085625-583d-435f-b1d3-bbb645d06e5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:05.774494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7085625-583d-435f-b1d3-bbb645d06e5b None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:05.776443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 141/278] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:05.777743 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e6be0-5d40-4869-9ca8-c68ae919f028 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:05.778220 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e6be0-5d40-4869-9ca8-c68ae919f028 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:05.779119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e6be0-5d40-4869-9ca8-c68ae919f028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:05.795131 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-472e6be0-5d40-4869-9ca8-c68ae919f028 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:05.796303 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-472e6be0-5d40-4869-9ca8-c68ae919f028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:05.797748 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8ed21-ea1b-41f6-a2fe-1bef4f7a52d8 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:05.834033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1e2e4-6cab-40e3-832a-9cc41793717f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:05.834611 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1e2e4-6cab-40e3-832a-9cc41793717f None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:05.834894 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1e2e4-6cab-40e3-832a-9cc41793717f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:05.835170 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1e2e4-6cab-40e3-832a-9cc41793717f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:05.836008 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1e2e4-6cab-40e3-832a-9cc41793717f None admin] RBAC: Adding query filter params (role.id=80c590b37af34bca8dee5f7c87a38999, user.id=8a90874a11ec473580d46f2e8e9e4767, scope.system=all) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:05.836324 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1e2e4-6cab-40e3-832a-9cc41793717f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:05.837793 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1e2e4-6cab-40e3-832a-9cc41793717f None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:05.853564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 138/279] 10.222.0.57 () {56 vars in 1308 bytes} [Thu Jul 21 08:19:05 2022] GET /identity/v3/role_assignments?user.id=8a90874a11ec473580d46f2e8e9e4767&scope.system=all&role.id=80c590b37af34bca8dee5f7c87a38999 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:05.853564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1e2e4-6cab-40e3-832a-9cc41793717f None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:05.880246 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 142/280] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:05.895242 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:05.903295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e6be0-5d40-4869-9ca8-c68ae919f028 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:05.971854 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1e2e4-6cab-40e3-832a-9cc41793717f None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:06.009631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118297e1-046f-4bda-a282-58f00a0608a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:06.010295 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118297e1-046f-4bda-a282-58f00a0608a9 None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:06.010582 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118297e1-046f-4bda-a282-58f00a0608a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:06.010860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118297e1-046f-4bda-a282-58f00a0608a9 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:06.011586 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118297e1-046f-4bda-a282-58f00a0608a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:06.013090 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118297e1-046f-4bda-a282-58f00a0608a9 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:06.019423 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e6be0-5d40-4869-9ca8-c68ae919f028 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:06.049947 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:06.055833 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905c23c-2131-4f50-a8e3-34010905b5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:06.056625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905c23c-2131-4f50-a8e3-34010905b5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:06.056905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905c23c-2131-4f50-a8e3-34010905b5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:06.057178 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905c23c-2131-4f50-a8e3-34010905b5b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:06.067528 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905c23c-2131-4f50-a8e3-34010905b5b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:06.075215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-4905c23c-2131-4f50-a8e3-34010905b5b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:19:06.075215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:06.075215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:06.075215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:06.075215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:06.075215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:06.075215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:06.075215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:06.075215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:06.075215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:06.075215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:06.075215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:06.075215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:06.075215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:06.075215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:06.075215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:06.076117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:06.076117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:06.076117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:06.076117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:06.076117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:06.076117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:06.076117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:06.076117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:06.076117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:06.076117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:06.076117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:06.076117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:06.076117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:06.076117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:06.076117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:06.076117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:06.076897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:06.076897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:06.076897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:06.076897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:06.076897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:06.076897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:06.076897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:06.076897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:06.076897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:06.076897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:06.076897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:19:06.076897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:06.076897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 143/281] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:19:06.078065 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abac0f-18bf-42b1-a4b6-63cdc13bd460 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:06.078065 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abac0f-18bf-42b1-a4b6-63cdc13bd460 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:06.078185 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3abac0f-18bf-42b1-a4b6-63cdc13bd460 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:06.081446 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 144/282] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:06.082005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abac0f-18bf-42b1-a4b6-63cdc13bd460 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:06.129668 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 139/283] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 08:19:05 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:19:06.129668 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8629d3a-26e7-4e87-ae74-9aa969339dff None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:06.129668 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8629d3a-26e7-4e87-ae74-9aa969339dff None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:06.129668 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8629d3a-26e7-4e87-ae74-9aa969339dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:06.141104 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-f8629d3a-26e7-4e87-ae74-9aa969339dff None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:06.143930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f8629d3a-26e7-4e87-ae74-9aa969339dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:06.219748 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3abac0f-18bf-42b1-a4b6-63cdc13bd460 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:06.232691 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 140/284] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:06.253210 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8629d3a-26e7-4e87-ae74-9aa969339dff None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:06.260586 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303f8ef-fedf-425a-816e-8cbe785f54ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:06.261269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303f8ef-fedf-425a-816e-8cbe785f54ae None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:06.261568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303f8ef-fedf-425a-816e-8cbe785f54ae None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:06.261854 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303f8ef-fedf-425a-816e-8cbe785f54ae None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:06.263377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303f8ef-fedf-425a-816e-8cbe785f54ae None admin] RBAC: Adding query filter params (name=reader) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:06.263688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303f8ef-fedf-425a-816e-8cbe785f54ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:06.265703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8303f8ef-fedf-425a-816e-8cbe785f54ae None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:06.281565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 145/285] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:19:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:06.286863 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303f8ef-fedf-425a-816e-8cbe785f54ae None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:06.295995 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:06.360958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:06.393554 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8629d3a-26e7-4e87-ae74-9aa969339dff None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:06.423389 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303f8ef-fedf-425a-816e-8cbe785f54ae None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:06.440406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a525b65-a6dc-4f57-bdde-831ae9f2d3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:06.441201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a525b65-a6dc-4f57-bdde-831ae9f2d3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:06.441508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a525b65-a6dc-4f57-bdde-831ae9f2d3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:06.441786 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a525b65-a6dc-4f57-bdde-831ae9f2d3d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:06.454587 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a525b65-a6dc-4f57-bdde-831ae9f2d3d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:06.462322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-0a525b65-a6dc-4f57-bdde-831ae9f2d3d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:06.462322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:06.462322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:06.462322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:06.462322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:06.462322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:06.462322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:06.462322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:06.462322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:06.462322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:06.462322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:06.462322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:06.462322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:06.462322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:06.462322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:06.462322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:06.463202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:06.463202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:06.463202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:06.463202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:06.463202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:06.463202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:06.463202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:06.463202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:06.463202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:06.463202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:06.463202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:06.463202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:06.463202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:06.463202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:06.463202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:06.463202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:06.463998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:06.463998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:06.463998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:06.463998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:06.463998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:06.463998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:06.463998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:06.463998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:06.463998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:06.463998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:06.463998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:06.463998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:06.463998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 141/286] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:19:06.469969 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a525b65-a6dc-4f57-bdde-831ae9f2d3d5 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:06.471786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d94a91-ee47-4c7e-8175-1e9807e0cbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:06.474253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d94a91-ee47-4c7e-8175-1e9807e0cbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:06.474368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d94a91-ee47-4c7e-8175-1e9807e0cbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:06.474957 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d94a91-ee47-4c7e-8175-1e9807e0cbb6 None admin] PATH_INFO: `/v3/users/27ae7afb9a6d45b8b533d94b27cf8f5f` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:06.476254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d94a91-ee47-4c7e-8175-1e9807e0cbb6 None admin] RBAC: Authorizing `identity:get_user(user_id=27ae7afb9a6d45b8b533d94b27cf8f5f)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:06.479823 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d94a91-ee47-4c7e-8175-1e9807e0cbb6 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:06.480495 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 146/287] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:19:06 2022] GET /identity/v3/users/27ae7afb9a6d45b8b533d94b27cf8f5f => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:06.487893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d94a91-ee47-4c7e-8175-1e9807e0cbb6 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:06.574203 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:06.597288 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a525b65-a6dc-4f57-bdde-831ae9f2d3d5 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:06.611949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d94a91-ee47-4c7e-8175-1e9807e0cbb6 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:06.638219 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de192a-bc60-40f6-8f6f-997be79b36ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:06.639287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:06.640044 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de192a-bc60-40f6-8f6f-997be79b36ec None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:06.640619 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de192a-bc60-40f6-8f6f-997be79b36ec None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:06.641110 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de192a-bc60-40f6-8f6f-997be79b36ec None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:06.642156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de192a-bc60-40f6-8f6f-997be79b36ec None admin] RBAC: Adding query filter params (name=member) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:06.642675 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de192a-bc60-40f6-8f6f-997be79b36ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:06.644554 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de192a-bc60-40f6-8f6f-997be79b36ec None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:06.654587 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 142/288] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:19:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:06.658849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2e2d5-39a9-4339-a1e7-b5e5875fde1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:06.658849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2e2d5-39a9-4339-a1e7-b5e5875fde1e None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:06.658849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2e2d5-39a9-4339-a1e7-b5e5875fde1e None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:06.658849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2e2d5-39a9-4339-a1e7-b5e5875fde1e None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:06.659162 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2e2d5-39a9-4339-a1e7-b5e5875fde1e None admin] RBAC: Authorizing `identity:get_project(project_id=f5e21a6b8db94073b1c84a6d986af044)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:06.660088 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2e2d5-39a9-4339-a1e7-b5e5875fde1e None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:06.661162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de192a-bc60-40f6-8f6f-997be79b36ec None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:06.662349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 147/289] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:06 2022] GET /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:06.671638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2e2d5-39a9-4339-a1e7-b5e5875fde1e None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:06.826330 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de192a-bc60-40f6-8f6f-997be79b36ec None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:06.854045 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2e2d5-39a9-4339-a1e7-b5e5875fde1e None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:06.865832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3f8bb-ca9d-4e8a-b0a4-175f2d6b2081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:06.867125 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3f8bb-ca9d-4e8a-b0a4-175f2d6b2081 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:06.867616 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3f8bb-ca9d-4e8a-b0a4-175f2d6b2081 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:06.868196 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3f8bb-ca9d-4e8a-b0a4-175f2d6b2081 None admin] PATH_INFO: `/v3/users/34e9c1abcf2248c8a46895df6b54168e` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:06.869784 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3f8bb-ca9d-4e8a-b0a4-175f2d6b2081 None admin] RBAC: Authorizing `identity:get_user(user_id=34e9c1abcf2248c8a46895df6b54168e)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:06.871486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3f8bb-ca9d-4e8a-b0a4-175f2d6b2081 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:06.874141 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 143/290] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:19:06 2022] GET /identity/v3/users/34e9c1abcf2248c8a46895df6b54168e => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:06.879889 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3f8bb-ca9d-4e8a-b0a4-175f2d6b2081 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:06.893335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547cfca-df81-442f-85c2-8041a4e50912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:06.893335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547cfca-df81-442f-85c2-8041a4e50912 None admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:06.893335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547cfca-df81-442f-85c2-8041a4e50912 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:06.893662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547cfca-df81-442f-85c2-8041a4e50912 None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044/users/27ae7afb9a6d45b8b533d94b27cf8f5f/roles/0b6428c4b6694007a2af55aa5d143e27` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:06.895886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547cfca-df81-442f-85c2-8041a4e50912 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5e21a6b8db94073b1c84a6d986af044, user_id=27ae7afb9a6d45b8b533d94b27cf8f5f, role_id=0b6428c4b6694007a2af55aa5d143e27)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:06.897274 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547cfca-df81-442f-85c2-8041a4e50912 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:06.907451 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:06.978254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 148/291] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:19:06 2022] PUT /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044/users/27ae7afb9a6d45b8b533d94b27cf8f5f/roles/0b6428c4b6694007a2af55aa5d143e27 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:19:07.013745 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3f8bb-ca9d-4e8a-b0a4-175f2d6b2081 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:07.055948 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb543f8f-1af4-4c6c-a823-9f54615fdcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:07.056661 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb543f8f-1af4-4c6c-a823-9f54615fdcfc None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:07.056945 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb543f8f-1af4-4c6c-a823-9f54615fdcfc None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:07.057278 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb543f8f-1af4-4c6c-a823-9f54615fdcfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:07.165593 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb543f8f-1af4-4c6c-a823-9f54615fdcfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:07.167008 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb543f8f-1af4-4c6c-a823-9f54615fdcfc None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:07.183478 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:07.286606 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 144/292] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:19:07.292565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547cfca-df81-442f-85c2-8041a4e50912 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:07.371095 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:07.432235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547cfca-df81-442f-85c2-8041a4e50912 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:07.468175 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43333085-64c4-4396-b88d-a56e4c8454cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:07.469035 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43333085-64c4-4396-b88d-a56e4c8454cb None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:07.469315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43333085-64c4-4396-b88d-a56e4c8454cb None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:07.469623 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43333085-64c4-4396-b88d-a56e4c8454cb None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:07.470803 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43333085-64c4-4396-b88d-a56e4c8454cb None admin] RBAC: Authorizing `identity:get_project(project_id=f5e21a6b8db94073b1c84a6d986af044)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:07.472227 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43333085-64c4-4396-b88d-a56e4c8454cb None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:07.474239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 149/293] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:07 2022] GET /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:07.480159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb543f8f-1af4-4c6c-a823-9f54615fdcfc None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:07.626109 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb543f8f-1af4-4c6c-a823-9f54615fdcfc None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:07.651702 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:07.684211 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e685456-607b-470e-b0d5-868c632778a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:07.685312 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e685456-607b-470e-b0d5-868c632778a3 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:07.685620 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e685456-607b-470e-b0d5-868c632778a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:07.685896 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e685456-607b-470e-b0d5-868c632778a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:07.686746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e685456-607b-470e-b0d5-868c632778a3 None admin] RBAC: Adding query filter params (role.id=80c590b37af34bca8dee5f7c87a38999, scope.project.id=f5e21a6b8db94073b1c84a6d986af044, user.id=34e9c1abcf2248c8a46895df6b54168e) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:07.687059 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e685456-607b-470e-b0d5-868c632778a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:07.688502 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e685456-607b-470e-b0d5-868c632778a3 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:07.695541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 145/294] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:19:07 2022] GET /identity/v3/role_assignments?user.id=34e9c1abcf2248c8a46895df6b54168e&scope.project.id=f5e21a6b8db94073b1c84a6d986af044&role.id=80c590b37af34bca8dee5f7c87a38999 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:08.125386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bdb6b-389a-4029-aab9-67ae329ea838 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:08.125753 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bdb6b-389a-4029-aab9-67ae329ea838 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:08.125978 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bdb6b-389a-4029-aab9-67ae329ea838 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:08.127635 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 150/295] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:08.133070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48a0b2-06db-46bf-a80e-751bfe7a27a1 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:08.133359 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48a0b2-06db-46bf-a80e-751bfe7a27a1 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:08.133670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48a0b2-06db-46bf-a80e-751bfe7a27a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:08.152105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-0a48a0b2-06db-46bf-a80e-751bfe7a27a1 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:08.153360 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-0a48a0b2-06db-46bf-a80e-751bfe7a27a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:08.225637 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 146/296] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:19:08.245357 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bdb6b-389a-4029-aab9-67ae329ea838 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:08.370110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bdb6b-389a-4029-aab9-67ae329ea838 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:08.388516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:08.407011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849581dd-5912-448c-981a-7d74bd2f65da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:08.407828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849581dd-5912-448c-981a-7d74bd2f65da None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:08.408112 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849581dd-5912-448c-981a-7d74bd2f65da None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:08.408520 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849581dd-5912-448c-981a-7d74bd2f65da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:08.420827 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849581dd-5912-448c-981a-7d74bd2f65da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:08.429015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-849581dd-5912-448c-981a-7d74bd2f65da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:08.429015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:08.429015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:08.429015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:08.429015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:08.429015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:08.429015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:08.429015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:08.429015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:08.429015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:08.429015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:08.429015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:08.429015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:08.429015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:08.429015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:08.429015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:08.429914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:08.429914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:08.429914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:08.429914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:08.429914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:08.429914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:08.429914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:08.429914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:08.429914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:08.429914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:08.429914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:08.429914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:08.429914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:08.429914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:08.429914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:08.429914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:08.430731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:08.430731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:08.430731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:08.430731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:08.430731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:08.430731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:08.430731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:08.430731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:08.430731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:08.430731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:08.430731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:08.430731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:08.430731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 151/297] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:08.436795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48a0b2-06db-46bf-a80e-751bfe7a27a1 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:08.536115 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48a0b2-06db-46bf-a80e-751bfe7a27a1 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:08.543542 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:08.571242 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e1319-d151-4f71-b3d6-482141766ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:08.571904 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e1319-d151-4f71-b3d6-482141766ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:08.572183 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e1319-d151-4f71-b3d6-482141766ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:08.572455 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e1319-d151-4f71-b3d6-482141766ac8 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:08.573201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e1319-d151-4f71-b3d6-482141766ac8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:08.573503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e1319-d151-4f71-b3d6-482141766ac8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:08.574950 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e1319-d151-4f71-b3d6-482141766ac8 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:08.584092 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 147/298] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:19:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:08.589454 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849581dd-5912-448c-981a-7d74bd2f65da None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:08.692939 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849581dd-5912-448c-981a-7d74bd2f65da None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:08.728363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eda850-80c7-4b20-a46a-9caae6e3b1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:08.729237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eda850-80c7-4b20-a46a-9caae6e3b1dc None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:08.729518 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eda850-80c7-4b20-a46a-9caae6e3b1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:08.729819 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eda850-80c7-4b20-a46a-9caae6e3b1dc None admin] PATH_INFO: `/v3/users/8a90874a11ec473580d46f2e8e9e4767` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:08.731022 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eda850-80c7-4b20-a46a-9caae6e3b1dc None admin] RBAC: Authorizing `identity:get_user(user_id=8a90874a11ec473580d46f2e8e9e4767)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:08.733009 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eda850-80c7-4b20-a46a-9caae6e3b1dc None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:08.739473 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 152/299] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:19:08 2022] GET /identity/v3/users/8a90874a11ec473580d46f2e8e9e4767 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:08.742594 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e1319-d151-4f71-b3d6-482141766ac8 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:08.782989 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59dec7-289e-41cc-9adb-1814fa35eed8 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:08.783320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59dec7-289e-41cc-9adb-1814fa35eed8 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:08.783546 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59dec7-289e-41cc-9adb-1814fa35eed8 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:08.785037 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 153/300] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:19:08.789788 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb56b5-4c98-468f-94b0-d4fea8ca9c12 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:08.790072 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb56b5-4c98-468f-94b0-d4fea8ca9c12 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:08.790350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb56b5-4c98-468f-94b0-d4fea8ca9c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:08.808428 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-fadb56b5-4c98-468f-94b0-d4fea8ca9c12 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:08.810245 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-fadb56b5-4c98-468f-94b0-d4fea8ca9c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:08.858034 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e1319-d151-4f71-b3d6-482141766ac8 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:08.860057 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:08.889687 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 154/301] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:19:08.896431 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d19065-0e29-4eae-a4e5-3ad0aede0b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:08.897440 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d19065-0e29-4eae-a4e5-3ad0aede0b65 None admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:08.897895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d19065-0e29-4eae-a4e5-3ad0aede0b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:08.898064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d19065-0e29-4eae-a4e5-3ad0aede0b65 None admin] PATH_INFO: `/v3/system/users/8a90874a11ec473580d46f2e8e9e4767/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:08.899531 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d19065-0e29-4eae-a4e5-3ad0aede0b65 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8a90874a11ec473580d46f2e8e9e4767, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:08.900932 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d19065-0e29-4eae-a4e5-3ad0aede0b65 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:08.911678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb56b5-4c98-468f-94b0-d4fea8ca9c12 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:08.973083 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 148/302] 10.222.0.57 () {58 vars in 1334 bytes} [Thu Jul 21 08:19:08 2022] PUT /identity/v3/system/users/8a90874a11ec473580d46f2e8e9e4767/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:19:08.979952 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a06a91-9300-46e0-bd5d-8b66777ea56a None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:08.980617 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a06a91-9300-46e0-bd5d-8b66777ea56a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:08.981096 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a06a91-9300-46e0-bd5d-8b66777ea56a None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:08.983359 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 149/303] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:19:08.989252 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef5b02-4176-4281-9f39-ccde6715dc66 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:08.989820 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef5b02-4176-4281-9f39-ccde6715dc66 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:08.990334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef5b02-4176-4281-9f39-ccde6715dc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:09.014797 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-70ef5b02-4176-4281-9f39-ccde6715dc66 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:09.016037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-70ef5b02-4176-4281-9f39-ccde6715dc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:09.032948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb56b5-4c98-468f-94b0-d4fea8ca9c12 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:09.057980 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:09.080816 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e118c-934f-4f9f-9218-e78b875001ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:09.082148 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e118c-934f-4f9f-9218-e78b875001ff None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:09.082738 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e118c-934f-4f9f-9218-e78b875001ff None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:09.083258 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e118c-934f-4f9f-9218-e78b875001ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:09.097254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e118c-934f-4f9f-9218-e78b875001ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:09.107235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-4c4e118c-934f-4f9f-9218-e78b875001ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:19:09.107235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:09.107235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:09.107235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:09.107235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:09.107235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:09.107235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:09.107235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:09.107235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:09.107235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:09.107235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:09.107235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:09.107235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:09.107235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:09.107235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:09.107235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:09.108210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:09.108210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:09.108210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:09.108210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:09.108210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:09.108210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:09.108210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:09.108210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:09.108210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:09.108210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:09.108210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:09.108210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:09.108210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:09.108210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:09.108210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:09.108210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:09.109001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:09.109001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:09.109001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:09.109001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:09.109001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:09.109001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:09.109001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:09.109001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:09.109001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:09.109001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:09.109001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:19:09.109001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:09.111949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 155/304] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:19:09.117744 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e118c-934f-4f9f-9218-e78b875001ff None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:09.129548 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 150/305] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:09.146181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef5b02-4176-4281-9f39-ccde6715dc66 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:09.166843 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:09.238406 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e118c-934f-4f9f-9218-e78b875001ff None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:09.274445 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef5b02-4176-4281-9f39-ccde6715dc66 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:09.276234 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0010c-fd04-4bd6-9164-0d2d3d6e7026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:09.276971 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0010c-fd04-4bd6-9164-0d2d3d6e7026 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:09.277284 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0010c-fd04-4bd6-9164-0d2d3d6e7026 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:09.277583 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0010c-fd04-4bd6-9164-0d2d3d6e7026 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:09.278374 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0010c-fd04-4bd6-9164-0d2d3d6e7026 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:09.278681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0010c-fd04-4bd6-9164-0d2d3d6e7026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:09.280067 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0010c-fd04-4bd6-9164-0d2d3d6e7026 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:09.294411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 156/306] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:19:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:09.301931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0010c-fd04-4bd6-9164-0d2d3d6e7026 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:09.316461 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9dca60-fcc5-4a53-a9e5-3b7061d77cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:09.317312 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9dca60-fcc5-4a53-a9e5-3b7061d77cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:09.317625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9dca60-fcc5-4a53-a9e5-3b7061d77cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:09.317904 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9dca60-fcc5-4a53-a9e5-3b7061d77cc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:09.319126 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9dca60-fcc5-4a53-a9e5-3b7061d77cc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:09.320578 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9dca60-fcc5-4a53-a9e5-3b7061d77cc3 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:09.327396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 151/307] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:09.330059 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9dca60-fcc5-4a53-a9e5-3b7061d77cc3 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:09.363815 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:09.410307 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:09.417690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0010c-fd04-4bd6-9164-0d2d3d6e7026 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:09.436511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9dca60-fcc5-4a53-a9e5-3b7061d77cc3 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:09.459113 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0074ebb-d3ba-4ee5-b121-00c2c8d92ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:09.459991 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0074ebb-d3ba-4ee5-b121-00c2c8d92ebc None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:09.460277 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0074ebb-d3ba-4ee5-b121-00c2c8d92ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:09.460557 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0074ebb-d3ba-4ee5-b121-00c2c8d92ebc None admin] PATH_INFO: `/v3/users/eee41da160184a1fbe91cc1cca37bbf6` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:09.473960 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26457fb1-59f0-44b1-92b6-e39b8d07e488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:09.474625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26457fb1-59f0-44b1-92b6-e39b8d07e488 None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:09.474904 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0074ebb-d3ba-4ee5-b121-00c2c8d92ebc None admin] RBAC: Authorizing `identity:get_user(user_id=eee41da160184a1fbe91cc1cca37bbf6)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:09.475004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26457fb1-59f0-44b1-92b6-e39b8d07e488 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:09.475170 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26457fb1-59f0-44b1-92b6-e39b8d07e488 None admin] PATH_INFO: `/v3/groups` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:09.475865 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26457fb1-59f0-44b1-92b6-e39b8d07e488 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:09.476361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0074ebb-d3ba-4ee5-b121-00c2c8d92ebc None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:09.477578 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26457fb1-59f0-44b1-92b6-e39b8d07e488 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:09.478592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 157/308] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:19:09 2022] GET /identity/v3/users/eee41da160184a1fbe91cc1cca37bbf6 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:09.484190 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457dbb9-78f7-4368-8a86-3d2d88ff0539 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:09.484481 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457dbb9-78f7-4368-8a86-3d2d88ff0539 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:09.484758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457dbb9-78f7-4368-8a86-3d2d88ff0539 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:09.486102 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 158/309] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:09.486872 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457dbb9-78f7-4368-8a86-3d2d88ff0539 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:09.553725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 152/310] 10.222.0.57 () {60 vars in 1134 bytes} [Thu Jul 21 08:19:09 2022] POST /identity/v3/groups => generated 229 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:19:09.553725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc70c7-d4f0-4f6e-9d77-840c06bb1b18 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:09.553725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc70c7-d4f0-4f6e-9d77-840c06bb1b18 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:09.553725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc70c7-d4f0-4f6e-9d77-840c06bb1b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:09.572642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-07bc70c7-d4f0-4f6e-9d77-840c06bb1b18 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:09.574314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-07bc70c7-d4f0-4f6e-9d77-840c06bb1b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:09.612886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457dbb9-78f7-4368-8a86-3d2d88ff0539 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:09.653874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 153/311] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:09.665426 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3160a-b23c-4f66-8e87-9c5c37363217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:09.666488 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3160a-b23c-4f66-8e87-9c5c37363217 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:09.666915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3160a-b23c-4f66-8e87-9c5c37363217 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:09.667329 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3160a-b23c-4f66-8e87-9c5c37363217 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:09.668385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3160a-b23c-4f66-8e87-9c5c37363217 None admin] RBAC: Adding query filter params (role.id=0b6428c4b6694007a2af55aa5d143e27, user.id=eee41da160184a1fbe91cc1cca37bbf6, scope.system=all) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:09.668923 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3160a-b23c-4f66-8e87-9c5c37363217 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:09.670763 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3160a-b23c-4f66-8e87-9c5c37363217 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:09.677448 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 159/312] 10.222.0.57 () {56 vars in 1308 bytes} [Thu Jul 21 08:19:09 2022] GET /identity/v3/role_assignments?user.id=eee41da160184a1fbe91cc1cca37bbf6&scope.system=all&role.id=0b6428c4b6694007a2af55aa5d143e27 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:09.696189 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc70c7-d4f0-4f6e-9d77-840c06bb1b18 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:09.723628 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:09.826882 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc70c7-d4f0-4f6e-9d77-840c06bb1b18 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:09.864706 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03189cd8-2c32-4f81-b329-5c5230086707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:09.865894 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03189cd8-2c32-4f81-b329-5c5230086707 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:09.866380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03189cd8-2c32-4f81-b329-5c5230086707 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:09.866880 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03189cd8-2c32-4f81-b329-5c5230086707 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:09.877846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03189cd8-2c32-4f81-b329-5c5230086707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:09.885832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-03189cd8-2c32-4f81-b329-5c5230086707 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:19:09.885832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:09.885832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:09.885832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:09.885832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:09.885832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:09.885832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:09.885832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:09.885832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:09.885832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:09.885832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:09.885832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:09.885832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:09.885832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:09.885832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:09.885832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:09.886704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:09.886704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:09.886704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:09.886704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:09.886704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:09.886704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:09.886704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:09.886704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:09.886704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:09.886704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:09.886704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:09.886704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:09.886704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:09.886704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:09.886704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:09.886704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:09.887512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:09.887512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:09.887512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:09.887512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:09.887512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:09.887512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:09.887512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:09.887512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:09.887512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:09.887512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:09.887512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:19:09.887512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:09.890247 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 154/313] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:09.895696 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3160a-b23c-4f66-8e87-9c5c37363217 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:09.916851 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:10.002647 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3160a-b23c-4f66-8e87-9c5c37363217 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:10.039164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255b803-928f-4e16-856d-a952ad7cdef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:10.039835 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255b803-928f-4e16-856d-a952ad7cdef2 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:10.040116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255b803-928f-4e16-856d-a952ad7cdef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:10.040393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255b803-928f-4e16-856d-a952ad7cdef2 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:10.041149 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255b803-928f-4e16-856d-a952ad7cdef2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:10.041456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255b803-928f-4e16-856d-a952ad7cdef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:10.042898 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255b803-928f-4e16-856d-a952ad7cdef2 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:10.052427 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 160/314] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:19:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:10.057847 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03189cd8-2c32-4f81-b329-5c5230086707 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:10.143715 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:10.170590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03189cd8-2c32-4f81-b329-5c5230086707 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:10.211243 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52543ad-f6ae-4345-a6ba-507eaad1ca40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:10.212117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52543ad-f6ae-4345-a6ba-507eaad1ca40 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:10.212401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52543ad-f6ae-4345-a6ba-507eaad1ca40 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:10.212682 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52543ad-f6ae-4345-a6ba-507eaad1ca40 None admin] PATH_INFO: `/v3/users/27ae7afb9a6d45b8b533d94b27cf8f5f` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:10.213927 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52543ad-f6ae-4345-a6ba-507eaad1ca40 None admin] RBAC: Authorizing `identity:get_user(user_id=27ae7afb9a6d45b8b533d94b27cf8f5f)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:10.215404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52543ad-f6ae-4345-a6ba-507eaad1ca40 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:10.217375 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 155/315] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:19:10 2022] GET /identity/v3/users/27ae7afb9a6d45b8b533d94b27cf8f5f => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:10.222812 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255b803-928f-4e16-856d-a952ad7cdef2 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:10.306705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:10.326467 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255b803-928f-4e16-856d-a952ad7cdef2 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:10.363851 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb98f38-2684-4566-91b4-b3c59a5bbcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:10.364991 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb98f38-2684-4566-91b4-b3c59a5bbcb5 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:10.365489 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb98f38-2684-4566-91b4-b3c59a5bbcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:10.366009 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb98f38-2684-4566-91b4-b3c59a5bbcb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:10.446251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb98f38-2684-4566-91b4-b3c59a5bbcb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:10.448062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb98f38-2684-4566-91b4-b3c59a5bbcb5 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:10.531215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:10.552152 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 161/316] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:19:10.560120 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52543ad-f6ae-4345-a6ba-507eaad1ca40 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:10.664285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52543ad-f6ae-4345-a6ba-507eaad1ca40 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:10.700077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae122e-d7d6-44ca-a5ca-6215ba9c5bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:10.700863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae122e-d7d6-44ca-a5ca-6215ba9c5bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:10.701149 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae122e-d7d6-44ca-a5ca-6215ba9c5bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:10.701427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae122e-d7d6-44ca-a5ca-6215ba9c5bb6 None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:10.702669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae122e-d7d6-44ca-a5ca-6215ba9c5bb6 None admin] RBAC: Authorizing `identity:get_project(project_id=f5e21a6b8db94073b1c84a6d986af044)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:10.704369 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae122e-d7d6-44ca-a5ca-6215ba9c5bb6 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:10.706420 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 156/317] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:10 2022] GET /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:10.712367 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb98f38-2684-4566-91b4-b3c59a5bbcb5 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:10.827762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb98f38-2684-4566-91b4-b3c59a5bbcb5 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:10.863812 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893618b-56be-4980-939a-acbb006652d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:10.864469 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893618b-56be-4980-939a-acbb006652d2 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:10.864752 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893618b-56be-4980-939a-acbb006652d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:10.865030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893618b-56be-4980-939a-acbb006652d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:10.865890 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893618b-56be-4980-939a-acbb006652d2 None admin] RBAC: Adding query filter params (role.id=0b6428c4b6694007a2af55aa5d143e27, scope.project.id=f5e21a6b8db94073b1c84a6d986af044, user.id=27ae7afb9a6d45b8b533d94b27cf8f5f) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:10.866207 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893618b-56be-4980-939a-acbb006652d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:10.867741 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893618b-56be-4980-939a-acbb006652d2 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:10.873873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 162/318] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:19:10 2022] GET /identity/v3/role_assignments?user.id=27ae7afb9a6d45b8b533d94b27cf8f5f&scope.project.id=f5e21a6b8db94073b1c84a6d986af044&role.id=0b6428c4b6694007a2af55aa5d143e27 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:11.111492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2783d3-2569-49e6-8561-b7c14ebea53f None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:11.111695 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2783d3-2569-49e6-8561-b7c14ebea53f None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:11.111968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2783d3-2569-49e6-8561-b7c14ebea53f None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:11.113374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 157/319] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:11.118899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ca990-c5e0-4df8-9711-ff576b37d13a None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:11.119194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ca990-c5e0-4df8-9711-ff576b37d13a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:11.119476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ca990-c5e0-4df8-9711-ff576b37d13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:11.181267 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-f34ca990-c5e0-4df8-9711-ff576b37d13a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:11.182476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f34ca990-c5e0-4df8-9711-ff576b37d13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:11.223369 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:11.251256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 163/320] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:11.274612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2783d3-2569-49e6-8561-b7c14ebea53f None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:11.293048 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:11.377513 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2783d3-2569-49e6-8561-b7c14ebea53f None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:11.410897 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cfcf7-a3b0-4dc1-845f-7770e5720f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:11.411689 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cfcf7-a3b0-4dc1-845f-7770e5720f37 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:11.411971 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cfcf7-a3b0-4dc1-845f-7770e5720f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:11.412246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cfcf7-a3b0-4dc1-845f-7770e5720f37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:11.422975 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cfcf7-a3b0-4dc1-845f-7770e5720f37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:11.430546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-384cfcf7-a3b0-4dc1-845f-7770e5720f37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:11.430546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:11.430546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:11.430546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:11.430546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:11.430546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:11.430546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:11.430546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:11.430546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:11.430546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:11.430546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:11.430546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:11.430546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:11.430546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:11.430546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:11.430546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:11.431395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:11.431395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:11.431395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:11.431395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:11.431395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:11.431395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:11.431395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:11.431395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:11.431395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:11.431395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:11.431395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:11.431395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:11.431395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:11.431395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:11.431395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:11.431395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:11.432165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:11.432165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:11.432165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:11.432165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:11.432165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:11.432165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:11.432165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:11.432165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:11.432165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:11.432165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:11.432165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:11.432165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:11.436560 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 158/321] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:11.437948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ca990-c5e0-4df8-9711-ff576b37d13a None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:11.538432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ca990-c5e0-4df8-9711-ff576b37d13a None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:11.572210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebe184-0871-499f-9199-c75b478b1820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:11.572878 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebe184-0871-499f-9199-c75b478b1820 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:11.573159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebe184-0871-499f-9199-c75b478b1820 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:11.573434 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebe184-0871-499f-9199-c75b478b1820 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:11.574218 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebe184-0871-499f-9199-c75b478b1820 None admin] RBAC: Adding query filter params (name=member) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:11.574521 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebe184-0871-499f-9199-c75b478b1820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:11.575937 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebe184-0871-499f-9199-c75b478b1820 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:11.584176 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 164/322] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:19:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:11.589706 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cfcf7-a3b0-4dc1-845f-7770e5720f37 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:11.667196 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:11.690386 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cfcf7-a3b0-4dc1-845f-7770e5720f37 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:11.701233 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e98d75-cca0-4de6-bfe8-aacd02dfbdbf None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:11.701551 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e98d75-cca0-4de6-bfe8-aacd02dfbdbf None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:11.701854 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e98d75-cca0-4de6-bfe8-aacd02dfbdbf None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:11.703427 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 165/323] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:11.708043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ca062-9733-4330-9672-7ea426a82d4e None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:11.708332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ca062-9733-4330-9672-7ea426a82d4e None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:11.708611 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ca062-9733-4330-9672-7ea426a82d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:11.727489 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-e96ca062-9733-4330-9672-7ea426a82d4e None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:12.011126 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b780f-af74-48fc-a4ce-b4a2685820de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:12.011126 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b780f-af74-48fc-a4ce-b4a2685820de None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:12.011126 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b780f-af74-48fc-a4ce-b4a2685820de None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:12.011126 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b780f-af74-48fc-a4ce-b4a2685820de None admin] PATH_INFO: `/v3/users/8a90874a11ec473580d46f2e8e9e4767` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:12.012090 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b780f-af74-48fc-a4ce-b4a2685820de None admin] RBAC: Authorizing `identity:get_user(user_id=8a90874a11ec473580d46f2e8e9e4767)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:12.012090 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b780f-af74-48fc-a4ce-b4a2685820de None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:12.012231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e96ca062-9733-4330-9672-7ea426a82d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:12.012315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 159/324] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:19:11 2022] GET /identity/v3/users/8a90874a11ec473580d46f2e8e9e4767 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:12.012315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b780f-af74-48fc-a4ce-b4a2685820de None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:12.012955 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:12.012955 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 166/325] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:19:12.012955 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ca062-9733-4330-9672-7ea426a82d4e None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:12.013161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b780f-af74-48fc-a4ce-b4a2685820de None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:12.013161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160223b5-8d56-40f6-9b27-eb7e6e202892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:12.013161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160223b5-8d56-40f6-9b27-eb7e6e202892 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:12.013161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160223b5-8d56-40f6-9b27-eb7e6e202892 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:12.013417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160223b5-8d56-40f6-9b27-eb7e6e202892 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:12.013417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160223b5-8d56-40f6-9b27-eb7e6e202892 None admin] RBAC: Adding query filter params (role.id=80c590b37af34bca8dee5f7c87a38999, user.id=8a90874a11ec473580d46f2e8e9e4767, scope.system=all) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:12.013417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160223b5-8d56-40f6-9b27-eb7e6e202892 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:12.013417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160223b5-8d56-40f6-9b27-eb7e6e202892 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:12.013417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 160/326] 10.222.0.57 () {56 vars in 1308 bytes} [Thu Jul 21 08:19:11 2022] GET /identity/v3/role_assignments?user.id=8a90874a11ec473580d46f2e8e9e4767&scope.system=all&role.id=80c590b37af34bca8dee5f7c87a38999 => generated 510 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:12.013417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ccc42-8922-4742-90a7-4738b3d8c249 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:12.013820 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ccc42-8922-4742-90a7-4738b3d8c249 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:12.013820 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ccc42-8922-4742-90a7-4738b3d8c249 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:12.013820 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 161/327] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:12.013820 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a08aa-5bc2-4762-9f71-77977d809a98 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:12.013820 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a08aa-5bc2-4762-9f71-77977d809a98 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:12.013820 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a08aa-5bc2-4762-9f71-77977d809a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:12.013820 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:12.014270 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-fa5a08aa-5bc2-4762-9f71-77977d809a98 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:12.014270 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-fa5a08aa-5bc2-4762-9f71-77977d809a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:12.014456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ca062-9733-4330-9672-7ea426a82d4e None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:12.014456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3430e-1dfe-4a11-aeb1-374a65b43c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:12.014456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3430e-1dfe-4a11-aeb1-374a65b43c53 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:12.014456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3430e-1dfe-4a11-aeb1-374a65b43c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:12.014739 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3430e-1dfe-4a11-aeb1-374a65b43c53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:12.014739 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3430e-1dfe-4a11-aeb1-374a65b43c53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:12.014739 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3430e-1dfe-4a11-aeb1-374a65b43c53 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:12.014739 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 167/328] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:12.014739 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3430e-1dfe-4a11-aeb1-374a65b43c53 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:12.015053 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 162/329] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:19:12.024238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a08aa-5bc2-4762-9f71-77977d809a98 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:12.034837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:12.107824 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3430e-1dfe-4a11-aeb1-374a65b43c53 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:12.176756 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a08aa-5bc2-4762-9f71-77977d809a98 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:12.178908 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b818ed7-2464-477f-b928-38ed59dcf8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:12.179573 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b818ed7-2464-477f-b928-38ed59dcf8cb None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:12.179858 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b818ed7-2464-477f-b928-38ed59dcf8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:12.180139 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b818ed7-2464-477f-b928-38ed59dcf8cb None admin] PATH_INFO: `/v3/groups` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:12.180821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b818ed7-2464-477f-b928-38ed59dcf8cb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:12.182298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b818ed7-2464-477f-b928-38ed59dcf8cb None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:12.206482 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:12.211203 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aff6e2-430a-42e2-9344-074ba931377c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:12.212016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aff6e2-430a-42e2-9344-074ba931377c None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:12.212300 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aff6e2-430a-42e2-9344-074ba931377c None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:12.212577 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aff6e2-430a-42e2-9344-074ba931377c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:12.222385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aff6e2-430a-42e2-9344-074ba931377c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:12.230394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-14aff6e2-430a-42e2-9344-074ba931377c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:19:12.230394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:12.230394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:12.230394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:12.230394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:12.230394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:12.230394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:12.230394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:12.230394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:12.230394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:12.230394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:12.230394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:12.230394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:12.230394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:12.230394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:12.230394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:12.231505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:12.231505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:12.231505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:12.231505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:12.231505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:12.231505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:12.231505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:12.231505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:12.231505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:12.231505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:12.231505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:12.231505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:12.231505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:12.231505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:12.231505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:12.231505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:12.232737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:12.232737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:12.232737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:12.232737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:12.232737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:12.232737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:12.232737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:12.232737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:12.232737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:12.232737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:12.232737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:19:12.232737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:12.232737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 163/330] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:19:12.237309 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aff6e2-430a-42e2-9344-074ba931377c None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:12.284380 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 168/331] 10.222.0.57 () {60 vars in 1134 bytes} [Thu Jul 21 08:19:11 2022] POST /identity/v3/groups => generated 226 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:19:12.339749 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aff6e2-430a-42e2-9344-074ba931377c None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:12.376788 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abefe2-c11a-4eef-a8a0-4530352c36d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:12.377610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abefe2-c11a-4eef-a8a0-4530352c36d0 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:12.377895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abefe2-c11a-4eef-a8a0-4530352c36d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:12.378168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abefe2-c11a-4eef-a8a0-4530352c36d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:12.378929 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abefe2-c11a-4eef-a8a0-4530352c36d0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:12.379233 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abefe2-c11a-4eef-a8a0-4530352c36d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:12.380674 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abefe2-c11a-4eef-a8a0-4530352c36d0 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:12.390117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 164/332] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:19:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:12.395852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b818ed7-2464-477f-b928-38ed59dcf8cb None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:12.491944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:12.498691 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b818ed7-2464-477f-b928-38ed59dcf8cb None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:12.533321 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71de87d-3f70-4091-9188-fdf969710e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:12.540177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71de87d-3f70-4091-9188-fdf969710e5e None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:12.540177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71de87d-3f70-4091-9188-fdf969710e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:12.540177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71de87d-3f70-4091-9188-fdf969710e5e None admin] PATH_INFO: `/v3/users/eee41da160184a1fbe91cc1cca37bbf6` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:12.540177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71de87d-3f70-4091-9188-fdf969710e5e None admin] RBAC: Authorizing `identity:get_user(user_id=eee41da160184a1fbe91cc1cca37bbf6)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:12.540177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71de87d-3f70-4091-9188-fdf969710e5e None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:12.540177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 169/333] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:19:12 2022] GET /identity/v3/users/eee41da160184a1fbe91cc1cca37bbf6 => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:12.545657 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abefe2-c11a-4eef-a8a0-4530352c36d0 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:12.605570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:12.655085 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abefe2-c11a-4eef-a8a0-4530352c36d0 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:12.691323 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367428c-2434-4be2-8d33-3f66b421ad7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:12.692443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367428c-2434-4be2-8d33-3f66b421ad7c None admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:12.692887 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367428c-2434-4be2-8d33-3f66b421ad7c None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:12.693326 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367428c-2434-4be2-8d33-3f66b421ad7c None admin] PATH_INFO: `/v3/system/users/eee41da160184a1fbe91cc1cca37bbf6/roles/0b6428c4b6694007a2af55aa5d143e27` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:12.695062 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367428c-2434-4be2-8d33-3f66b421ad7c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=eee41da160184a1fbe91cc1cca37bbf6, role_id=0b6428c4b6694007a2af55aa5d143e27)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:12.696625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367428c-2434-4be2-8d33-3f66b421ad7c None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:12.761623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 165/334] 10.222.0.57 () {58 vars in 1334 bytes} [Thu Jul 21 08:19:12 2022] PUT /identity/v3/system/users/eee41da160184a1fbe91cc1cca37bbf6/roles/0b6428c4b6694007a2af55aa5d143e27 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:19:14.819725 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0e36e-477b-4166-973f-650a4aff28d1 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:14.820246 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0e36e-477b-4166-973f-650a4aff28d1 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:14.820340 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0e36e-477b-4166-973f-650a4aff28d1 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:14.821923 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 170/335] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:14.827450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c73b9-0d8c-4fc3-942e-0dbb03c5b2de None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:14.827867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c73b9-0d8c-4fc3-942e-0dbb03c5b2de None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:14.828059 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c73b9-0d8c-4fc3-942e-0dbb03c5b2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:14.850522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-037c73b9-0d8c-4fc3-942e-0dbb03c5b2de None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:14.851735 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-037c73b9-0d8c-4fc3-942e-0dbb03c5b2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:14.929738 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 166/336] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:14.954240 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0e36e-477b-4166-973f-650a4aff28d1 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:14.986980 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb2c13-c2f3-4299-9540-348382c1737a None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:14.987643 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb2c13-c2f3-4299-9540-348382c1737a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:14.988133 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb2c13-c2f3-4299-9540-348382c1737a None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:14.990042 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 167/337] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:19:14.995518 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccf60c-2318-47bc-89bd-09e48c9d5fd2 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:14.996079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccf60c-2318-47bc-89bd-09e48c9d5fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:14.996567 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccf60c-2318-47bc-89bd-09e48c9d5fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:15.022618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-3eccf60c-2318-47bc-89bd-09e48c9d5fd2 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:15.024126 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-3eccf60c-2318-47bc-89bd-09e48c9d5fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:15.087413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0e36e-477b-4166-973f-650a4aff28d1 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:15.130951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:15.135103 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fbe00-6a62-45eb-8a54-527e6856a7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:15.136212 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fbe00-6a62-45eb-8a54-527e6856a7bd None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:15.136500 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fbe00-6a62-45eb-8a54-527e6856a7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:15.137205 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fbe00-6a62-45eb-8a54-527e6856a7bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:15.152257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fbe00-6a62-45eb-8a54-527e6856a7bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:15.160429 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 168/338] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:19:15.163047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701aa479-eac6-490a-9b7b-d05f36a4f1bc None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:15.163338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-6e2fbe00-6a62-45eb-8a54-527e6856a7bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:19:15.163338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:15.163338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:15.163338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:15.163338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:15.163338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:15.163338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:15.163338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:15.163338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:15.163338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:15.163338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:15.163338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:15.163338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:15.163338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:15.163338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:15.163338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:15.164309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:15.164309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:15.164309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:15.164309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:15.164309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:15.164309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:15.164309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:15.164309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:15.164309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:15.164309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:15.164309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:15.164309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:15.164309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:15.164309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:15.164309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:15.164309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:15.165373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:15.165373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:15.165373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:15.165373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:15.165373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:15.165373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:15.165373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:15.165373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:15.165373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:15.165373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:15.165373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:19:15.165373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:15.166185 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701aa479-eac6-490a-9b7b-d05f36a4f1bc None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:15.166185 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701aa479-eac6-490a-9b7b-d05f36a4f1bc None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:15.166330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 171/339] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:19:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:15.166396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 169/340] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:15.173154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0ebc2-059d-45e9-8191-c2b2528ada5a None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:15.177662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0ebc2-059d-45e9-8191-c2b2528ada5a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:15.177662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0ebc2-059d-45e9-8191-c2b2528ada5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:15.177866 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701aa479-eac6-490a-9b7b-d05f36a4f1bc None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:15.208584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-12e0ebc2-059d-45e9-8191-c2b2528ada5a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:15.209844 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-12e0ebc2-059d-45e9-8191-c2b2528ada5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:15.247601 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:15.350853 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701aa479-eac6-490a-9b7b-d05f36a4f1bc None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:15.367204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 172/341] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:15.368111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0ebc2-059d-45e9-8191-c2b2528ada5a None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:15.412779 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667cc63-9aa3-482a-a7bd-939eb3a4e3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:15.413459 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667cc63-9aa3-482a-a7bd-939eb3a4e3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:15.413851 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667cc63-9aa3-482a-a7bd-939eb3a4e3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:15.414128 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667cc63-9aa3-482a-a7bd-939eb3a4e3e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:15.414892 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667cc63-9aa3-482a-a7bd-939eb3a4e3e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:15.415198 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667cc63-9aa3-482a-a7bd-939eb3a4e3e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:15.416591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667cc63-9aa3-482a-a7bd-939eb3a4e3e8 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:15.430328 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 170/342] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:15.431536 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667cc63-9aa3-482a-a7bd-939eb3a4e3e8 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:15.482050 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:15.546615 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667cc63-9aa3-482a-a7bd-939eb3a4e3e8 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:15.586586 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385248-3b2e-4ffb-a060-2387082a6fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:15.587386 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385248-3b2e-4ffb-a060-2387082a6fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:15.587878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385248-3b2e-4ffb-a060-2387082a6fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:15.588162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385248-3b2e-4ffb-a060-2387082a6fd0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:15.601450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e385248-3b2e-4ffb-a060-2387082a6fd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:15.610525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-2e385248-3b2e-4ffb-a060-2387082a6fd0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:19:15.610525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:15.610525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:15.610525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:15.610525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:15.610525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:15.610525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:15.610525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:15.610525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:15.610525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:15.610525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:15.610525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:15.610525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:15.610525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:15.610525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:15.610525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:15.611450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:15.611450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:15.611450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:15.611450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:15.611450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:15.611450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:15.611450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:15.611450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:15.611450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:15.611450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:15.611450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:15.611450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:15.611450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:15.611450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:15.611450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:15.611450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:15.612642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:15.612642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:15.612642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:15.612642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:15.612642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:15.612642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:15.612642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:15.612642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:15.612642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:15.612642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:15.612642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 08:19:15.612642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:15.613248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0ebc2-059d-45e9-8191-c2b2528ada5a None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:15.613332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 171/343] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:15.613332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385248-3b2e-4ffb-a060-2387082a6fd0 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:15.681204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f5f08-0ff3-41f5-bbce-2fed99eba747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:15.682048 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f5f08-0ff3-41f5-bbce-2fed99eba747 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:15.682330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f5f08-0ff3-41f5-bbce-2fed99eba747 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:15.682604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f5f08-0ff3-41f5-bbce-2fed99eba747 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:15.705122 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f5f08-0ff3-41f5-bbce-2fed99eba747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:15.717895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-838f5f08-0ff3-41f5-bbce-2fed99eba747 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:15.717895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:15.717895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:15.717895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:15.717895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:15.717895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:15.717895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:15.717895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:15.717895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:15.717895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:15.717895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:15.717895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:15.717895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:15.717895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:15.717895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:15.717895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:15.720332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:15.720332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:15.720332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:15.720332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:15.720332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:15.720332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:15.720332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:15.720332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:15.720332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:15.720332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:15.720332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:15.720332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:15.720332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:15.720332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:15.720332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:15.720332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:15.722347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:15.722347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:15.722347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:15.722347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:15.722347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:15.722347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:15.722347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:15.722347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:15.722347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:15.722347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:15.722347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:15.722347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:15.722347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 173/344] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:15.722347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f5f08-0ff3-41f5-bbce-2fed99eba747 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:15.732819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:15.735967 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385248-3b2e-4ffb-a060-2387082a6fd0 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:15.764269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:15.776519 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ddbb9-f859-486b-bc5e-342a93688013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:15.776519 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ddbb9-f859-486b-bc5e-342a93688013 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:15.776519 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ddbb9-f859-486b-bc5e-342a93688013 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:15.776519 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ddbb9-f859-486b-bc5e-342a93688013 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:15.850991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ddbb9-f859-486b-bc5e-342a93688013 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:15.852808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ddbb9-f859-486b-bc5e-342a93688013 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:15.907892 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f5f08-0ff3-41f5-bbce-2fed99eba747 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:15.959056 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 172/345] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:19:15.960084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ddbb9-f859-486b-bc5e-342a93688013 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:15.962232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9656d63-fa2e-4e6a-801c-73071a758f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:15.962914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9656d63-fa2e-4e6a-801c-73071a758f52 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:15.963201 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9656d63-fa2e-4e6a-801c-73071a758f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:15.963483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9656d63-fa2e-4e6a-801c-73071a758f52 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:15.963843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:15.964252 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9656d63-fa2e-4e6a-801c-73071a758f52 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:15.964564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9656d63-fa2e-4e6a-801c-73071a758f52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:15.966542 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9656d63-fa2e-4e6a-801c-73071a758f52 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:15.981900 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 174/346] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:19:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:15.984563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9656d63-fa2e-4e6a-801c-73071a758f52 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:16.070168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ddbb9-f859-486b-bc5e-342a93688013 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:16.115501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134de256-f027-4d33-b48f-51ab6274df8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:16.116180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134de256-f027-4d33-b48f-51ab6274df8b None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:16.116372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134de256-f027-4d33-b48f-51ab6274df8b None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:16.116818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134de256-f027-4d33-b48f-51ab6274df8b None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:16.116964 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:16.117624 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134de256-f027-4d33-b48f-51ab6274df8b None admin] RBAC: Adding query filter params (name=member) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:16.117939 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134de256-f027-4d33-b48f-51ab6274df8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:16.120033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134de256-f027-4d33-b48f-51ab6274df8b None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:16.132206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 173/347] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:19:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:16.134431 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134de256-f027-4d33-b48f-51ab6274df8b None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:16.145279 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9656d63-fa2e-4e6a-801c-73071a758f52 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:16.194791 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0f438-f50a-4eb6-ac81-4831f80fe5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:16.196820 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0f438-f50a-4eb6-ac81-4831f80fe5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:16.196820 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0f438-f50a-4eb6-ac81-4831f80fe5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:16.196820 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0f438-f50a-4eb6-ac81-4831f80fe5d3 None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:16.198461 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0f438-f50a-4eb6-ac81-4831f80fe5d3 None admin] RBAC: Authorizing `identity:get_project(project_id=5b12104d6dfe4464b0c1b5738679bdb1)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:16.200474 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0f438-f50a-4eb6-ac81-4831f80fe5d3 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:16.202241 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 175/348] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:15 2022] GET /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:16.203539 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bac340-ffd3-430f-97dd-5f99f04192cf None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:16.204072 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bac340-ffd3-430f-97dd-5f99f04192cf None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:16.204072 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bac340-ffd3-430f-97dd-5f99f04192cf None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:16.205371 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 176/349] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:16.206047 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bac340-ffd3-430f-97dd-5f99f04192cf None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:16.222581 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:16.272484 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134de256-f027-4d33-b48f-51ab6274df8b None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:16.315238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef7508-7f2e-4d1f-b51f-fe682a5805c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:16.316112 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef7508-7f2e-4d1f-b51f-fe682a5805c0 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:16.316393 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef7508-7f2e-4d1f-b51f-fe682a5805c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:16.316667 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef7508-7f2e-4d1f-b51f-fe682a5805c0 None admin] PATH_INFO: `/v3/users/eee41da160184a1fbe91cc1cca37bbf6` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:16.318548 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef7508-7f2e-4d1f-b51f-fe682a5805c0 None admin] RBAC: Authorizing `identity:get_user(user_id=eee41da160184a1fbe91cc1cca37bbf6)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:16.320573 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef7508-7f2e-4d1f-b51f-fe682a5805c0 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:16.323332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 174/350] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:19:16 2022] GET /identity/v3/users/eee41da160184a1fbe91cc1cca37bbf6 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:16.324448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef7508-7f2e-4d1f-b51f-fe682a5805c0 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:16.332362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bac340-ffd3-430f-97dd-5f99f04192cf None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:16.378298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524c23e-134c-4d56-aa1c-446a8bcd60e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:16.379394 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524c23e-134c-4d56-aa1c-446a8bcd60e2 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:16.379682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524c23e-134c-4d56-aa1c-446a8bcd60e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:16.379965 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524c23e-134c-4d56-aa1c-446a8bcd60e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:16.397808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:16.461625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef7508-7f2e-4d1f-b51f-fe682a5805c0 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:16.477401 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524c23e-134c-4d56-aa1c-446a8bcd60e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:16.479253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524c23e-134c-4d56-aa1c-446a8bcd60e2 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:16.499506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:16.501720 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e22a6-40fc-4bd5-8e54-65adda9cb27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:16.502856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e22a6-40fc-4bd5-8e54-65adda9cb27a None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:16.503207 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e22a6-40fc-4bd5-8e54-65adda9cb27a None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:16.503491 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e22a6-40fc-4bd5-8e54-65adda9cb27a None admin] PATH_INFO: `/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:16.514216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e22a6-40fc-4bd5-8e54-65adda9cb27a None admin] RBAC: Authorizing `identity:get_group(group_id=b12e5815a0064aa7b7d3b2baac0ce7b1)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:16.515679 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e22a6-40fc-4bd5-8e54-65adda9cb27a None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:16.517666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 175/351] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 08:19:16 2022] GET /identity/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:16.518613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca06b92-5587-4f56-8727-82559186c8d9 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:16.519091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca06b92-5587-4f56-8727-82559186c8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:16.519196 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca06b92-5587-4f56-8727-82559186c8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:16.539080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-eca06b92-5587-4f56-8727-82559186c8d9 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:16.540505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-eca06b92-5587-4f56-8727-82559186c8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:16.608788 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 177/352] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:19:16.610175 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a4cbb-ae37-4a45-a73a-086412b9d10a None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:16.610466 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a4cbb-ae37-4a45-a73a-086412b9d10a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:16.610745 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a4cbb-ae37-4a45-a73a-086412b9d10a None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:16.612816 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 178/353] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:16.613556 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a4cbb-ae37-4a45-a73a-086412b9d10a None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:16.626991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 176/354] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:16.627655 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca06b92-5587-4f56-8727-82559186c8d9 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:16.679163 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:16.762104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a4cbb-ae37-4a45-a73a-086412b9d10a None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:16.766544 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca06b92-5587-4f56-8727-82559186c8d9 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:16.796145 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:16.810273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7da56-fc2c-4d78-aeb0-af037f1c1fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:16.810582 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c871a-bf89-442c-b763-e878cb34ce9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:16.811354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c871a-bf89-442c-b763-e878cb34ce9c None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:16.811700 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c871a-bf89-442c-b763-e878cb34ce9c None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:16.812066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c871a-bf89-442c-b763-e878cb34ce9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:16.812599 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7da56-fc2c-4d78-aeb0-af037f1c1fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:16.813049 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c871a-bf89-442c-b763-e878cb34ce9c None admin] RBAC: Adding query filter params (group.id=b12e5815a0064aa7b7d3b2baac0ce7b1, role.id=f6c74bb34f9c4b0faaf6a21007abcaa5, scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:16.813340 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7da56-fc2c-4d78-aeb0-af037f1c1fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:16.813448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c871a-bf89-442c-b763-e878cb34ce9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:16.813879 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7da56-fc2c-4d78-aeb0-af037f1c1fb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:16.814860 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7da56-fc2c-4d78-aeb0-af037f1c1fb7 None admin] RBAC: Adding query filter params (role.id=0b6428c4b6694007a2af55aa5d143e27, user.id=eee41da160184a1fbe91cc1cca37bbf6, scope.system=all) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:16.815188 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c871a-bf89-442c-b763-e878cb34ce9c None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:16.815502 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7da56-fc2c-4d78-aeb0-af037f1c1fb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:16.817115 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7da56-fc2c-4d78-aeb0-af037f1c1fb7 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:16.822122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 177/355] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Jul 21 08:19:16 2022] GET /identity/v3/role_assignments?group.id=b12e5815a0064aa7b7d3b2baac0ce7b1&scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1&role.id=f6c74bb34f9c4b0faaf6a21007abcaa5 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:16.823035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c871a-bf89-442c-b763-e878cb34ce9c None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:16.832211 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 179/356] 10.222.0.57 () {56 vars in 1308 bytes} [Thu Jul 21 08:19:16 2022] GET /identity/v3/role_assignments?user.id=eee41da160184a1fbe91cc1cca37bbf6&scope.system=all&role.id=0b6428c4b6694007a2af55aa5d143e27 => generated 510 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:16.834064 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b11085-c6a5-4314-8b9a-6ebcd40e0ab5 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:16.834570 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b11085-c6a5-4314-8b9a-6ebcd40e0ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:16.835041 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b11085-c6a5-4314-8b9a-6ebcd40e0ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:16.854513 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-30b11085-c6a5-4314-8b9a-6ebcd40e0ab5 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:16.856101 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-30b11085-c6a5-4314-8b9a-6ebcd40e0ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:16.971627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c871a-bf89-442c-b763-e878cb34ce9c None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:16.974985 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 180/357] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:16.977565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b11085-c6a5-4314-8b9a-6ebcd40e0ab5 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:17.037113 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:17.039889 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a192a-f825-41db-aa10-6d213fa30964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:17.041006 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a192a-f825-41db-aa10-6d213fa30964 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:17.041497 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a192a-f825-41db-aa10-6d213fa30964 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:17.042024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a192a-f825-41db-aa10-6d213fa30964 None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:17.044393 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a192a-f825-41db-aa10-6d213fa30964 None admin] RBAC: Authorizing `identity:get_project(project_id=5b12104d6dfe4464b0c1b5738679bdb1)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:17.046153 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a192a-f825-41db-aa10-6d213fa30964 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:17.048134 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 178/358] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:16 2022] GET /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:17.049615 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46588504-cf12-45bf-b245-2f4c073cec5f None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:17.055596 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46588504-cf12-45bf-b245-2f4c073cec5f None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:17.055596 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46588504-cf12-45bf-b245-2f4c073cec5f None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:17.055596 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 179/359] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:17.055596 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46588504-cf12-45bf-b245-2f4c073cec5f None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:17.133474 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:17.136182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b11085-c6a5-4314-8b9a-6ebcd40e0ab5 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:17.184152 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519fc16-91fc-45ba-b627-ef9356263855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:17.184961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519fc16-91fc-45ba-b627-ef9356263855 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:17.185288 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519fc16-91fc-45ba-b627-ef9356263855 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:17.185538 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519fc16-91fc-45ba-b627-ef9356263855 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:17.190502 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46588504-cf12-45bf-b245-2f4c073cec5f None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:17.198395 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519fc16-91fc-45ba-b627-ef9356263855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:17.209760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-5519fc16-91fc-45ba-b627-ef9356263855 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:17.209760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:17.209760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:17.209760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:17.209760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:17.209760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:17.209760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:17.209760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:17.209760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:17.209760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:17.209760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:17.209760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:17.209760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:17.209760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:17.209760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:17.209760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:17.210678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:17.210678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:17.210678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:17.210678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:17.210678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:17.210678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:17.210678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:17.210678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:17.210678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:17.210678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:17.210678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:17.210678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:17.210678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:17.210678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:17.210678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:17.210678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:17.211459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:17.211459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:17.211459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:17.211459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:17.211459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:17.211459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:17.211459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:17.211459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:17.211459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:17.211459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:17.211459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:17.211459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:17.211459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 181/360] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:17.211459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafed4d9-82e6-4dfc-869d-32e58d89120a None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:17.212242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafed4d9-82e6-4dfc-869d-32e58d89120a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:17.212242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafed4d9-82e6-4dfc-869d-32e58d89120a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:17.235552 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-fafed4d9-82e6-4dfc-869d-32e58d89120a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:17.236697 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-fafed4d9-82e6-4dfc-869d-32e58d89120a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:17.237019 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be86d6-8925-4326-abee-1223c7f5cd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:17.237859 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be86d6-8925-4326-abee-1223c7f5cd69 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:17.238148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be86d6-8925-4326-abee-1223c7f5cd69 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:17.238424 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7be86d6-8925-4326-abee-1223c7f5cd69 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:17.251668 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7be86d6-8925-4326-abee-1223c7f5cd69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:17.259791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-f7be86d6-8925-4326-abee-1223c7f5cd69 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:19:17.259791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:17.259791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:17.259791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:17.259791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:17.259791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:17.259791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:17.259791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:17.259791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:17.259791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:17.259791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:17.259791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:17.259791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:17.259791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:17.259791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:17.259791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:17.260686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:17.260686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:17.260686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:17.260686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:17.260686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:17.260686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:17.260686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:17.260686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:17.260686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:17.260686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:17.260686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:17.260686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:17.260686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:17.260686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:17.260686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:17.260686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:17.261486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:17.261486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:17.261486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:17.261486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:17.261486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:17.261486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:17.261486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:17.261486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:17.261486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:17.261486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:17.261486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:19:17.261486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:17.261486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 180/361] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:19:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:17.262690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be86d6-8925-4326-abee-1223c7f5cd69 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:17.319995 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 182/362] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:17.321326 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafed4d9-82e6-4dfc-869d-32e58d89120a None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:17.347991 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:17.390924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7be86d6-8925-4326-abee-1223c7f5cd69 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:17.411248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:17.439631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d1b91-4a03-4e34-ba78-e372d5a71a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:17.440500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d1b91-4a03-4e34-ba78-e372d5a71a52 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:17.440781 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d1b91-4a03-4e34-ba78-e372d5a71a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:17.441058 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d1b91-4a03-4e34-ba78-e372d5a71a52 None admin] PATH_INFO: `/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:17.442289 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d1b91-4a03-4e34-ba78-e372d5a71a52 None admin] RBAC: Authorizing `identity:get_group(group_id=b12e5815a0064aa7b7d3b2baac0ce7b1)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:17.443757 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d1b91-4a03-4e34-ba78-e372d5a71a52 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:17.446597 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 181/363] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 08:19:17 2022] GET /identity/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:17.447435 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d1b91-4a03-4e34-ba78-e372d5a71a52 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:17.451580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafed4d9-82e6-4dfc-869d-32e58d89120a None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:17.497673 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d264e-7c87-43fb-b6b7-e86356fe51d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:17.498679 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d264e-7c87-43fb-b6b7-e86356fe51d4 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:17.499183 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d264e-7c87-43fb-b6b7-e86356fe51d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:17.499647 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d264e-7c87-43fb-b6b7-e86356fe51d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:17.500413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d264e-7c87-43fb-b6b7-e86356fe51d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:17.501170 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d264e-7c87-43fb-b6b7-e86356fe51d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:17.502971 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d264e-7c87-43fb-b6b7-e86356fe51d4 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:17.514043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 183/364] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:19:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:17.514916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d264e-7c87-43fb-b6b7-e86356fe51d4 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:17.583215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d1b91-4a03-4e34-ba78-e372d5a71a52 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:17.627582 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa2d16-c302-4672-859b-2c8afd094cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:17.628941 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2d16-c302-4672-859b-2c8afd094cea None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:17.629185 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:17.629487 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2d16-c302-4672-859b-2c8afd094cea None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:17.629822 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa2d16-c302-4672-859b-2c8afd094cea None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:17.630924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa2d16-c302-4672-859b-2c8afd094cea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:17.631240 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa2d16-c302-4672-859b-2c8afd094cea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:17.633291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa2d16-c302-4672-859b-2c8afd094cea None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:17.642780 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 182/365] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:17.643761 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa2d16-c302-4672-859b-2c8afd094cea None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:17.651857 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d264e-7c87-43fb-b6b7-e86356fe51d4 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:17.695455 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489818a-c3d3-4761-a806-4ffc37059eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:17.696266 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489818a-c3d3-4761-a806-4ffc37059eae None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:17.696549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489818a-c3d3-4761-a806-4ffc37059eae None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:17.697862 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489818a-c3d3-4761-a806-4ffc37059eae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:17.698372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:17.709062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489818a-c3d3-4761-a806-4ffc37059eae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:17.716916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-2489818a-c3d3-4761-a806-4ffc37059eae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:19:17.716916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:17.716916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:17.716916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:17.716916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:17.716916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:17.716916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:17.716916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:17.716916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:17.716916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:17.716916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:17.716916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:17.716916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:17.716916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:17.716916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:17.716916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:17.717864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:17.717864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:17.717864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:17.717864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:17.717864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:17.717864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:17.717864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:17.717864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:17.717864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:17.717864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:17.717864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:17.717864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:17.717864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:17.717864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:17.717864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:17.717864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:17.718688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:17.718688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:17.718688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:17.718688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:17.718688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:17.718688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:17.718688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:17.718688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:17.718688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:17.718688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:17.718688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:19:17.718688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:17.718688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 184/366] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:19:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:17.719341 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489818a-c3d3-4761-a806-4ffc37059eae None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:17.775176 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa2d16-c302-4672-859b-2c8afd094cea None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:17.820327 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a01e88-c81e-444a-8e5d-6b68588b7943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:17.820988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a01e88-c81e-444a-8e5d-6b68588b7943 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:17.821271 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a01e88-c81e-444a-8e5d-6b68588b7943 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:17.821596 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a01e88-c81e-444a-8e5d-6b68588b7943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:17.822476 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a01e88-c81e-444a-8e5d-6b68588b7943 None admin] RBAC: Adding query filter params (group.id=b12e5815a0064aa7b7d3b2baac0ce7b1, role.id=80c590b37af34bca8dee5f7c87a38999, scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:17.822797 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a01e88-c81e-444a-8e5d-6b68588b7943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:17.824233 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a01e88-c81e-444a-8e5d-6b68588b7943 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:17.830655 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 183/367] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Jul 21 08:19:17 2022] GET /identity/v3/role_assignments?group.id=b12e5815a0064aa7b7d3b2baac0ce7b1&scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1&role.id=80c590b37af34bca8dee5f7c87a38999 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:17.831462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a01e88-c81e-444a-8e5d-6b68588b7943 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:17.875162 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489818a-c3d3-4761-a806-4ffc37059eae None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:17.925951 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d670ee-8305-4f93-b69d-338b2a74056f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:17.926879 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d670ee-8305-4f93-b69d-338b2a74056f None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:17.927583 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d670ee-8305-4f93-b69d-338b2a74056f None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:17.929007 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d670ee-8305-4f93-b69d-338b2a74056f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:17.946390 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:17.967895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a01e88-c81e-444a-8e5d-6b68588b7943 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:17.984021 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:18.017569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f9e2a-6438-48ab-82ef-63e67b9cb714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:18.019059 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f9e2a-6438-48ab-82ef-63e67b9cb714 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:18.019352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f9e2a-6438-48ab-82ef-63e67b9cb714 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:18.019635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f9e2a-6438-48ab-82ef-63e67b9cb714 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:18.026357 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d670ee-8305-4f93-b69d-338b2a74056f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:18.027902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d670ee-8305-4f93-b69d-338b2a74056f None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:18.117332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f9e2a-6438-48ab-82ef-63e67b9cb714 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:18.118878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f9e2a-6438-48ab-82ef-63e67b9cb714 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:18.152545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 185/368] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:19:18.153973 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d670ee-8305-4f93-b69d-338b2a74056f None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:18.199279 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:18.240484 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 184/369] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:19:18.241117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f9e2a-6438-48ab-82ef-63e67b9cb714 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:18.262322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:18.270700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d670ee-8305-4f93-b69d-338b2a74056f None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:18.318388 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91190c55-79c5-4c63-a6de-74d5a46cf643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:18.320011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91190c55-79c5-4c63-a6de-74d5a46cf643 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:18.320011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91190c55-79c5-4c63-a6de-74d5a46cf643 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:18.320011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91190c55-79c5-4c63-a6de-74d5a46cf643 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:18.320602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91190c55-79c5-4c63-a6de-74d5a46cf643 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:18.320910 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91190c55-79c5-4c63-a6de-74d5a46cf643 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:18.323074 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91190c55-79c5-4c63-a6de-74d5a46cf643 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:18.334202 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 186/370] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:18.335217 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91190c55-79c5-4c63-a6de-74d5a46cf643 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:18.374655 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f9e2a-6438-48ab-82ef-63e67b9cb714 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:18.422141 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6819867-8e25-4d08-a1df-836830d0a4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:18.423249 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6819867-8e25-4d08-a1df-836830d0a4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:18.423556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6819867-8e25-4d08-a1df-836830d0a4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:18.423841 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6819867-8e25-4d08-a1df-836830d0a4e8 None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:18.426005 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6819867-8e25-4d08-a1df-836830d0a4e8 None admin] RBAC: Authorizing `identity:get_project(project_id=f5e21a6b8db94073b1c84a6d986af044)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:18.427479 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6819867-8e25-4d08-a1df-836830d0a4e8 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:18.429799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 185/371] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:18 2022] GET /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:18.430592 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6819867-8e25-4d08-a1df-836830d0a4e8 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:18.470277 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91190c55-79c5-4c63-a6de-74d5a46cf643 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:18.473667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:18.517708 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba02de-fbd9-45b4-ab72-7f644cbb1ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:18.518577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba02de-fbd9-45b4-ab72-7f644cbb1ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:18.518862 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba02de-fbd9-45b4-ab72-7f644cbb1ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:18.519143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba02de-fbd9-45b4-ab72-7f644cbb1ac4 None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:18.521585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba02de-fbd9-45b4-ab72-7f644cbb1ac4 None admin] RBAC: Authorizing `identity:get_project(project_id=f5e21a6b8db94073b1c84a6d986af044)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:18.522997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba02de-fbd9-45b4-ab72-7f644cbb1ac4 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:18.525028 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 187/372] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:18 2022] GET /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:18.529590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba02de-fbd9-45b4-ab72-7f644cbb1ac4 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:18.535771 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:18.562689 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6819867-8e25-4d08-a1df-836830d0a4e8 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:18.615881 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ab783-1722-487c-81fc-f09bc5048f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:18.616541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ab783-1722-487c-81fc-f09bc5048f71 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:18.616826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ab783-1722-487c-81fc-f09bc5048f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:18.617108 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ab783-1722-487c-81fc-f09bc5048f71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:18.673661 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba02de-fbd9-45b4-ab72-7f644cbb1ac4 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:18.702992 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ab783-1722-487c-81fc-f09bc5048f71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:18.704772 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ab783-1722-487c-81fc-f09bc5048f71 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:18.720971 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e705d-5ee2-4259-9d2d-1b4efa2f8c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:18.720971 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e705d-5ee2-4259-9d2d-1b4efa2f8c6a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:18.720971 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e705d-5ee2-4259-9d2d-1b4efa2f8c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:18.720971 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e705d-5ee2-4259-9d2d-1b4efa2f8c6a None admin] PATH_INFO: `/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:18.726025 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e705d-5ee2-4259-9d2d-1b4efa2f8c6a None admin] RBAC: Authorizing `identity:get_group(group_id=b12e5815a0064aa7b7d3b2baac0ce7b1)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:18.726731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e705d-5ee2-4259-9d2d-1b4efa2f8c6a None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:18.729612 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 188/373] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 08:19:18 2022] GET /identity/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:18.730057 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e705d-5ee2-4259-9d2d-1b4efa2f8c6a None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:18.781478 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:18.830358 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:18.856443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 186/374] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:19:18.856613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e705d-5ee2-4259-9d2d-1b4efa2f8c6a None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:18.857739 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ab783-1722-487c-81fc-f09bc5048f71 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:18.912244 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a5e44-eeb3-4b0a-b09d-cb09a6adae42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:18.913756 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a5e44-eeb3-4b0a-b09d-cb09a6adae42 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:18.914053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a5e44-eeb3-4b0a-b09d-cb09a6adae42 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:18.914335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a5e44-eeb3-4b0a-b09d-cb09a6adae42 None admin] PATH_INFO: `/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:18.915960 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a5e44-eeb3-4b0a-b09d-cb09a6adae42 None admin] RBAC: Authorizing `identity:get_group(group_id=b12e5815a0064aa7b7d3b2baac0ce7b1)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:18.917818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a5e44-eeb3-4b0a-b09d-cb09a6adae42 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:18.920807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 189/375] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 08:19:18 2022] GET /identity/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:18.920807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a5e44-eeb3-4b0a-b09d-cb09a6adae42 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:18.985337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ab783-1722-487c-81fc-f09bc5048f71 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:19.025938 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc06496-aa41-4fa9-a7b1-23b19a69300c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:19.027016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc06496-aa41-4fa9-a7b1-23b19a69300c None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:19.027504 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc06496-aa41-4fa9-a7b1-23b19a69300c None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:19.028026 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc06496-aa41-4fa9-a7b1-23b19a69300c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:19.029061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc06496-aa41-4fa9-a7b1-23b19a69300c None admin] RBAC: Adding query filter params (group.id=b12e5815a0064aa7b7d3b2baac0ce7b1, role.id=80c590b37af34bca8dee5f7c87a38999, scope.project.id=f5e21a6b8db94073b1c84a6d986af044) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:19.029626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc06496-aa41-4fa9-a7b1-23b19a69300c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:19.031323 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc06496-aa41-4fa9-a7b1-23b19a69300c None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:19.037469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 187/376] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Jul 21 08:19:18 2022] GET /identity/v3/role_assignments?group.id=b12e5815a0064aa7b7d3b2baac0ce7b1&scope.project.id=f5e21a6b8db94073b1c84a6d986af044&role.id=80c590b37af34bca8dee5f7c87a38999 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:19.038548 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc06496-aa41-4fa9-a7b1-23b19a69300c None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:19.056399 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a5e44-eeb3-4b0a-b09d-cb09a6adae42 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:19.069268 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:19.112911 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:19.113654 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc9db9-1441-4af6-8f02-445eaa4d01dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:19.115530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc9db9-1441-4af6-8f02-445eaa4d01dd None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:19.116062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc9db9-1441-4af6-8f02-445eaa4d01dd None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:19.116561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc9db9-1441-4af6-8f02-445eaa4d01dd None admin] PATH_INFO: `/v3/projects/735f219fa6204590a96733afe606902c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:19.118344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc9db9-1441-4af6-8f02-445eaa4d01dd None admin] RBAC: Authorizing `identity:get_project(project_id=735f219fa6204590a96733afe606902c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:19.120144 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc9db9-1441-4af6-8f02-445eaa4d01dd None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:19.123208 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 190/377] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:18 2022] GET /identity/v3/projects/735f219fa6204590a96733afe606902c => generated 344 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:19.124900 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3eee5-bf0b-4740-a87f-4f70522f3860 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:19.127880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3eee5-bf0b-4740-a87f-4f70522f3860 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:19.128463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe3eee5-bf0b-4740-a87f-4f70522f3860 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:19.130596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 191/378] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:19.131669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3eee5-bf0b-4740-a87f-4f70522f3860 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:19.212372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc06496-aa41-4fa9-a7b1-23b19a69300c None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:19.267995 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3c1f3-b8e5-4ff0-afd8-371b597d8aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:19.269021 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3c1f3-b8e5-4ff0-afd8-371b597d8aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:19.269509 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3c1f3-b8e5-4ff0-afd8-371b597d8aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:19.270040 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3c1f3-b8e5-4ff0-afd8-371b597d8aa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:19.270971 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3c1f3-b8e5-4ff0-afd8-371b597d8aa8 None admin] RBAC: Adding query filter params (group.id=b12e5815a0064aa7b7d3b2baac0ce7b1, role.id=f6c74bb34f9c4b0faaf6a21007abcaa5, scope.project.id=f5e21a6b8db94073b1c84a6d986af044) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:19.271363 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3c1f3-b8e5-4ff0-afd8-371b597d8aa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:19.272902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3c1f3-b8e5-4ff0-afd8-371b597d8aa8 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:19.284049 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 188/379] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Jul 21 08:19:19 2022] GET /identity/v3/role_assignments?group.id=b12e5815a0064aa7b7d3b2baac0ce7b1&scope.project.id=f5e21a6b8db94073b1c84a6d986af044&role.id=f6c74bb34f9c4b0faaf6a21007abcaa5 => generated 260 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:19.285327 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b1c97-0199-461e-944d-2279cb99e43c None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:19.286145 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b1c97-0199-461e-944d-2279cb99e43c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:19.286428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b1c97-0199-461e-944d-2279cb99e43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:19.304768 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe3eee5-bf0b-4740-a87f-4f70522f3860 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:19.311078 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-c96b1c97-0199-461e-944d-2279cb99e43c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:19.312319 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c96b1c97-0199-461e-944d-2279cb99e43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:19.347636 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c61c7-0460-4e57-a734-fa3c574be471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:19.348604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c61c7-0460-4e57-a734-fa3c574be471 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:19.348988 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c61c7-0460-4e57-a734-fa3c574be471 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:19.349342 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c61c7-0460-4e57-a734-fa3c574be471 None admin] PATH_INFO: `/v3/groups/c51d1fe45afb495b86325b553d740edb` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:19.356672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c61c7-0460-4e57-a734-fa3c574be471 None admin] RBAC: Authorizing `identity:get_group(group_id=c51d1fe45afb495b86325b553d740edb)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:19.358520 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c61c7-0460-4e57-a734-fa3c574be471 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:19.360521 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 192/380] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 08:19:19 2022] GET /identity/v3/groups/c51d1fe45afb495b86325b553d740edb => generated 229 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:19.366230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c61c7-0460-4e57-a734-fa3c574be471 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:19.404359 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 189/381] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:19.425945 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:19.436975 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b1c97-0199-461e-944d-2279cb99e43c None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:19.496441 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:19.500513 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c61c7-0460-4e57-a734-fa3c574be471 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:19.546086 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0400850-58d7-426b-9354-f6b280cc30f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:19.547130 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0400850-58d7-426b-9354-f6b280cc30f0 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:19.547612 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0400850-58d7-426b-9354-f6b280cc30f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:19.548205 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0400850-58d7-426b-9354-f6b280cc30f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:19.550037 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0400850-58d7-426b-9354-f6b280cc30f0 None admin] RBAC: Adding query filter params (group.id=c51d1fe45afb495b86325b553d740edb, role.id=beed8caad097496292e544146859df5c, scope.project.id=735f219fa6204590a96733afe606902c) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:19.550819 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0400850-58d7-426b-9354-f6b280cc30f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:19.553135 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0400850-58d7-426b-9354-f6b280cc30f0 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:19.566658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 193/382] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Jul 21 08:19:19 2022] GET /identity/v3/role_assignments?group.id=c51d1fe45afb495b86325b553d740edb&scope.project.id=735f219fa6204590a96733afe606902c&role.id=beed8caad097496292e544146859df5c => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:19.613017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b1c97-0199-461e-944d-2279cb99e43c None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:19.659145 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497975a-39db-40ee-a5c7-6e2f54dc44a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:19.660346 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497975a-39db-40ee-a5c7-6e2f54dc44a8 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:19.660836 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497975a-39db-40ee-a5c7-6e2f54dc44a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:19.661308 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497975a-39db-40ee-a5c7-6e2f54dc44a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:19.675644 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497975a-39db-40ee-a5c7-6e2f54dc44a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:19.684541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-1497975a-39db-40ee-a5c7-6e2f54dc44a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:19:19.684541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:19.684541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:19.684541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:19.684541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:19.684541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:19.684541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:19.684541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:19.684541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:19.684541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:19.684541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:19.684541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:19.684541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:19.684541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:19.684541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:19.684541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:19.685500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:19.685500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:19.685500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:19.685500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:19.685500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:19.685500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:19.685500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:19.685500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:19.685500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:19.685500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:19.685500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:19.685500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:19.685500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:19.685500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:19.685500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:19.685500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:19.686378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:19.686378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:19.686378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:19.686378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:19.686378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:19.686378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:19.686378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:19.686378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:19.686378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:19.686378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:19.686378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:19:19.686378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:19.689227 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 190/383] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:19:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:19:19.695479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0400850-58d7-426b-9354-f6b280cc30f0 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:19.811346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0400850-58d7-426b-9354-f6b280cc30f0 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:19.813851 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:19.847443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32839b73-d7ae-4f09-9c37-c173bb20fe0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:19.848084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32839b73-d7ae-4f09-9c37-c173bb20fe0f None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:19.848372 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32839b73-d7ae-4f09-9c37-c173bb20fe0f None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:19.848649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32839b73-d7ae-4f09-9c37-c173bb20fe0f None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:19.849429 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32839b73-d7ae-4f09-9c37-c173bb20fe0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:19.849766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32839b73-d7ae-4f09-9c37-c173bb20fe0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:19.851195 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32839b73-d7ae-4f09-9c37-c173bb20fe0f None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:19.861565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 194/384] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:19.866772 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497975a-39db-40ee-a5c7-6e2f54dc44a8 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:19.976058 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:19.982393 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497975a-39db-40ee-a5c7-6e2f54dc44a8 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:20.034908 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe31a3-7a88-4573-859e-6fe0e9a06838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:20.035774 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe31a3-7a88-4573-859e-6fe0e9a06838 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:20.036059 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe31a3-7a88-4573-859e-6fe0e9a06838 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:20.036332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe31a3-7a88-4573-859e-6fe0e9a06838 None admin] PATH_INFO: `/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:20.042257 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe31a3-7a88-4573-859e-6fe0e9a06838 None admin] RBAC: Authorizing `identity:get_group(group_id=b12e5815a0064aa7b7d3b2baac0ce7b1)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:20.043782 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe31a3-7a88-4573-859e-6fe0e9a06838 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:20.045443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 191/385] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 08:19:19 2022] GET /identity/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:20.051256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32839b73-d7ae-4f09-9c37-c173bb20fe0f None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:20.162064 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32839b73-d7ae-4f09-9c37-c173bb20fe0f None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:20.198075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b2576-6c9c-43fc-861d-e22b07e87417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:20.198943 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b2576-6c9c-43fc-861d-e22b07e87417 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:20.199224 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b2576-6c9c-43fc-861d-e22b07e87417 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:20.199501 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b2576-6c9c-43fc-861d-e22b07e87417 None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:20.201324 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b2576-6c9c-43fc-861d-e22b07e87417 None admin] RBAC: Authorizing `identity:get_project(project_id=5b12104d6dfe4464b0c1b5738679bdb1)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:20.203223 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b2576-6c9c-43fc-861d-e22b07e87417 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:20.205129 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77aae0-f19c-42d7-a100-00fb22a810c1 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:20.205417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77aae0-f19c-42d7-a100-00fb22a810c1 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:20.205717 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77aae0-f19c-42d7-a100-00fb22a810c1 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:20.207212 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 192/386] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:19:20.208748 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 195/387] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:20 2022] GET /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:20.212589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f422c73-01dc-4cb3-ac1d-582ec33a2140 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:20.212951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f422c73-01dc-4cb3-ac1d-582ec33a2140 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:20.213555 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f422c73-01dc-4cb3-ac1d-582ec33a2140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:20.214220 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b2576-6c9c-43fc-861d-e22b07e87417 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:20.232416 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-8f422c73-01dc-4cb3-ac1d-582ec33a2140 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:20.233956 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-8f422c73-01dc-4cb3-ac1d-582ec33a2140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:20.265266 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:20.356895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 193/388] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 21 08:19:20.379765 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b2576-6c9c-43fc-861d-e22b07e87417 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:20.382655 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f422c73-01dc-4cb3-ac1d-582ec33a2140 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:20.481448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:20.482781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338cd89-60af-4222-9b18-424a30429197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:20.483680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338cd89-60af-4222-9b18-424a30429197 None admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:20.483961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338cd89-60af-4222-9b18-424a30429197 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:20.484234 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338cd89-60af-4222-9b18-424a30429197 None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1/groups/b12e5815a0064aa7b7d3b2baac0ce7b1/roles/f6c74bb34f9c4b0faaf6a21007abcaa5` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:20.488109 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f422c73-01dc-4cb3-ac1d-582ec33a2140 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:20.491380 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338cd89-60af-4222-9b18-424a30429197 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b12104d6dfe4464b0c1b5738679bdb1, group_id=b12e5815a0064aa7b7d3b2baac0ce7b1, role_id=f6c74bb34f9c4b0faaf6a21007abcaa5)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:20.493634 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338cd89-60af-4222-9b18-424a30429197 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:20.524534 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bf43f-57b7-46ad-9628-4934f90a596f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:20.525378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bf43f-57b7-46ad-9628-4934f90a596f None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:20.525688 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bf43f-57b7-46ad-9628-4934f90a596f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:20.525960 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bf43f-57b7-46ad-9628-4934f90a596f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:20.537037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bf43f-57b7-46ad-9628-4934f90a596f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:20.545218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-746bf43f-57b7-46ad-9628-4934f90a596f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:20.545218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:20.545218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:20.545218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:20.545218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:20.545218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:20.545218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:20.545218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:20.545218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:20.545218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:20.545218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:20.545218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:20.545218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:20.545218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:20.545218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:20.545218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:20.546175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:20.546175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:20.546175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:20.546175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:20.546175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:20.546175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:20.546175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:20.546175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:20.546175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:20.546175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:20.546175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:20.546175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:20.546175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:20.546175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:20.546175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:20.546175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:20.547022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:20.547022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:20.547022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:20.547022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:20.547022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:20.547022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:20.547022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:20.547022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:20.547022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:20.547022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:20.547022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:20.547022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:20.547022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 194/389] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:20.552454 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bf43f-57b7-46ad-9628-4934f90a596f None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:20.600686 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 196/390] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Jul 21 08:19:20 2022] PUT /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1/groups/b12e5815a0064aa7b7d3b2baac0ce7b1/roles/f6c74bb34f9c4b0faaf6a21007abcaa5 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:19:20.690854 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bf43f-57b7-46ad-9628-4934f90a596f None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:20.745076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c1d62-2e41-461d-8200-6343f7559730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:20.745726 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c1d62-2e41-461d-8200-6343f7559730 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:20.746013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c1d62-2e41-461d-8200-6343f7559730 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:20.746290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c1d62-2e41-461d-8200-6343f7559730 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:20.747647 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c1d62-2e41-461d-8200-6343f7559730 None admin] RBAC: Adding query filter params (name=member) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:20.747963 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c1d62-2e41-461d-8200-6343f7559730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:20.749425 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c1d62-2e41-461d-8200-6343f7559730 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:20.769438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 195/391] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:19:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:20.774608 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338cd89-60af-4222-9b18-424a30429197 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:20.916477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:20.924935 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338cd89-60af-4222-9b18-424a30429197 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:20.988060 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd2d2c-cace-4f3a-8579-3612d39dc7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:20.988922 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd2d2c-cace-4f3a-8579-3612d39dc7fc None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:20.989203 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd2d2c-cace-4f3a-8579-3612d39dc7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:20.989474 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd2d2c-cace-4f3a-8579-3612d39dc7fc None admin] PATH_INFO: `/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:20.990675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd2d2c-cace-4f3a-8579-3612d39dc7fc None admin] RBAC: Authorizing `identity:get_group(group_id=b12e5815a0064aa7b7d3b2baac0ce7b1)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:20.992175 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd2d2c-cace-4f3a-8579-3612d39dc7fc None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:20.994121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 197/392] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 08:19:20 2022] GET /identity/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:20.999703 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c1d62-2e41-461d-8200-6343f7559730 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:21.019111 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:21.103494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c1d62-2e41-461d-8200-6343f7559730 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:21.138519 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85e4c8-417c-402e-8691-fd0827974686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:21.139372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85e4c8-417c-402e-8691-fd0827974686 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:21.139646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85e4c8-417c-402e-8691-fd0827974686 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:21.139911 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85e4c8-417c-402e-8691-fd0827974686 None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:21.141202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85e4c8-417c-402e-8691-fd0827974686 None admin] RBAC: Authorizing `identity:get_project(project_id=5b12104d6dfe4464b0c1b5738679bdb1)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:21.142682 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85e4c8-417c-402e-8691-fd0827974686 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:21.144364 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 196/393] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:20 2022] GET /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:21.150264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd2d2c-cace-4f3a-8579-3612d39dc7fc None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:21.272549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd2d2c-cace-4f3a-8579-3612d39dc7fc None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:21.323344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2601d95-f243-4031-81a3-7673897a349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:21.324271 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2601d95-f243-4031-81a3-7673897a349c None admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:21.324577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2601d95-f243-4031-81a3-7673897a349c None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:21.324851 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2601d95-f243-4031-81a3-7673897a349c None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1/groups/b12e5815a0064aa7b7d3b2baac0ce7b1/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:21.330862 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2601d95-f243-4031-81a3-7673897a349c None admin] RBAC: Authorizing `identity:create_grant(project_id=5b12104d6dfe4464b0c1b5738679bdb1, group_id=b12e5815a0064aa7b7d3b2baac0ce7b1, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:21.332293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2601d95-f243-4031-81a3-7673897a349c None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:21.424289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 198/394] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Jul 21 08:19:21 2022] PUT /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1/groups/b12e5815a0064aa7b7d3b2baac0ce7b1/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:19:21.827829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fc207-f177-4f9e-90f4-3186cb0e6da1 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:21.828170 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fc207-f177-4f9e-90f4-3186cb0e6da1 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:21.828371 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fc207-f177-4f9e-90f4-3186cb0e6da1 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:21.830005 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 197/395] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:21.835321 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eff3f7-132c-498b-886a-7349d94368c9 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:21.835838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eff3f7-132c-498b-886a-7349d94368c9 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:21.836329 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eff3f7-132c-498b-886a-7349d94368c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:21.862520 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-b9eff3f7-132c-498b-886a-7349d94368c9 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:21.864055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b9eff3f7-132c-498b-886a-7349d94368c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:21.881947 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:21.947177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 199/396] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:21.957125 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bd7ec-a27b-411e-982d-cd56432a55a3 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:21.957564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bd7ec-a27b-411e-982d-cd56432a55a3 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:21.957754 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277bd7ec-a27b-411e-982d-cd56432a55a3 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:21.959322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 198/397] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:21.964565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93557d32-b828-489b-826e-baff63944dc4 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:21.965720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93557d32-b828-489b-826e-baff63944dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:21.966185 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93557d32-b828-489b-826e-baff63944dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:21.974923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bd7ec-a27b-411e-982d-cd56432a55a3 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:21.990020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-93557d32-b828-489b-826e-baff63944dc4 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:21.991445 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-93557d32-b828-489b-826e-baff63944dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:22.084478 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 200/398] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:22.084478 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfb02f-addf-4ff9-8e6d-80bc2c562982 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:22.084478 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfb02f-addf-4ff9-8e6d-80bc2c562982 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:22.084478 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cfb02f-addf-4ff9-8e6d-80bc2c562982 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:22.088921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 201/399] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:22.090660 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7bdab-32ba-4f35-b044-d2e47af5ce4f None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:22.094146 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7bdab-32ba-4f35-b044-d2e47af5ce4f None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:22.094146 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7bdab-32ba-4f35-b044-d2e47af5ce4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:22.110709 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-09b7bdab-32ba-4f35-b044-d2e47af5ce4f None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:22.111452 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:22.111895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-09b7bdab-32ba-4f35-b044-d2e47af5ce4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:22.137180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277bd7ec-a27b-411e-982d-cd56432a55a3 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:22.180196 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9dfa1-b5fb-408a-9d98-0dd0bb2d082c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:22.181387 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9dfa1-b5fb-408a-9d98-0dd0bb2d082c None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:22.182163 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9dfa1-b5fb-408a-9d98-0dd0bb2d082c None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:22.182859 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9dfa1-b5fb-408a-9d98-0dd0bb2d082c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:22.197713 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 202/400] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:22.199081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7bdab-32ba-4f35-b044-d2e47af5ce4f None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:22.200274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa9dfa1-b5fb-408a-9d98-0dd0bb2d082c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:22.218029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-faa9dfa1-b5fb-408a-9d98-0dd0bb2d082c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:22.218029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:22.218029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:22.218029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:22.218029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:22.218029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:22.218029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:22.218029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:22.218029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:22.218029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:22.218029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:22.218029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:22.218029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:22.218029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:22.218029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:22.218029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:22.219148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:22.219148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:22.219148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:22.219148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:22.219148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:22.219148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:22.219148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:22.219148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:22.219148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:22.219148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:22.219148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:22.219148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:22.219148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:22.219148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:22.219148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:22.219148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:22.220039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:22.220039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:22.220039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:22.220039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:22.220039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:22.220039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:22.220039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:22.220039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:22.220039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:22.220039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:22.220039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:22.220039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:22.222685 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 199/401] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:19:22.223904 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9dfa1-b5fb-408a-9d98-0dd0bb2d082c None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:22.230458 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:22.328393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7bdab-32ba-4f35-b044-d2e47af5ce4f None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:22.361546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9dfa1-b5fb-408a-9d98-0dd0bb2d082c None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:22.373157 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aaec7b-09b0-4426-aecb-e251b1b738e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:22.374787 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaec7b-09b0-4426-aecb-e251b1b738e2 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:22.375660 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaec7b-09b0-4426-aecb-e251b1b738e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:22.376130 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aaec7b-09b0-4426-aecb-e251b1b738e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:22.392299 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aaec7b-09b0-4426-aecb-e251b1b738e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:22.403774 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383fbac-86c7-4d34-ae76-89595b6fa576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:22.404656 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383fbac-86c7-4d34-ae76-89595b6fa576 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:22.405057 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383fbac-86c7-4d34-ae76-89595b6fa576 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:22.405404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383fbac-86c7-4d34-ae76-89595b6fa576 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:22.405727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-e3aaec7b-09b0-4426-aecb-e251b1b738e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:19:22.405727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:22.405727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:22.405727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:22.405727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:22.405727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:22.405727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:22.405727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:22.405727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:22.405727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:22.405727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:22.405727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:22.405727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:22.405727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:22.405727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:22.405727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:22.406581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:22.406581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:22.406581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:22.406581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:22.406581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:22.406581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:22.406581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:22.406581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:22.406581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:22.406581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:22.406581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:22.406581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:22.406581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:22.406581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:22.406581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:22.406581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:22.407368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:22.407368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:22.407368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:22.407368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:22.407368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:22.407368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:22.407368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:22.407368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:22.407368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:22.407368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:22.407368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:19:22.407368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:22.414790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 203/402] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:19:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:22.414790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aaec7b-09b0-4426-aecb-e251b1b738e2 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:22.421668 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383fbac-86c7-4d34-ae76-89595b6fa576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:22.430076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-d383fbac-86c7-4d34-ae76-89595b6fa576 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:19:22.430076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:22.430076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:22.430076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:22.430076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:22.430076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:22.430076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:22.430076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:22.430076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:22.430076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:22.430076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:22.430076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:22.430076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:22.430076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:22.430076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:22.430076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:22.431004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:22.431004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:22.431004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:22.431004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:22.431004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:22.431004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:22.431004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:22.431004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:22.431004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:22.431004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:22.431004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:22.431004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:22.431004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:22.431004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:22.431004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:22.431004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:22.432405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:22.432405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:22.432405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:22.432405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:22.432405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:22.432405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:22.432405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:22.432405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:22.432405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:22.432405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:22.432405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:19:22.432405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:22.432405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 200/403] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:19:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:22.433105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383fbac-86c7-4d34-ae76-89595b6fa576 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:22.438160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:22.504149 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:22.539707 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aaec7b-09b0-4426-aecb-e251b1b738e2 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:22.566657 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383fbac-86c7-4d34-ae76-89595b6fa576 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:22.577179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7512963-b29c-4c8f-bd71-b1313fb5fb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:22.577889 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7512963-b29c-4c8f-bd71-b1313fb5fb9d None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:22.578174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7512963-b29c-4c8f-bd71-b1313fb5fb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:22.578451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7512963-b29c-4c8f-bd71-b1313fb5fb9d None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:22.579193 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7512963-b29c-4c8f-bd71-b1313fb5fb9d None admin] RBAC: Adding query filter params (name=member) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:22.579501 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7512963-b29c-4c8f-bd71-b1313fb5fb9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:22.580994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7512963-b29c-4c8f-bd71-b1313fb5fb9d None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:22.590738 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 204/404] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:19:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:22.591608 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7512963-b29c-4c8f-bd71-b1313fb5fb9d None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:22.614736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76c275-2530-4602-87af-6b3838eb09f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:22.615708 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76c275-2530-4602-87af-6b3838eb09f9 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:22.616709 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76c275-2530-4602-87af-6b3838eb09f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:22.617189 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76c275-2530-4602-87af-6b3838eb09f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:22.618444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76c275-2530-4602-87af-6b3838eb09f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:22.619264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76c275-2530-4602-87af-6b3838eb09f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:22.622093 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76c275-2530-4602-87af-6b3838eb09f9 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:22.633694 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 201/405] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:22.634816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76c275-2530-4602-87af-6b3838eb09f9 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:22.704066 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7512963-b29c-4c8f-bd71-b1313fb5fb9d None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:22.721041 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:22.742337 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395261f-e087-4cf0-a68b-a3b7a6bd0fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:22.745317 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395261f-e087-4cf0-a68b-a3b7a6bd0fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:22.745706 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395261f-e087-4cf0-a68b-a3b7a6bd0fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:22.745970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395261f-e087-4cf0-a68b-a3b7a6bd0fa6 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:22.747261 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395261f-e087-4cf0-a68b-a3b7a6bd0fa6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:22.747822 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395261f-e087-4cf0-a68b-a3b7a6bd0fa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:22.749008 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b395261f-e087-4cf0-a68b-a3b7a6bd0fa6 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:22.751213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:22.766086 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 205/406] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:22.766086 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395261f-e087-4cf0-a68b-a3b7a6bd0fa6 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:22.766634 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76c275-2530-4602-87af-6b3838eb09f9 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:22.802704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b939d8-105a-4997-bc7d-3f524a4651f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:22.803573 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b939d8-105a-4997-bc7d-3f524a4651f5 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:22.803855 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b939d8-105a-4997-bc7d-3f524a4651f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:22.804133 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b939d8-105a-4997-bc7d-3f524a4651f5 None admin] PATH_INFO: `/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:22.805365 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b939d8-105a-4997-bc7d-3f524a4651f5 None admin] RBAC: Authorizing `identity:get_group(group_id=b12e5815a0064aa7b7d3b2baac0ce7b1)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:22.806901 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b939d8-105a-4997-bc7d-3f524a4651f5 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:22.808640 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 202/407] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 08:19:22 2022] GET /identity/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:22.810259 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b939d8-105a-4997-bc7d-3f524a4651f5 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:22.878237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395261f-e087-4cf0-a68b-a3b7a6bd0fa6 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:22.913555 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b939d8-105a-4997-bc7d-3f524a4651f5 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:22.916566 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbaf6a-f9c6-49e4-aa0b-04ee88703ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:22.917479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbaf6a-f9c6-49e4-aa0b-04ee88703ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:22.917812 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbaf6a-f9c6-49e4-aa0b-04ee88703ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:22.918088 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbaf6a-f9c6-49e4-aa0b-04ee88703ae5 None admin] PATH_INFO: `/v3/groups/c51d1fe45afb495b86325b553d740edb` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:22.919315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbaf6a-f9c6-49e4-aa0b-04ee88703ae5 None admin] RBAC: Authorizing `identity:get_group(group_id=c51d1fe45afb495b86325b553d740edb)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:22.920773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbaf6a-f9c6-49e4-aa0b-04ee88703ae5 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:22.922479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 206/408] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 08:19:22 2022] GET /identity/v3/groups/c51d1fe45afb495b86325b553d740edb => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:22.923345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbaf6a-f9c6-49e4-aa0b-04ee88703ae5 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:22.949000 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7cfa0-10c1-4513-9c12-d2ecb7ee2fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:22.950541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7cfa0-10c1-4513-9c12-d2ecb7ee2fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:22.950822 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7cfa0-10c1-4513-9c12-d2ecb7ee2fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:22.951094 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7cfa0-10c1-4513-9c12-d2ecb7ee2fe4 None admin] PATH_INFO: `/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:22.952295 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7cfa0-10c1-4513-9c12-d2ecb7ee2fe4 None admin] RBAC: Authorizing `identity:get_group(group_id=b12e5815a0064aa7b7d3b2baac0ce7b1)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:22.953764 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7cfa0-10c1-4513-9c12-d2ecb7ee2fe4 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:22.955737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 203/409] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 08:19:22 2022] GET /identity/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:22.956575 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7cfa0-10c1-4513-9c12-d2ecb7ee2fe4 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:22.959272 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:22.992386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:23.035192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbaf6a-f9c6-49e4-aa0b-04ee88703ae5 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:23.058577 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7cfa0-10c1-4513-9c12-d2ecb7ee2fe4 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:23.074042 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84083d46-946e-4c56-9610-726a40342ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:23.075149 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84083d46-946e-4c56-9610-726a40342ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:23.075573 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84083d46-946e-4c56-9610-726a40342ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:23.076117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84083d46-946e-4c56-9610-726a40342ff9 None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:23.077475 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84083d46-946e-4c56-9610-726a40342ff9 None admin] RBAC: Authorizing `identity:get_project(project_id=f5e21a6b8db94073b1c84a6d986af044)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:23.079111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84083d46-946e-4c56-9610-726a40342ff9 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:23.081344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 207/410] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:22 2022] GET /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:23.082284 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84083d46-946e-4c56-9610-726a40342ff9 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:23.097195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeeb62-b983-4f0a-b4a9-ffa77eceef09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:23.098128 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeeb62-b983-4f0a-b4a9-ffa77eceef09 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:23.098414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeeb62-b983-4f0a-b4a9-ffa77eceef09 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:23.098692 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeeb62-b983-4f0a-b4a9-ffa77eceef09 None admin] PATH_INFO: `/v3/projects/735f219fa6204590a96733afe606902c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:23.099929 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feeeb62-b983-4f0a-b4a9-ffa77eceef09 None admin] RBAC: Authorizing `identity:get_project(project_id=735f219fa6204590a96733afe606902c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:23.101385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feeeb62-b983-4f0a-b4a9-ffa77eceef09 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:23.103866 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 204/411] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:22 2022] GET /identity/v3/projects/735f219fa6204590a96733afe606902c => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:23.104636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeeb62-b983-4f0a-b4a9-ffa77eceef09 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:23.176736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:23.198535 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84083d46-946e-4c56-9610-726a40342ff9 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:23.207765 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeeb62-b983-4f0a-b4a9-ffa77eceef09 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:23.231481 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:23.236756 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2d257-9fe7-4b52-8123-c9e725080c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:23.237665 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2d257-9fe7-4b52-8123-c9e725080c59 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:23.238038 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2d257-9fe7-4b52-8123-c9e725080c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:23.238208 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2d257-9fe7-4b52-8123-c9e725080c59 None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:23.239376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2d257-9fe7-4b52-8123-c9e725080c59 None admin] RBAC: Authorizing `identity:get_project(project_id=f5e21a6b8db94073b1c84a6d986af044)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:23.240816 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2d257-9fe7-4b52-8123-c9e725080c59 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:23.247118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 208/412] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:23 2022] GET /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:23.247118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2d257-9fe7-4b52-8123-c9e725080c59 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:23.249844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3f571-ae5a-4983-bebd-a64da7bef1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:23.250751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3f571-ae5a-4983-bebd-a64da7bef1b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:23.251037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3f571-ae5a-4983-bebd-a64da7bef1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:23.251305 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3f571-ae5a-4983-bebd-a64da7bef1b4 None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044/groups/b12e5815a0064aa7b7d3b2baac0ce7b1/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:23.253263 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3f571-ae5a-4983-bebd-a64da7bef1b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5e21a6b8db94073b1c84a6d986af044, group_id=b12e5815a0064aa7b7d3b2baac0ce7b1, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:23.254727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3f571-ae5a-4983-bebd-a64da7bef1b4 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:23.343530 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 205/413] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Jul 21 08:19:23 2022] PUT /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044/groups/b12e5815a0064aa7b7d3b2baac0ce7b1/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:19:23.349798 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2d257-9fe7-4b52-8123-c9e725080c59 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:23.351117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc13689-2cbf-4cfc-97c8-9831ef844d9c None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:23.351411 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc13689-2cbf-4cfc-97c8-9831ef844d9c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:23.351701 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc13689-2cbf-4cfc-97c8-9831ef844d9c None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:23.353313 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 206/414] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:23.354024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc13689-2cbf-4cfc-97c8-9831ef844d9c None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:23.403000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8363730-599f-4357-84c0-1b24effc67d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:23.403989 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8363730-599f-4357-84c0-1b24effc67d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:23.404281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8363730-599f-4357-84c0-1b24effc67d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:23.404557 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8363730-599f-4357-84c0-1b24effc67d4 None admin] PATH_INFO: `/v3/projects/735f219fa6204590a96733afe606902c/groups/c51d1fe45afb495b86325b553d740edb/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:23.407131 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8363730-599f-4357-84c0-1b24effc67d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=735f219fa6204590a96733afe606902c, group_id=c51d1fe45afb495b86325b553d740edb, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:23.408624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8363730-599f-4357-84c0-1b24effc67d4 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:23.465209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 209/415] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Jul 21 08:19:23 2022] PUT /identity/v3/projects/735f219fa6204590a96733afe606902c/groups/c51d1fe45afb495b86325b553d740edb/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:19:23.467284 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb5f58-e912-4614-9092-218ee2701fef None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:23.467786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb5f58-e912-4614-9092-218ee2701fef None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:23.468358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb5f58-e912-4614-9092-218ee2701fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:23.490800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-15fb5f58-e912-4614-9092-218ee2701fef None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:23.491942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-15fb5f58-e912-4614-9092-218ee2701fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:23.495388 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc13689-2cbf-4cfc-97c8-9831ef844d9c None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:23.529706 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:23.547486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02694b-345a-4e7e-ad8c-8ed1496fb353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:23.548420 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02694b-345a-4e7e-ad8c-8ed1496fb353 None admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:23.548724 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02694b-345a-4e7e-ad8c-8ed1496fb353 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:23.549414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a02694b-345a-4e7e-ad8c-8ed1496fb353 None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044/groups/b12e5815a0064aa7b7d3b2baac0ce7b1/roles/f6c74bb34f9c4b0faaf6a21007abcaa5` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:23.552282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02694b-345a-4e7e-ad8c-8ed1496fb353 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5e21a6b8db94073b1c84a6d986af044, group_id=b12e5815a0064aa7b7d3b2baac0ce7b1, role_id=f6c74bb34f9c4b0faaf6a21007abcaa5)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:23.554374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a02694b-345a-4e7e-ad8c-8ed1496fb353 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:23.565516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:23.580148 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 210/416] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:23.605715 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb5f58-e912-4614-9092-218ee2701fef None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:23.616638 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 207/417] 10.222.0.57 () {58 vars in 1442 bytes} [Thu Jul 21 08:19:23 2022] PUT /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044/groups/b12e5815a0064aa7b7d3b2baac0ce7b1/roles/f6c74bb34f9c4b0faaf6a21007abcaa5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:19:23.738601 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb5f58-e912-4614-9092-218ee2701fef None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:23.781175 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ae568-4599-4820-b7cb-415ba7e6f3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:23.782028 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ae568-4599-4820-b7cb-415ba7e6f3cb None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:23.782309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ae568-4599-4820-b7cb-415ba7e6f3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:23.782588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ae568-4599-4820-b7cb-415ba7e6f3cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:23.795420 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ae568-4599-4820-b7cb-415ba7e6f3cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:23.803800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-f56ae568-4599-4820-b7cb-415ba7e6f3cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:19:23.803800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:23.803800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:23.803800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:23.803800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:23.803800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:23.803800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:23.803800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:23.803800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:23.803800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:23.803800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:23.803800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:23.803800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:23.803800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:23.803800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:23.803800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:23.804783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:23.804783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:23.804783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:23.804783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:23.804783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:23.804783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:23.804783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:23.804783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:23.804783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:23.804783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:23.804783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:23.804783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:23.804783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:23.804783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:23.804783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:23.804783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:23.805604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:23.805604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:23.805604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:23.805604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:23.805604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:23.805604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:23.805604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:23.805604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:23.805604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:23.805604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:23.805604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:19:23.805604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:23.809748 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 211/418] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:19:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:23.814685 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02694b-345a-4e7e-ad8c-8ed1496fb353 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:23.826210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec20705-a689-4a99-9787-f4810b6b0a99 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:23.826711 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec20705-a689-4a99-9787-f4810b6b0a99 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:23.827136 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec20705-a689-4a99-9787-f4810b6b0a99 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:23.828948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 212/419] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:23.835204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42795662-2ea3-405b-a7db-e38b2ddbab19 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:23.835494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42795662-2ea3-405b-a7db-e38b2ddbab19 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:23.835776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42795662-2ea3-405b-a7db-e38b2ddbab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:23.852886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-42795662-2ea3-405b-a7db-e38b2ddbab19 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:23.854103 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-42795662-2ea3-405b-a7db-e38b2ddbab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:23.905273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:23.927385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 213/420] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:19:23.928134 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a02694b-345a-4e7e-ad8c-8ed1496fb353 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:23.967693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42795662-2ea3-405b-a7db-e38b2ddbab19 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:23.990893 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d376b82-8b6e-46fb-afaf-c6e1eef57a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:23.991508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d376b82-8b6e-46fb-afaf-c6e1eef57a19 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:23.992196 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d376b82-8b6e-46fb-afaf-c6e1eef57a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:23.992596 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d376b82-8b6e-46fb-afaf-c6e1eef57a19 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:23.993837 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d376b82-8b6e-46fb-afaf-c6e1eef57a19 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:23.994151 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d376b82-8b6e-46fb-afaf-c6e1eef57a19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:23.995609 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d376b82-8b6e-46fb-afaf-c6e1eef57a19 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:24.017197 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 208/421] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:24.028894 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d376b82-8b6e-46fb-afaf-c6e1eef57a19 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:24.082320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42795662-2ea3-405b-a7db-e38b2ddbab19 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:24.119282 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f8194-4f52-4ac7-9860-ceda9b62eb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:24.120483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f8194-4f52-4ac7-9860-ceda9b62eb1d None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:24.121075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f8194-4f52-4ac7-9860-ceda9b62eb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:24.122085 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f8194-4f52-4ac7-9860-ceda9b62eb1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:24.133768 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f8194-4f52-4ac7-9860-ceda9b62eb1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:24.143377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-a38f8194-4f52-4ac7-9860-ceda9b62eb1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:24.143377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:24.143377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:24.143377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:24.143377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:24.143377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:24.143377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:24.143377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:24.143377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:24.143377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:24.143377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:24.143377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:24.143377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:24.143377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:24.143377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:24.143377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:24.144331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:24.144331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:24.144331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:24.144331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:24.144331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:24.144331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:24.144331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:24.144331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:24.144331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:24.144331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:24.144331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:24.144331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:24.144331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:24.144331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:24.144331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:24.144331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:24.145127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:24.145127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:24.145127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:24.145127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:24.145127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:24.145127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:24.145127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:24.145127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:24.145127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:24.145127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:24.145127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:24.145127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:24.147563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 214/422] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:19:24.153699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f8194-4f52-4ac7-9860-ceda9b62eb1d None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:24.167321 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:24.222077 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:24.263934 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f8194-4f52-4ac7-9860-ceda9b62eb1d None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:24.287682 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d376b82-8b6e-46fb-afaf-c6e1eef57a19 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:24.300129 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a184648-7061-4222-b5aa-ef0b637f21dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:24.301156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a184648-7061-4222-b5aa-ef0b637f21dc None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:24.301790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a184648-7061-4222-b5aa-ef0b637f21dc None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:24.302293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a184648-7061-4222-b5aa-ef0b637f21dc None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:24.303250 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a184648-7061-4222-b5aa-ef0b637f21dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:24.303751 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a184648-7061-4222-b5aa-ef0b637f21dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:24.305308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a184648-7061-4222-b5aa-ef0b637f21dc None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:24.319033 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 215/423] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:19:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:24.321041 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a184648-7061-4222-b5aa-ef0b637f21dc None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:24.394290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf09a1-1d44-4907-890a-249d71d32ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:24.394962 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf09a1-1d44-4907-890a-249d71d32ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:24.395240 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf09a1-1d44-4907-890a-249d71d32ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:24.395514 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf09a1-1d44-4907-890a-249d71d32ab3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:24.433448 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a184648-7061-4222-b5aa-ef0b637f21dc None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:24.441835 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:24.477289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4720e-1937-4bd1-8136-15e52b1ffafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:24.478318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4720e-1937-4bd1-8136-15e52b1ffafe None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:24.478864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4720e-1937-4bd1-8136-15e52b1ffafe None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:24.479334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4720e-1937-4bd1-8136-15e52b1ffafe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:24.512742 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf09a1-1d44-4907-890a-249d71d32ab3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:24.514717 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf09a1-1d44-4907-890a-249d71d32ab3 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:24.581509 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:24.641666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 209/424] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:19:24.644657 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf09a1-1d44-4907-890a-249d71d32ab3 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:24.734401 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4720e-1937-4bd1-8136-15e52b1ffafe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:24.735854 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4720e-1937-4bd1-8136-15e52b1ffafe None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:24.758022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf09a1-1d44-4907-890a-249d71d32ab3 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:24.797176 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851e995-a9f2-431a-9565-76e3aff6d877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:24.798390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851e995-a9f2-431a-9565-76e3aff6d877 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:24.798930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851e995-a9f2-431a-9565-76e3aff6d877 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:24.799469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851e995-a9f2-431a-9565-76e3aff6d877 None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:24.800896 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851e995-a9f2-431a-9565-76e3aff6d877 None admin] RBAC: Authorizing `identity:get_project(project_id=5b12104d6dfe4464b0c1b5738679bdb1)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:24.802573 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851e995-a9f2-431a-9565-76e3aff6d877 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:24.809649 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 210/425] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:24 2022] GET /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:24.811540 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851e995-a9f2-431a-9565-76e3aff6d877 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:24.835528 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:24.921987 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851e995-a9f2-431a-9565-76e3aff6d877 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:24.962134 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2fc23-f590-4bec-8794-e5405c3d3831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:24.966036 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2fc23-f590-4bec-8794-e5405c3d3831 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:24.968763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2fc23-f590-4bec-8794-e5405c3d3831 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:24.969247 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2fc23-f590-4bec-8794-e5405c3d3831 None admin] PATH_INFO: `/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:24.971828 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2fc23-f590-4bec-8794-e5405c3d3831 None admin] RBAC: Authorizing `identity:get_group(group_id=b12e5815a0064aa7b7d3b2baac0ce7b1)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:24.975001 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f2fc23-f590-4bec-8794-e5405c3d3831 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:24.983717 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 211/426] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 08:19:24 2022] GET /identity/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:24.985292 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2fc23-f590-4bec-8794-e5405c3d3831 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:25.094582 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 216/427] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 767 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:19:25.095658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4720e-1937-4bd1-8136-15e52b1ffafe None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:25.098041 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:25.114048 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:25.131406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2fc23-f590-4bec-8794-e5405c3d3831 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:25.177808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabed657-ed73-414e-bf19-74a4e2c88438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:25.178859 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabed657-ed73-414e-bf19-74a4e2c88438 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:25.179342 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabed657-ed73-414e-bf19-74a4e2c88438 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:25.179814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabed657-ed73-414e-bf19-74a4e2c88438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:25.180866 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabed657-ed73-414e-bf19-74a4e2c88438 None admin] RBAC: Adding query filter params (group.id=b12e5815a0064aa7b7d3b2baac0ce7b1, role.id=f6c74bb34f9c4b0faaf6a21007abcaa5, scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:25.181391 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabed657-ed73-414e-bf19-74a4e2c88438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:25.183050 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabed657-ed73-414e-bf19-74a4e2c88438 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:25.197691 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 212/428] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Jul 21 08:19:24 2022] GET /identity/v3/role_assignments?group.id=b12e5815a0064aa7b7d3b2baac0ce7b1&scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1&role.id=f6c74bb34f9c4b0faaf6a21007abcaa5 => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:25.330904 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4720e-1937-4bd1-8136-15e52b1ffafe None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:25.390887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfe619-9cb3-486f-a1ad-180a5583384e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:25.391763 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfe619-9cb3-486f-a1ad-180a5583384e None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:25.392049 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfe619-9cb3-486f-a1ad-180a5583384e None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:25.395838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cfe619-9cb3-486f-a1ad-180a5583384e None admin] PATH_INFO: `/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:25.398299 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfe619-9cb3-486f-a1ad-180a5583384e None admin] RBAC: Authorizing `identity:get_project(project_id=5b12104d6dfe4464b0c1b5738679bdb1)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:25.399741 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cfe619-9cb3-486f-a1ad-180a5583384e None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:25.401777 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 217/429] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:25 2022] GET /identity/v3/projects/5b12104d6dfe4464b0c1b5738679bdb1 => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:25.411598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabed657-ed73-414e-bf19-74a4e2c88438 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:25.593698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabed657-ed73-414e-bf19-74a4e2c88438 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:25.636054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c124ba0c-2fba-437d-ada3-a2c0a4b5c408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:25.639546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124ba0c-2fba-437d-ada3-a2c0a4b5c408 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:25.639842 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124ba0c-2fba-437d-ada3-a2c0a4b5c408 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:25.640117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c124ba0c-2fba-437d-ada3-a2c0a4b5c408 None admin] PATH_INFO: `/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:25.644488 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124ba0c-2fba-437d-ada3-a2c0a4b5c408 None admin] RBAC: Authorizing `identity:get_group(group_id=b12e5815a0064aa7b7d3b2baac0ce7b1)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:25.645967 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c124ba0c-2fba-437d-ada3-a2c0a4b5c408 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:25.647657 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 213/430] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 08:19:25 2022] GET /identity/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:25.653655 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfe619-9cb3-486f-a1ad-180a5583384e None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:25.727540 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:25.759080 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cfe619-9cb3-486f-a1ad-180a5583384e None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:25.787153 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf4a7e-e514-43b2-91fc-c8292c7bf79e None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:25.787443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf4a7e-e514-43b2-91fc-c8292c7bf79e None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:25.787718 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf4a7e-e514-43b2-91fc-c8292c7bf79e None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:25.789073 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 214/431] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:25.794748 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ad8bc-79c8-4956-8d0a-4f93cfba3bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:25.795399 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ad8bc-79c8-4956-8d0a-4f93cfba3bdb None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:25.795676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ad8bc-79c8-4956-8d0a-4f93cfba3bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:25.795947 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ad8bc-79c8-4956-8d0a-4f93cfba3bdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:25.796769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ad8bc-79c8-4956-8d0a-4f93cfba3bdb None admin] RBAC: Adding query filter params (group.id=b12e5815a0064aa7b7d3b2baac0ce7b1, role.id=80c590b37af34bca8dee5f7c87a38999, scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:25.797079 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ad8bc-79c8-4956-8d0a-4f93cfba3bdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:25.798532 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ad8bc-79c8-4956-8d0a-4f93cfba3bdb None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:25.798776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8daf62-b9ba-4158-884f-a04fa6497300 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:25.799062 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8daf62-b9ba-4158-884f-a04fa6497300 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:25.799338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8daf62-b9ba-4158-884f-a04fa6497300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:25.806539 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 218/432] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Jul 21 08:19:25 2022] GET /identity/v3/role_assignments?group.id=b12e5815a0064aa7b7d3b2baac0ce7b1&scope.project.id=5b12104d6dfe4464b0c1b5738679bdb1&role.id=80c590b37af34bca8dee5f7c87a38999 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:25.822149 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-ce8daf62-b9ba-4158-884f-a04fa6497300 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:25.823768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ce8daf62-b9ba-4158-884f-a04fa6497300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:25.841937 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:25.909801 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 215/433] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:19:25.927420 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ad8bc-79c8-4956-8d0a-4f93cfba3bdb None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:26.039078 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ad8bc-79c8-4956-8d0a-4f93cfba3bdb None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:26.079009 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6a4ce-6b5b-4764-9d6f-f15b0ce2e51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:26.079800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6a4ce-6b5b-4764-9d6f-f15b0ce2e51d None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:26.080077 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6a4ce-6b5b-4764-9d6f-f15b0ce2e51d None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:26.080347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6a4ce-6b5b-4764-9d6f-f15b0ce2e51d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:26.083342 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:26.093002 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea6a4ce-6b5b-4764-9d6f-f15b0ce2e51d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:26.100817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-eea6a4ce-6b5b-4764-9d6f-f15b0ce2e51d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:26.100817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:26.100817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:26.100817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:26.100817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:26.100817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:26.100817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:26.100817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:26.100817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:26.100817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:26.100817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:26.100817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:26.100817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:26.100817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:26.100817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:26.100817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:26.101734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:26.101734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:26.101734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:26.101734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:26.101734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:26.101734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:26.101734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:26.101734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:26.101734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:26.101734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:26.101734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:26.101734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:26.101734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:26.101734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:26.101734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:26.101734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:26.103646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:26.103646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:26.103646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:26.103646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:26.103646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:26.103646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:26.103646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:26.103646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:26.103646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:26.103646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:26.103646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 08:19:26.103646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:26.103646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 219/434] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:26.108773 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8daf62-b9ba-4158-884f-a04fa6497300 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:26.163796 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450a421-b64a-4d24-9be8-c13fe52bc61d None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:26.164361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450a421-b64a-4d24-9be8-c13fe52bc61d None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:26.167835 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450a421-b64a-4d24-9be8-c13fe52bc61d None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:26.167835 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 220/435] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:19:26.170090 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c878a-12f8-4a09-8b19-e42905045b9d None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:26.170370 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c878a-12f8-4a09-8b19-e42905045b9d None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:26.170641 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c878a-12f8-4a09-8b19-e42905045b9d None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:26.172263 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 221/436] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:26.173645 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5b635-1093-4d10-bb5b-be8bf29bbf8f None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:26.173925 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5b635-1093-4d10-bb5b-be8bf29bbf8f None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:26.174194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5b635-1093-4d10-bb5b-be8bf29bbf8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:26.194637 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-4ae5b635-1093-4d10-bb5b-be8bf29bbf8f None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:26.195821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4ae5b635-1093-4d10-bb5b-be8bf29bbf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:26.225594 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8daf62-b9ba-4158-884f-a04fa6497300 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:26.275812 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8335f-28bc-4cf8-8b75-e26e9e517917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:26.277284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8335f-28bc-4cf8-8b75-e26e9e517917 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:26.277878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8335f-28bc-4cf8-8b75-e26e9e517917 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:26.278404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8335f-28bc-4cf8-8b75-e26e9e517917 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:26.279211 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8335f-28bc-4cf8-8b75-e26e9e517917 None admin] RBAC: Adding query filter params (name=member) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:26.279552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8335f-28bc-4cf8-8b75-e26e9e517917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:26.280960 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8335f-28bc-4cf8-8b75-e26e9e517917 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:26.285440 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 222/437] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:26.287636 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7bb0c-f540-497c-912f-487859ba098b None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:26.288270 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7bb0c-f540-497c-912f-487859ba098b None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:26.288805 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7bb0c-f540-497c-912f-487859ba098b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:26.290684 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 216/438] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:19:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:26.296846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8335f-28bc-4cf8-8b75-e26e9e517917 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:26.311559 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-0ae7bb0c-f540-497c-912f-487859ba098b None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:26.314764 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-0ae7bb0c-f540-497c-912f-487859ba098b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:26.316532 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:26.400471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 223/439] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:26.400776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7bb0c-f540-497c-912f-487859ba098b None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:26.421995 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8335f-28bc-4cf8-8b75-e26e9e517917 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:26.458319 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fed810-994a-4fe8-87b8-89949acc039e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:26.458956 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fed810-994a-4fe8-87b8-89949acc039e None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:26.459233 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fed810-994a-4fe8-87b8-89949acc039e None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:26.459504 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fed810-994a-4fe8-87b8-89949acc039e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:26.462460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:26.507175 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7bb0c-f540-497c-912f-487859ba098b None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:26.524455 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fed810-994a-4fe8-87b8-89949acc039e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:26.525947 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fed810-994a-4fe8-87b8-89949acc039e None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:26.539336 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:26.541242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42caf14b-9b64-456a-9787-82556e9fded2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:26.542082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42caf14b-9b64-456a-9787-82556e9fded2 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:26.542370 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42caf14b-9b64-456a-9787-82556e9fded2 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:26.542651 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42caf14b-9b64-456a-9787-82556e9fded2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:26.553460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42caf14b-9b64-456a-9787-82556e9fded2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:26.561792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-42caf14b-9b64-456a-9787-82556e9fded2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:19:26.561792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:26.561792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:26.561792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:26.561792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:26.561792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:26.561792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:26.561792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:26.561792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:26.561792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:26.561792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:26.561792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:26.561792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:26.561792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:26.561792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:26.561792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:26.562682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:26.562682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:26.562682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:26.562682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:26.562682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:26.562682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:26.562682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:26.562682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:26.562682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:26.562682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:26.562682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:26.562682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:26.562682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:26.562682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:26.562682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:26.562682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:26.563690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:26.563690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:26.563690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:26.563690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:26.563690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:26.563690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:26.563690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:26.563690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:26.563690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:26.563690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:26.563690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:19:26.563690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:26.563690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 224/440] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:19:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:26.564971 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42caf14b-9b64-456a-9787-82556e9fded2 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:26.623477 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 217/441] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:19:26.624308 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fed810-994a-4fe8-87b8-89949acc039e None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:26.668864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42caf14b-9b64-456a-9787-82556e9fded2 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:26.682172 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:26.701796 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7230f6-77d5-42df-aa20-149a425ec381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:26.702578 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7230f6-77d5-42df-aa20-149a425ec381 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:26.702863 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7230f6-77d5-42df-aa20-149a425ec381 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:26.703140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7230f6-77d5-42df-aa20-149a425ec381 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:26.714086 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7230f6-77d5-42df-aa20-149a425ec381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:26.722463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-2d7230f6-77d5-42df-aa20-149a425ec381 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:19:26.722463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:26.722463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:26.722463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:26.722463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:26.722463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:26.722463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:26.722463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:26.722463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:26.722463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:26.722463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:26.722463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:26.722463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:26.722463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:26.722463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:26.722463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:26.723346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:26.723346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:26.723346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:26.723346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:26.723346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:26.723346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:26.723346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:26.723346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:26.723346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:26.723346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:26.723346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:26.723346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:26.723346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:26.723346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:26.723346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:26.723346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:26.724145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:26.724145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:26.724145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:26.724145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:26.724145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:26.724145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:26.724145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:26.724145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:26.724145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:26.724145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:26.724145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:19:26.724145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:26.724145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 225/442] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:19:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:26.725406 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7230f6-77d5-42df-aa20-149a425ec381 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:26.725483 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fed810-994a-4fe8-87b8-89949acc039e None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:26.744230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:26.765532 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460684f0-fe4f-4a08-a592-d772e8b93b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:26.766212 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460684f0-fe4f-4a08-a592-d772e8b93b67 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:26.766494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460684f0-fe4f-4a08-a592-d772e8b93b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:26.766768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460684f0-fe4f-4a08-a592-d772e8b93b67 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:26.767526 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460684f0-fe4f-4a08-a592-d772e8b93b67 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:26.767886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460684f0-fe4f-4a08-a592-d772e8b93b67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:26.769254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460684f0-fe4f-4a08-a592-d772e8b93b67 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:26.777337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 218/443] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:26.778627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460684f0-fe4f-4a08-a592-d772e8b93b67 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:26.826890 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7230f6-77d5-42df-aa20-149a425ec381 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:26.860657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59c2c0-3efb-4157-be2e-134ae0e1071f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:26.861508 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59c2c0-3efb-4157-be2e-134ae0e1071f None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:26.861815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59c2c0-3efb-4157-be2e-134ae0e1071f None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:26.862089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59c2c0-3efb-4157-be2e-134ae0e1071f None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:26.863258 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59c2c0-3efb-4157-be2e-134ae0e1071f None admin] RBAC: Authorizing `identity:get_project(project_id=f5e21a6b8db94073b1c84a6d986af044)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:26.864727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59c2c0-3efb-4157-be2e-134ae0e1071f None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:26.866441 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 226/444] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:26 2022] GET /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:26.867194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59c2c0-3efb-4157-be2e-134ae0e1071f None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:26.877868 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460684f0-fe4f-4a08-a592-d772e8b93b67 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:26.910900 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae66aaa-e8fd-457e-b654-1c57f20ded73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:26.911554 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae66aaa-e8fd-457e-b654-1c57f20ded73 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:26.911839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae66aaa-e8fd-457e-b654-1c57f20ded73 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:26.912113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae66aaa-e8fd-457e-b654-1c57f20ded73 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:26.912204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:26.912856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae66aaa-e8fd-457e-b654-1c57f20ded73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:26.913179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae66aaa-e8fd-457e-b654-1c57f20ded73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:26.914563 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae66aaa-e8fd-457e-b654-1c57f20ded73 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:26.922509 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 219/445] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:26.927239 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae66aaa-e8fd-457e-b654-1c57f20ded73 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:26.959272 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:26.969402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59c2c0-3efb-4157-be2e-134ae0e1071f None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:27.003628 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56001afe-e0ef-4418-b38e-32eaff849191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:27.004260 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56001afe-e0ef-4418-b38e-32eaff849191 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:27.004609 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56001afe-e0ef-4418-b38e-32eaff849191 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:27.004813 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56001afe-e0ef-4418-b38e-32eaff849191 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:27.023745 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae66aaa-e8fd-457e-b654-1c57f20ded73 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:27.056302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005830f0-8237-465b-9025-7708a0f5639d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:27.057136 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005830f0-8237-465b-9025-7708a0f5639d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:27.057419 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005830f0-8237-465b-9025-7708a0f5639d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:27.057727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005830f0-8237-465b-9025-7708a0f5639d None admin] PATH_INFO: `/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:27.059538 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005830f0-8237-465b-9025-7708a0f5639d None admin] RBAC: Authorizing `identity:get_group(group_id=b12e5815a0064aa7b7d3b2baac0ce7b1)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:27.060974 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005830f0-8237-465b-9025-7708a0f5639d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:27.062620 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 220/446] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 08:19:26 2022] GET /identity/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:27.063370 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005830f0-8237-465b-9025-7708a0f5639d None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:27.071850 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56001afe-e0ef-4418-b38e-32eaff849191 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:27.073325 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56001afe-e0ef-4418-b38e-32eaff849191 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:27.116245 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:27.162076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005830f0-8237-465b-9025-7708a0f5639d None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:27.164453 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:27.172603 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 227/447] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:19:27.173427 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56001afe-e0ef-4418-b38e-32eaff849191 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:27.200602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677271d-8bf7-4350-b5d9-fbf85c687bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:27.201242 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677271d-8bf7-4350-b5d9-fbf85c687bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:27.201535 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677271d-8bf7-4350-b5d9-fbf85c687bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:27.201825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677271d-8bf7-4350-b5d9-fbf85c687bc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:27.267835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677271d-8bf7-4350-b5d9-fbf85c687bc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:27.269243 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677271d-8bf7-4350-b5d9-fbf85c687bc7 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:27.270062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56001afe-e0ef-4418-b38e-32eaff849191 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:27.305273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94252549-ce50-4e41-a354-b3835cfb8236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:27.305947 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94252549-ce50-4e41-a354-b3835cfb8236 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:27.306232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94252549-ce50-4e41-a354-b3835cfb8236 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:27.306513 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94252549-ce50-4e41-a354-b3835cfb8236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:27.307335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94252549-ce50-4e41-a354-b3835cfb8236 None admin] RBAC: Adding query filter params (group.id=b12e5815a0064aa7b7d3b2baac0ce7b1, role.id=80c590b37af34bca8dee5f7c87a38999, scope.project.id=f5e21a6b8db94073b1c84a6d986af044) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:27.307651 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94252549-ce50-4e41-a354-b3835cfb8236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:27.309124 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94252549-ce50-4e41-a354-b3835cfb8236 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:27.314865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 228/448] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Jul 21 08:19:27 2022] GET /identity/v3/role_assignments?group.id=b12e5815a0064aa7b7d3b2baac0ce7b1&scope.project.id=f5e21a6b8db94073b1c84a6d986af044&role.id=80c590b37af34bca8dee5f7c87a38999 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:27.315619 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94252549-ce50-4e41-a354-b3835cfb8236 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:27.338210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:27.386226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 221/449] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:19:27.387571 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677271d-8bf7-4350-b5d9-fbf85c687bc7 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:27.390992 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:27.447191 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94252549-ce50-4e41-a354-b3835cfb8236 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:27.490338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7419881-952c-416d-aa12-8de253e8cc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:27.491209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7419881-952c-416d-aa12-8de253e8cc1d None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:27.491495 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7419881-952c-416d-aa12-8de253e8cc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:27.491774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7419881-952c-416d-aa12-8de253e8cc1d None admin] PATH_INFO: `/v3/projects/f5e21a6b8db94073b1c84a6d986af044` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:27.493854 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7419881-952c-416d-aa12-8de253e8cc1d None admin] RBAC: Authorizing `identity:get_project(project_id=f5e21a6b8db94073b1c84a6d986af044)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:27.495302 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7419881-952c-416d-aa12-8de253e8cc1d None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:27.501560 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 229/450] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:27 2022] GET /identity/v3/projects/f5e21a6b8db94073b1c84a6d986af044 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:27.503433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7419881-952c-416d-aa12-8de253e8cc1d None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:27.505776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677271d-8bf7-4350-b5d9-fbf85c687bc7 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:27.545473 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4319b-e418-45b3-8a70-6d4822e751cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:27.546300 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4319b-e418-45b3-8a70-6d4822e751cc None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:27.546604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4319b-e418-45b3-8a70-6d4822e751cc None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:27.546934 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4319b-e418-45b3-8a70-6d4822e751cc None admin] PATH_INFO: `/v3/projects/735f219fa6204590a96733afe606902c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:27.548274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4319b-e418-45b3-8a70-6d4822e751cc None admin] RBAC: Authorizing `identity:get_project(project_id=735f219fa6204590a96733afe606902c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:27.550383 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4319b-e418-45b3-8a70-6d4822e751cc None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:27.553490 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 222/451] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:19:27 2022] GET /identity/v3/projects/735f219fa6204590a96733afe606902c => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:27.557666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4319b-e418-45b3-8a70-6d4822e751cc None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:27.596472 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:27.624992 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7419881-952c-416d-aa12-8de253e8cc1d None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:27.644396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:27.665600 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a005c-a3d6-401f-9ceb-75d3c39f15a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:27.665600 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a005c-a3d6-401f-9ceb-75d3c39f15a9 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:27.665885 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a005c-a3d6-401f-9ceb-75d3c39f15a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:27.665970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a005c-a3d6-401f-9ceb-75d3c39f15a9 None admin] PATH_INFO: `/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:27.667760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a005c-a3d6-401f-9ceb-75d3c39f15a9 None admin] RBAC: Authorizing `identity:get_group(group_id=b12e5815a0064aa7b7d3b2baac0ce7b1)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:27.669708 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a005c-a3d6-401f-9ceb-75d3c39f15a9 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:27.671378 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 230/452] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 08:19:27 2022] GET /identity/v3/groups/b12e5815a0064aa7b7d3b2baac0ce7b1 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:27.677153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a005c-a3d6-401f-9ceb-75d3c39f15a9 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:27.682941 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4319b-e418-45b3-8a70-6d4822e751cc None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:27.716941 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f80693-fa3b-4bbd-842c-91dd55aee34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:27.717828 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f80693-fa3b-4bbd-842c-91dd55aee34c None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:27.718108 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f80693-fa3b-4bbd-842c-91dd55aee34c None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:27.718382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f80693-fa3b-4bbd-842c-91dd55aee34c None admin] PATH_INFO: `/v3/groups/c51d1fe45afb495b86325b553d740edb` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:27.719564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f80693-fa3b-4bbd-842c-91dd55aee34c None admin] RBAC: Authorizing `identity:get_group(group_id=c51d1fe45afb495b86325b553d740edb)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:27.721003 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f80693-fa3b-4bbd-842c-91dd55aee34c None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:27.722644 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 223/453] 10.222.0.57 () {56 vars in 1180 bytes} [Thu Jul 21 08:19:27 2022] GET /identity/v3/groups/c51d1fe45afb495b86325b553d740edb => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:27.728664 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f80693-fa3b-4bbd-842c-91dd55aee34c None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:27.782283 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a005c-a3d6-401f-9ceb-75d3c39f15a9 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:27.816191 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96eff06-c6b2-4bf2-b12b-7db39b66dbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:27.816922 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96eff06-c6b2-4bf2-b12b-7db39b66dbbf None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:27.817093 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96eff06-c6b2-4bf2-b12b-7db39b66dbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:27.817331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96eff06-c6b2-4bf2-b12b-7db39b66dbbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:27.818188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96eff06-c6b2-4bf2-b12b-7db39b66dbbf None admin] RBAC: Adding query filter params (group.id=b12e5815a0064aa7b7d3b2baac0ce7b1, role.id=f6c74bb34f9c4b0faaf6a21007abcaa5, scope.project.id=f5e21a6b8db94073b1c84a6d986af044) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:27.818506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96eff06-c6b2-4bf2-b12b-7db39b66dbbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:27.819932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96eff06-c6b2-4bf2-b12b-7db39b66dbbf None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:27.825851 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 231/454] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Jul 21 08:19:27 2022] GET /identity/v3/role_assignments?group.id=b12e5815a0064aa7b7d3b2baac0ce7b1&scope.project.id=f5e21a6b8db94073b1c84a6d986af044&role.id=f6c74bb34f9c4b0faaf6a21007abcaa5 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:27.829498 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f80693-fa3b-4bbd-842c-91dd55aee34c None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:27.867549 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf155604-3ef2-4f14-a85a-0e354094a48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:27.868209 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf155604-3ef2-4f14-a85a-0e354094a48c None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:27.868492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf155604-3ef2-4f14-a85a-0e354094a48c None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:27.868764 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf155604-3ef2-4f14-a85a-0e354094a48c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:27.869643 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf155604-3ef2-4f14-a85a-0e354094a48c None admin] RBAC: Adding query filter params (group.id=c51d1fe45afb495b86325b553d740edb, role.id=beed8caad097496292e544146859df5c, scope.project.id=735f219fa6204590a96733afe606902c) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:27.869958 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf155604-3ef2-4f14-a85a-0e354094a48c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:27.871481 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf155604-3ef2-4f14-a85a-0e354094a48c None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:27.878226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 224/455] 10.222.0.57 () {56 vars in 1376 bytes} [Thu Jul 21 08:19:27 2022] GET /identity/v3/role_assignments?group.id=c51d1fe45afb495b86325b553d740edb&scope.project.id=735f219fa6204590a96733afe606902c&role.id=beed8caad097496292e544146859df5c => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:30.503315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7a960-1673-48d4-8846-342c40681302 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:30.503836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7a960-1673-48d4-8846-342c40681302 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:30.503940 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7a960-1673-48d4-8846-342c40681302 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:30.505502 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 232/456] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:30.510563 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad30bab-3f64-4d0c-b0d1-5191295d04f1 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:30.510946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad30bab-3f64-4d0c-b0d1-5191295d04f1 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:30.511121 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad30bab-3f64-4d0c-b0d1-5191295d04f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:30.517183 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:30.528874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-bad30bab-3f64-4d0c-b0d1-5191295d04f1 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:30.530091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-bad30bab-3f64-4d0c-b0d1-5191295d04f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:30.539606 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740b387-63d3-44d0-a63f-af4d8d3c754f None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:30.539907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740b387-63d3-44d0-a63f-af4d8d3c754f None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:30.540190 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740b387-63d3-44d0-a63f-af4d8d3c754f None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:30.541703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 233/457] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:30.548213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3a44d-b09d-499b-8779-be17509f66fc None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:30.548509 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3a44d-b09d-499b-8779-be17509f66fc None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:30.548793 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3a44d-b09d-499b-8779-be17509f66fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:30.569693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:30.582863 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-b5c3a44d-b09d-499b-8779-be17509f66fc None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:30.587031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b5c3a44d-b09d-499b-8779-be17509f66fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:30.634219 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 225/458] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:30.677234 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 234/459] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:30.686858 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad30bab-3f64-4d0c-b0d1-5191295d04f1 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:30.754973 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3a44d-b09d-499b-8779-be17509f66fc None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:30.854298 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad30bab-3f64-4d0c-b0d1-5191295d04f1 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:30.920020 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774be50-967a-41d2-a8e7-f6749fe6545c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:30.920818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774be50-967a-41d2-a8e7-f6749fe6545c None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:30.921096 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774be50-967a-41d2-a8e7-f6749fe6545c None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:30.921365 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774be50-967a-41d2-a8e7-f6749fe6545c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:30.923648 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:30.927737 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3a44d-b09d-499b-8779-be17509f66fc None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:30.933288 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774be50-967a-41d2-a8e7-f6749fe6545c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:30.934816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774be50-967a-41d2-a8e7-f6749fe6545c None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:30.954191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-a774be50-967a-41d2-a8e7-f6749fe6545c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:30.954191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:30.954191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:30.954191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:30.954191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:30.954191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:30.954191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:30.954191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:30.954191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:30.954191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:30.954191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:30.954191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:30.954191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:30.954191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:30.954191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:30.955091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:30.955091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:30.955091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:30.955091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:30.955091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:30.955091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:30.955091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:30.955091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:30.955091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:30.955091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:30.955091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:30.955091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:30.955091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:30.955091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:30.955091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:30.955091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:30.955091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:30.955916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:30.955916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:30.955916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:30.955916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:30.955916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 226/460] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:30.957166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eda30-9b0b-49af-a31d-e73be11ba2db None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:30.957462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eda30-9b0b-49af-a31d-e73be11ba2db None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:30.957769 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eda30-9b0b-49af-a31d-e73be11ba2db None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:30.963107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 227/461] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:30.963988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51eda30-9b0b-49af-a31d-e73be11ba2db None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:30.972782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847508ca-0bfb-4479-9e15-7b20c5622410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:30.974015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847508ca-0bfb-4479-9e15-7b20c5622410 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:30.974299 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847508ca-0bfb-4479-9e15-7b20c5622410 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:30.974576 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847508ca-0bfb-4479-9e15-7b20c5622410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:30.978569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:30.988992 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847508ca-0bfb-4479-9e15-7b20c5622410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:30.990805 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847508ca-0bfb-4479-9e15-7b20c5622410 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:31.014309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-847508ca-0bfb-4479-9e15-7b20c5622410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:31.014309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:31.014309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:31.014309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:31.014309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:31.014309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:31.014309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:31.014309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:31.014309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:31.014309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:31.014309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:31.014309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:31.014309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:31.014309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:31.014309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:31.015237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:31.015237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:31.015237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:31.015237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:31.015237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:31.015237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:31.015237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:31.015237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:31.015237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:31.015237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:31.015237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:31.015237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:31.015237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:31.015237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:31.015237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:31.015237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:31.015237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:31.016062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:31.016062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:31.016062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:31.016062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:31.017788 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 235/462] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:19:31.019084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc0e42-ba01-427d-86c7-056e6d7f5fb2 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:31.019377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc0e42-ba01-427d-86c7-056e6d7f5fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:31.019656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc0e42-ba01-427d-86c7-056e6d7f5fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:31.046785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-3fdc0e42-ba01-427d-86c7-056e6d7f5fb2 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:31.048305 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-3fdc0e42-ba01-427d-86c7-056e6d7f5fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:31.084068 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51eda30-9b0b-49af-a31d-e73be11ba2db None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:31.116723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 236/463] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:31.117878 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc0e42-ba01-427d-86c7-056e6d7f5fb2 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:31.133159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4f096-403e-4522-a8b5-e31155a24c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:31.133858 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4f096-403e-4522-a8b5-e31155a24c4a None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:31.134144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4f096-403e-4522-a8b5-e31155a24c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:31.134417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4f096-403e-4522-a8b5-e31155a24c4a None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:31.135311 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4f096-403e-4522-a8b5-e31155a24c4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:31.135793 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4f096-403e-4522-a8b5-e31155a24c4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:31.137621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4f096-403e-4522-a8b5-e31155a24c4a None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:31.162753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 228/464] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:31.163928 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4f096-403e-4522-a8b5-e31155a24c4a None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:31.214788 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:31.219656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc0e42-ba01-427d-86c7-056e6d7f5fb2 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:31.242033 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:31.255109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea7d8c-c147-4758-894b-35f76041ce7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:31.255886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea7d8c-c147-4758-894b-35f76041ce7e None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:31.256279 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea7d8c-c147-4758-894b-35f76041ce7e None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:31.256767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea7d8c-c147-4758-894b-35f76041ce7e None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:31.257722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea7d8c-c147-4758-894b-35f76041ce7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:31.258237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea7d8c-c147-4758-894b-35f76041ce7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:31.259793 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea7d8c-c147-4758-894b-35f76041ce7e None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:31.271412 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4f096-403e-4522-a8b5-e31155a24c4a None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:31.272255 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 237/465] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:31.273199 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea7d8c-c147-4758-894b-35f76041ce7e None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:31.308478 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e36ee-817b-4699-be8f-ece124d8888f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:31.309142 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e36ee-817b-4699-be8f-ece124d8888f None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:31.309439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e36ee-817b-4699-be8f-ece124d8888f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:31.309719 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e36ee-817b-4699-be8f-ece124d8888f None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:31.310808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e36ee-817b-4699-be8f-ece124d8888f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:31.311849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e36ee-817b-4699-be8f-ece124d8888f None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:31.376037 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea7d8c-c147-4758-894b-35f76041ce7e None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:31.411627 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74d4f5-3cdc-4ead-9c3b-585513e3ab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:31.412428 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74d4f5-3cdc-4ead-9c3b-585513e3ab69 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:31.412710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74d4f5-3cdc-4ead-9c3b-585513e3ab69 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:31.412985 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74d4f5-3cdc-4ead-9c3b-585513e3ab69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:31.421565 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 229/466] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 08:19:31 2022] POST /identity/v3/users => generated 248 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:19:31.425449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74d4f5-3cdc-4ead-9c3b-585513e3ab69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:31.426965 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74d4f5-3cdc-4ead-9c3b-585513e3ab69 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:31.431280 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b03aa7-915a-4f04-90bd-2960b1f00243 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:31.431719 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b03aa7-915a-4f04-90bd-2960b1f00243 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:31.432091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b03aa7-915a-4f04-90bd-2960b1f00243 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:31.434049 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 230/467] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:31.434944 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b03aa7-915a-4f04-90bd-2960b1f00243 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:31.453494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-9c74d4f5-3cdc-4ead-9c3b-585513e3ab69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:31.453494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:31.453494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:31.453494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:31.453494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:31.453494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:31.453494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:31.453494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:31.453494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:31.453494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:31.453494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:31.453494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:31.453494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:31.453494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:31.453494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:31.454624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:31.454624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:31.454624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:31.454624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:31.454624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:31.454624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:31.454624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:31.454624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:31.454624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:31.454624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:31.454624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:31.454624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:31.454624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:31.454624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:31.454624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:31.454624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:31.454624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:31.455678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:31.455678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:31.455678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:31.455678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:31.462536 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 238/468] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:31.464682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f4b66-3ec8-43a0-ba3d-391c4cd2b2e7 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:31.465799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f4b66-3ec8-43a0-ba3d-391c4cd2b2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:31.466263 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f4b66-3ec8-43a0-ba3d-391c4cd2b2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:31.485145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-278f4b66-3ec8-43a0-ba3d-391c4cd2b2e7 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:31.486691 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-278f4b66-3ec8-43a0-ba3d-391c4cd2b2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:31.518036 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:31.573908 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 239/469] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:31.575720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f4b66-3ec8-43a0-ba3d-391c4cd2b2e7 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:31.581836 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b03aa7-915a-4f04-90bd-2960b1f00243 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:31.583574 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:31.624680 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5fdbf-24d6-4b0b-ba06-717fe9b5ed5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:31.625350 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5fdbf-24d6-4b0b-ba06-717fe9b5ed5c None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:31.627079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5fdbf-24d6-4b0b-ba06-717fe9b5ed5c None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:31.627079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5fdbf-24d6-4b0b-ba06-717fe9b5ed5c None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:31.627327 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5fdbf-24d6-4b0b-ba06-717fe9b5ed5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:31.630006 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5fdbf-24d6-4b0b-ba06-717fe9b5ed5c None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:31.695666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f4b66-3ec8-43a0-ba3d-391c4cd2b2e7 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:31.736091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 231/470] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 08:19:31 2022] POST /identity/v3/users => generated 246 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:19:31.736386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efa0fd-d415-4965-a4df-525935e91c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:31.737453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efa0fd-d415-4965-a4df-525935e91c0a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:31.737861 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5fdbf-24d6-4b0b-ba06-717fe9b5ed5c None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:31.737966 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efa0fd-d415-4965-a4df-525935e91c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:31.738384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efa0fd-d415-4965-a4df-525935e91c0a None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:31.742199 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efa0fd-d415-4965-a4df-525935e91c0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:31.742199 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efa0fd-d415-4965-a4df-525935e91c0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:31.743095 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efa0fd-d415-4965-a4df-525935e91c0a None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:31.765620 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 240/471] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:31.767367 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc5bb7-5374-49dd-bfb3-b96c61ea6ba3 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:31.767658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc5bb7-5374-49dd-bfb3-b96c61ea6ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:31.767938 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc5bb7-5374-49dd-bfb3-b96c61ea6ba3 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:31.769929 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 241/472] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:31.771255 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc5bb7-5374-49dd-bfb3-b96c61ea6ba3 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:31.804381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:31.870644 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5fdbf-24d6-4b0b-ba06-717fe9b5ed5c None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:31.912744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e44841-2c7d-46df-883e-36431a04a03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:31.913556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e44841-2c7d-46df-883e-36431a04a03f None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:31.913944 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e44841-2c7d-46df-883e-36431a04a03f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:31.914215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e44841-2c7d-46df-883e-36431a04a03f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:31.921996 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc5bb7-5374-49dd-bfb3-b96c61ea6ba3 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:31.935411 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e44841-2c7d-46df-883e-36431a04a03f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:31.937293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e44841-2c7d-46df-883e-36431a04a03f None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:31.959755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-f9e44841-2c7d-46df-883e-36431a04a03f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:31.959755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:31.959755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:31.959755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:31.959755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:31.959755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:31.959755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:31.959755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:31.959755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:31.959755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:31.959755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:31.959755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:31.959755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:31.959755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:31.959755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:31.960658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:31.960658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:31.960658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:31.960658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:31.960658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:31.960658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:31.960658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:31.960658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:31.960658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:31.960658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:31.960658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:31.960658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:31.960658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:31.960658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:31.960658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:31.960658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:31.960658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:31.961561 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:31.961561 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:31.961561 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:31.961561 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:31.963849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 232/473] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:31.965446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94c52f-735a-4131-8a07-7f617655cdc8 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:31.965864 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94c52f-735a-4131-8a07-7f617655cdc8 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:31.966224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94c52f-735a-4131-8a07-7f617655cdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:31.969556 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5cc5f-44ab-40db-8464-546fb2bf063d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:31.970404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5cc5f-44ab-40db-8464-546fb2bf063d None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:31.970690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5cc5f-44ab-40db-8464-546fb2bf063d None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:31.970967 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5cc5f-44ab-40db-8464-546fb2bf063d None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:31.971665 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5cc5f-44ab-40db-8464-546fb2bf063d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:31.974254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5cc5f-44ab-40db-8464-546fb2bf063d None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:31.984312 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-9c94c52f-735a-4131-8a07-7f617655cdc8 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:31.985461 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9c94c52f-735a-4131-8a07-7f617655cdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:31.988702 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:32.055422 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 233/474] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:32.056331 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94c52f-735a-4131-8a07-7f617655cdc8 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:32.075068 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 242/475] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 08:19:31 2022] POST /identity/v3/users => generated 248 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:19:32.086070 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5cc5f-44ab-40db-8464-546fb2bf063d None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:32.192498 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:32.220533 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5cc5f-44ab-40db-8464-546fb2bf063d None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:32.264847 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d6dcb-dbe3-43ff-9d05-96b18d3b631b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:32.265624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d6dcb-dbe3-43ff-9d05-96b18d3b631b None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:32.265915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d6dcb-dbe3-43ff-9d05-96b18d3b631b None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:32.266195 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d6dcb-dbe3-43ff-9d05-96b18d3b631b None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:32.267200 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d6dcb-dbe3-43ff-9d05-96b18d3b631b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:32.268827 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d6dcb-dbe3-43ff-9d05-96b18d3b631b None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:32.271024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94c52f-735a-4131-8a07-7f617655cdc8 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:32.304912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.sql.core [None req-b29d6dcb-dbe3-43ff-9d05-96b18d3b631b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 08:19:32.304912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 08:19:32.304912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [parameters: {'id': 'bf442812ca264681a4f7330de6f8e387', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 08:19:32.304912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80262) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 08:19:32.320997 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a17b1-d4fc-4d28-b38c-ca138d9de845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:32.321712 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a17b1-d4fc-4d28-b38c-ca138d9de845 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:32.322001 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a17b1-d4fc-4d28-b38c-ca138d9de845 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:32.322332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a17b1-d4fc-4d28-b38c-ca138d9de845 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:32.323083 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a17b1-d4fc-4d28-b38c-ca138d9de845 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:32.323404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a17b1-d4fc-4d28-b38c-ca138d9de845 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:32.324917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a17b1-d4fc-4d28-b38c-ca138d9de845 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:32.330153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-b29d6dcb-dbe3-43ff-9d05-96b18d3b631b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 08:19:32.330153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:32.330153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 08:19:32.330153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 08:19:32.330153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 08:19:32.330153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 08:19:32.330153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 08:19:32.330153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 08:19:32.330153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 08:19:32.330153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application conn.query(q) Jul 21 08:19:32.330153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 08:19:32.330153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 08:19:32.330153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 08:19:32.330153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application result.read() Jul 21 08:19:32.330153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 08:19:32.331051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 08:19:32.331051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 08:19:32.331051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 08:19:32.331051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 08:19:32.331051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 08:19:32.331051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 08:19:32.331051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 08:19:32.331051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 08:19:32.331051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:32.331051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 08:19:32.331051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:32.331051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:32.331051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 08:19:32.331051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 08:19:32.331051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 21 08:19:32.331051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return ref.to_dict() Jul 21 08:19:32.331051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 08:19:32.331051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application next(self.gen) Jul 21 08:19:32.331979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 08:19:32.331979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application yield resource Jul 21 08:19:32.331979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 08:19:32.331979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application next(self.gen) Jul 21 08:19:32.331979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 08:19:32.331979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 08:19:32.331979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 08:19:32.331979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 08:19:32.331979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 08:19:32.331979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise self.value Jul 21 08:19:32.331979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 08:19:32.331979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 08:19:32.331979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 08:19:32.331979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application session.commit() Jul 21 08:19:32.331979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 08:19:32.331979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 08:19:32.331979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 08:19:32.332880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 08:19:32.332880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 08:19:32.332880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self.session.flush() Jul 21 08:19:32.332880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 08:19:32.332880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 08:19:32.332880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 08:19:32.332880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 08:19:32.332880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 08:19:32.332880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application compat.raise_( Jul 21 08:19:32.332880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 08:19:32.332880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception Jul 21 08:19:32.332880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 08:19:32.332880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 08:19:32.332880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 08:19:32.332880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 08:19:32.332880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 08:19:32.332880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 08:19:32.336293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 08:19:32.336293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 08:19:32.336293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 08:19:32.336293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 08:19:32.336293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 08:19:32.336293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 08:19:32.336293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 08:19:32.336293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 08:19:32.336293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 08:19:32.336293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 08:19:32.336293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 08:19:32.336293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 08:19:32.336293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 08:19:32.336293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 08:19:32.336293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 08:19:32.336293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception Jul 21 08:19:32.338249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 08:19:32.338249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 08:19:32.338249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 08:19:32.338249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 08:19:32.338249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 08:19:32.338249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 08:19:32.338249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 08:19:32.338249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application conn.query(q) Jul 21 08:19:32.338249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 08:19:32.338249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 08:19:32.338249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 08:19:32.338249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application result.read() Jul 21 08:19:32.338249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 08:19:32.338249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 08:19:32.338249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 08:19:32.338249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 08:19:32.341171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 08:19:32.341171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 08:19:32.341171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 08:19:32.341171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 08:19:32.341171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 08:19:32.341171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 08:19:32.341171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [parameters: {'id': 'bf442812ca264681a4f7330de6f8e387', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 08:19:32.341171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 08:19:32.341171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:32.341171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:19:32.341171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:32.341171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:32.341171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:32.341171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:32.341171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:32.341171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:32.353055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:32.353055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:32.353055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:32.353055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:32.353055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:32.353055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:32.353055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 21 08:19:32.353055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 21 08:19:32.353055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:32.353055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:32.353055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 21 08:19:32.353055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 21 08:19:32.353055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 08:19:32.353055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 08:19:32.353055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 08:19:32.353055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:32.354295 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:32.354385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 243/476] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Jul 21 08:19:32 2022] POST /identity/v3/roles => generated 144 bytes in 255 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:19:32.354470 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 234/477] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:32.354542 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d6dcb-dbe3-43ff-9d05-96b18d3b631b None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:32.354618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a17b1-d4fc-4d28-b38c-ca138d9de845 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:32.460028 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d6dcb-dbe3-43ff-9d05-96b18d3b631b None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:32.468948 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a17b1-d4fc-4d28-b38c-ca138d9de845 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:32.498141 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cc57e-e63c-475f-9248-88445627926f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:32.498948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cc57e-e63c-475f-9248-88445627926f None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:32.499228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cc57e-e63c-475f-9248-88445627926f None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:32.499503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cc57e-e63c-475f-9248-88445627926f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:32.509456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:32.510720 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f2c85-8e12-428d-805d-b61c750083f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:32.511595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f2c85-8e12-428d-805d-b61c750083f6 None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:32.512012 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f2c85-8e12-428d-805d-b61c750083f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:32.512431 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f2c85-8e12-428d-805d-b61c750083f6 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:32.512843 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355cc57e-e63c-475f-9248-88445627926f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:32.513431 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f2c85-8e12-428d-805d-b61c750083f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:32.515023 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f2c85-8e12-428d-805d-b61c750083f6 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:32.521251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-355cc57e-e63c-475f-9248-88445627926f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:19:32.521251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:32.521251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:32.521251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:32.521251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:32.521251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:32.521251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:32.521251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:32.521251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:32.521251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:32.521251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:32.521251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:32.521251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:32.521251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:32.521251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:32.521251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:32.529961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:32.529961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:32.529961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:32.529961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:32.529961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:32.529961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:32.529961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:32.529961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:32.529961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:32.529961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:32.529961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:32.529961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:32.529961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:32.529961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:32.529961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:32.529961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:32.530907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:32.530907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:32.530907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:32.530907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:32.530907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:32.530907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:32.530907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:32.530907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:32.530907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:32.530907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:32.530907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 08:19:32.530907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:32.530907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 244/478] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:19:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:19:32.530907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cc57e-e63c-475f-9248-88445627926f None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:32.622345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 235/479] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 08:19:32 2022] POST /identity/v3/users => generated 249 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:19:32.644700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cc57e-e63c-475f-9248-88445627926f None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:32.692198 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c2574-bbae-4b63-b568-cb735079e85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:32.692944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c2574-bbae-4b63-b568-cb735079e85c None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:32.693281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c2574-bbae-4b63-b568-cb735079e85c None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:32.693580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c2574-bbae-4b63-b568-cb735079e85c None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:32.694342 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c2574-bbae-4b63-b568-cb735079e85c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:32.694647 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c2574-bbae-4b63-b568-cb735079e85c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:32.696033 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c2574-bbae-4b63-b568-cb735079e85c None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:32.709413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 245/480] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:33.739206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8d92c-b774-4d47-ad57-c092ebf2beb6 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:33.739721 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8d92c-b774-4d47-ad57-c092ebf2beb6 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:33.739830 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8d92c-b774-4d47-ad57-c092ebf2beb6 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:33.741417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 236/481] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:33.747633 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e53c7-0cd9-4722-8c2b-492e12a8e432 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:33.748058 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e53c7-0cd9-4722-8c2b-492e12a8e432 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:33.748232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e53c7-0cd9-4722-8c2b-492e12a8e432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:33.771031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-643e53c7-0cd9-4722-8c2b-492e12a8e432 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:33.772243 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-643e53c7-0cd9-4722-8c2b-492e12a8e432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:33.848306 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:33.868442 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 246/482] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:33.901834 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8d92c-b774-4d47-ad57-c092ebf2beb6 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:33.962968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:34.011453 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8d92c-b774-4d47-ad57-c092ebf2beb6 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:34.046511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3825ecda-80c5-421e-b82a-46d59699fc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:34.047301 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825ecda-80c5-421e-b82a-46d59699fc7d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:34.047588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825ecda-80c5-421e-b82a-46d59699fc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:34.047864 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3825ecda-80c5-421e-b82a-46d59699fc7d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:34.059760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3825ecda-80c5-421e-b82a-46d59699fc7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:34.067472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-3825ecda-80c5-421e-b82a-46d59699fc7d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:34.067472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:34.067472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:34.067472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:34.067472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:34.067472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:34.067472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:34.067472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:34.067472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:34.067472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:34.067472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:34.067472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:34.067472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:34.067472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:34.067472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:34.067472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:34.068406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:34.068406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:34.068406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:34.068406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:34.068406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:34.068406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:34.068406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:34.068406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:34.068406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:34.068406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:34.068406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:34.068406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:34.068406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:34.068406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:34.068406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:34.068406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:34.069216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:34.069216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:34.069216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:34.069216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:34.069216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:34.069216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:34.069216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:34.069216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:34.069216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:34.069216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:34.069216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:34.069216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:34.069216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 237/483] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:19:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:34.075234 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e53c7-0cd9-4722-8c2b-492e12a8e432 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:34.186881 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4cc52-1962-4658-b222-b2f61371fa84 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:34.187206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4cc52-1962-4658-b222-b2f61371fa84 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:34.187445 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4cc52-1962-4658-b222-b2f61371fa84 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:34.189304 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 238/484] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:34.194680 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6d5fe-54ce-42ab-87e1-6f705cc3f2c5 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:34.194969 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6d5fe-54ce-42ab-87e1-6f705cc3f2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:34.195253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6d5fe-54ce-42ab-87e1-6f705cc3f2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:34.207939 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e53c7-0cd9-4722-8c2b-492e12a8e432 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:34.214307 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-c9d6d5fe-54ce-42ab-87e1-6f705cc3f2c5 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:34.216198 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c9d6d5fe-54ce-42ab-87e1-6f705cc3f2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:34.283660 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f8884-ff91-4de3-883a-0185f4eba7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:34.284252 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f8884-ff91-4de3-883a-0185f4eba7dd None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:34.284530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f8884-ff91-4de3-883a-0185f4eba7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:34.284804 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f8884-ff91-4de3-883a-0185f4eba7dd None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:34.285564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f8884-ff91-4de3-883a-0185f4eba7dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:34.285873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f8884-ff91-4de3-883a-0185f4eba7dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:34.287243 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f8884-ff91-4de3-883a-0185f4eba7dd None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:34.289567 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 239/485] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:19:34.304738 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 247/486] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:19:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:34.309954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6d5fe-54ce-42ab-87e1-6f705cc3f2c5 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:34.330966 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f8884-ff91-4de3-883a-0185f4eba7dd None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:34.400152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:34.445885 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:34.500650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6d5fe-54ce-42ab-87e1-6f705cc3f2c5 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:34.524242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f8884-ff91-4de3-883a-0185f4eba7dd None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:34.566907 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc767c63-c104-4ec2-ab6a-f6a218a2ce56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:34.567638 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc767c63-c104-4ec2-ab6a-f6a218a2ce56 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:34.567918 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc767c63-c104-4ec2-ab6a-f6a218a2ce56 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:34.568189 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc767c63-c104-4ec2-ab6a-f6a218a2ce56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:34.579639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc767c63-c104-4ec2-ab6a-f6a218a2ce56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:34.581111 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc767c63-c104-4ec2-ab6a-f6a218a2ce56 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:34.598245 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6aa3e-ac7b-4bdd-869d-6674c4d0538a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:34.599055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6aa3e-ac7b-4bdd-869d-6674c4d0538a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:34.599338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6aa3e-ac7b-4bdd-869d-6674c4d0538a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:34.599617 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6aa3e-ac7b-4bdd-869d-6674c4d0538a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:34.600512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-bc767c63-c104-4ec2-ab6a-f6a218a2ce56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:34.600512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:34.600512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:34.600512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:34.600512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:34.600512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:34.600512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:34.600512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:34.600512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:34.600512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:34.600512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:34.600512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:34.600512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:34.600512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:34.600512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:34.602731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:34.602731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:34.602731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:34.602731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:34.602731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:34.602731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:34.602731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:34.602731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:34.602731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:34.602731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:34.602731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:34.602731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:34.602731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:34.602731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:34.602731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:34.602731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:34.602731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:34.604818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:34.604818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:34.604818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:34.604818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:34.604818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 240/487] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:34.609547 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc767c63-c104-4ec2-ab6a-f6a218a2ce56 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:34.630252 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6aa3e-ac7b-4bdd-869d-6674c4d0538a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:34.638156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-efe6aa3e-ac7b-4bdd-869d-6674c4d0538a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:34.638156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:34.638156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:34.638156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:34.638156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:34.638156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:34.638156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:34.638156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:34.638156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:34.638156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:34.638156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:34.638156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:34.638156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:34.638156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:34.638156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:34.638156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:34.640339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:34.640339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:34.640339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:34.640339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:34.640339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:34.640339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:34.640339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:34.640339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:34.640339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:34.640339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:34.640339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:34.640339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:34.640339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:34.640339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:34.640339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:34.640339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:34.642468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:34.642468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:34.642468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:34.642468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:34.642468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:34.642468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:34.642468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:34.642468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:34.642468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:34.642468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:34.642468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:34.642468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:34.649618 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 248/488] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:19:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:19:34.649618 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6aa3e-ac7b-4bdd-869d-6674c4d0538a None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:34.729814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:34.735909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc767c63-c104-4ec2-ab6a-f6a218a2ce56 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:34.787149 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0974699-828a-445f-89fa-3fea26af1dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:34.787967 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974699-828a-445f-89fa-3fea26af1dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:34.788775 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974699-828a-445f-89fa-3fea26af1dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:34.789159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974699-828a-445f-89fa-3fea26af1dc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:34.790311 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0974699-828a-445f-89fa-3fea26af1dc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:34.790727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0974699-828a-445f-89fa-3fea26af1dc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:34.791874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6aa3e-ac7b-4bdd-869d-6674c4d0538a None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:34.792277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0974699-828a-445f-89fa-3fea26af1dc7 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:34.809606 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 241/489] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:34.811169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b779d-a732-44a3-802f-3bb85059db6a None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:34.811584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b779d-a732-44a3-802f-3bb85059db6a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:34.812097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b779d-a732-44a3-802f-3bb85059db6a None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:34.812898 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:34.813930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 242/490] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:34.815150 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b779d-a732-44a3-802f-3bb85059db6a None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:34.838316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bce534-0af8-4e80-81b7-c5891cd2f022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:34.839245 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bce534-0af8-4e80-81b7-c5891cd2f022 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:34.840205 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bce534-0af8-4e80-81b7-c5891cd2f022 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:34.840628 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bce534-0af8-4e80-81b7-c5891cd2f022 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:34.841567 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bce534-0af8-4e80-81b7-c5891cd2f022 None admin] RBAC: Adding query filter params (name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:34.842051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bce534-0af8-4e80-81b7-c5891cd2f022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:34.843681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bce534-0af8-4e80-81b7-c5891cd2f022 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:34.855225 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 249/491] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:19:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:34.856949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5f693-13df-4665-91e5-d8703450847e None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:34.857245 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5f693-13df-4665-91e5-d8703450847e None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:34.857546 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5f693-13df-4665-91e5-d8703450847e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:34.880805 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-f3b5f693-13df-4665-91e5-d8703450847e None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:34.882057 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f3b5f693-13df-4665-91e5-d8703450847e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:34.956737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b779d-a732-44a3-802f-3bb85059db6a None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:34.962898 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 250/492] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:34.965272 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5f693-13df-4665-91e5-d8703450847e None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:35.006390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d27458-b7c9-4fa0-8b07-b93cba91cd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:35.007324 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d27458-b7c9-4fa0-8b07-b93cba91cd7a None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:35.007611 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d27458-b7c9-4fa0-8b07-b93cba91cd7a None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:35.007892 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d27458-b7c9-4fa0-8b07-b93cba91cd7a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:35.016785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d27458-b7c9-4fa0-8b07-b93cba91cd7a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:35.018452 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d27458-b7c9-4fa0-8b07-b93cba91cd7a None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:35.035805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-37d27458-b7c9-4fa0-8b07-b93cba91cd7a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 08:19:35.035805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:35.035805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:35.035805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:35.035805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:35.035805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:35.035805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:35.035805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:35.035805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:35.035805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:35.035805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:35.035805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:35.035805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:19:35.035805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:19:35.035805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:19:35.035805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:19:35.036746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:35.036746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:35.036746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:19:35.036746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:35.036746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:19:35.036746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:35.036746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:35.036746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:35.036746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:35.036746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:35.036746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:35.036746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:35.036746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:35.036746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:35.036746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:35.036746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:35.036746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:35.036746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:35.038074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:35.038074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:35.038074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:19:35.038074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:19:35.038074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:19:35.038074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:19:35.038074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:19:35.038074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:19:35.038074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 08:19:35.038074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:35.038074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 243/493] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:35.042259 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d27458-b7c9-4fa0-8b07-b93cba91cd7a None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:35.063575 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:35.096976 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5f693-13df-4665-91e5-d8703450847e None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:35.108226 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:35.148456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65938b-b76d-402f-811f-01f9c8759f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:35.150303 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65938b-b76d-402f-811f-01f9c8759f9f None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:35.150815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65938b-b76d-402f-811f-01f9c8759f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:35.151573 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65938b-b76d-402f-811f-01f9c8759f9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:35.157383 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d27458-b7c9-4fa0-8b07-b93cba91cd7a None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:35.166179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65938b-b76d-402f-811f-01f9c8759f9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:35.168370 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65938b-b76d-402f-811f-01f9c8759f9f None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:35.193151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-5a65938b-b76d-402f-811f-01f9c8759f9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:35.193151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:35.193151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:35.193151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:35.193151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:35.193151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:35.193151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:35.193151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:35.193151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:35.193151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:35.193151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:35.193151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:35.193151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:35.193151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:35.193151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:35.194275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:35.194275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:35.194275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:35.194275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:35.194275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:35.194275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:35.194275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:35.194275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:35.194275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:35.194275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:35.194275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:35.194275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:35.194275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:35.194275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:35.194275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:35.194275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:35.194275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:35.195315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:35.195315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:35.195315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:35.195315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:35.197171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 251/494] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:35.198266 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65938b-b76d-402f-811f-01f9c8759f9f None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:35.203514 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a98a71-b464-4c4a-9581-cade5189ab76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:35.204543 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a98a71-b464-4c4a-9581-cade5189ab76 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:35.204932 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a98a71-b464-4c4a-9581-cade5189ab76 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:35.205312 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a98a71-b464-4c4a-9581-cade5189ab76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:35.218078 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a98a71-b464-4c4a-9581-cade5189ab76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:35.226230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-91a98a71-b464-4c4a-9581-cade5189ab76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:35.226230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:35.226230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:35.226230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:35.226230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:35.226230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:35.226230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:35.226230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:35.226230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:35.226230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:35.226230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:35.226230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:35.226230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:35.226230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:35.226230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:35.226230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:35.227553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:35.227553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:35.227553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:35.227553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:35.227553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:35.227553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:35.227553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:35.227553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:35.227553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:35.227553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:35.227553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:35.227553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:35.227553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:35.227553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:35.227553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:35.227553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:35.228545 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:35.228545 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:35.228545 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:35.228545 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:35.228545 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:35.228545 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:35.228545 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:35.228545 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:35.228545 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:35.228545 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:35.228545 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:35.228545 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:35.235368 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 244/495] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:19:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:35.236432 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a98a71-b464-4c4a-9581-cade5189ab76 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:35.323434 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65938b-b76d-402f-811f-01f9c8759f9f None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:35.326043 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:35.348039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a98a71-b464-4c4a-9581-cade5189ab76 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:35.359829 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbfd27-064f-48a2-a3d0-bc2c88ecb282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:35.360496 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbfd27-064f-48a2-a3d0-bc2c88ecb282 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:35.360783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbfd27-064f-48a2-a3d0-bc2c88ecb282 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:35.361057 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbfd27-064f-48a2-a3d0-bc2c88ecb282 None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:35.361924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbfd27-064f-48a2-a3d0-bc2c88ecb282 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:35.362233 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbfd27-064f-48a2-a3d0-bc2c88ecb282 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:35.363704 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbfd27-064f-48a2-a3d0-bc2c88ecb282 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:35.384188 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d51b3-f4e8-4e58-b7ab-8bfd02a55c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:35.385089 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d51b3-f4e8-4e58-b7ab-8bfd02a55c1d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:35.385676 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d51b3-f4e8-4e58-b7ab-8bfd02a55c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:35.386133 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d51b3-f4e8-4e58-b7ab-8bfd02a55c1d None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:35.387660 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d51b3-f4e8-4e58-b7ab-8bfd02a55c1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:35.388150 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d51b3-f4e8-4e58-b7ab-8bfd02a55c1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:35.389875 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d51b3-f4e8-4e58-b7ab-8bfd02a55c1d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:35.400601 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 252/496] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Jul 21 08:19:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:35.401701 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbfd27-064f-48a2-a3d0-bc2c88ecb282 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:35.404255 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 245/497] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:35.406926 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e037158-8d37-4f6a-9b60-d557aa84adba None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:35.407214 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e037158-8d37-4f6a-9b60-d557aa84adba None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:35.407491 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e037158-8d37-4f6a-9b60-d557aa84adba None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:35.408828 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 246/498] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:35.410430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e037158-8d37-4f6a-9b60-d557aa84adba None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:35.425833 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:35.515515 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbfd27-064f-48a2-a3d0-bc2c88ecb282 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:35.524142 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e037158-8d37-4f6a-9b60-d557aa84adba None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:35.551493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c35dc3-7087-4080-97e3-8df2558d9ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:35.552460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c35dc3-7087-4080-97e3-8df2558d9ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:35.552916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c35dc3-7087-4080-97e3-8df2558d9ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:35.553194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c35dc3-7087-4080-97e3-8df2558d9ca8 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:35.553982 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c35dc3-7087-4080-97e3-8df2558d9ca8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:35.554295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c35dc3-7087-4080-97e3-8df2558d9ca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:35.555682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c35dc3-7087-4080-97e3-8df2558d9ca8 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:35.559843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c7623-a687-4407-b51d-adba13ebdc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:35.560488 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c7623-a687-4407-b51d-adba13ebdc14 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:35.560767 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c7623-a687-4407-b51d-adba13ebdc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:35.561040 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c7623-a687-4407-b51d-adba13ebdc14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:35.564519 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 253/499] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:19:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:35.565322 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c35dc3-7087-4080-97e3-8df2558d9ca8 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:35.574530 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:35.632284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c7623-a687-4407-b51d-adba13ebdc14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:35.633798 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5c7623-a687-4407-b51d-adba13ebdc14 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:35.642647 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:35.663531 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c35dc3-7087-4080-97e3-8df2558d9ca8 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:35.697264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7133f9b-1de1-4fff-8ef1-9eb44167a61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:35.698090 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7133f9b-1de1-4fff-8ef1-9eb44167a61d None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:35.698355 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7133f9b-1de1-4fff-8ef1-9eb44167a61d None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:35.698632 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7133f9b-1de1-4fff-8ef1-9eb44167a61d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:35.706467 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7133f9b-1de1-4fff-8ef1-9eb44167a61d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:35.707907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7133f9b-1de1-4fff-8ef1-9eb44167a61d None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:35.722946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-d7133f9b-1de1-4fff-8ef1-9eb44167a61d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:19:35.722946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:35.722946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:35.722946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:35.722946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:35.722946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:35.722946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:35.722946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:35.722946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:35.722946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:35.722946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:35.722946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:35.722946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:19:35.722946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:19:35.722946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:19:35.722946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:19:35.723905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:35.723905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:35.723905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:19:35.723905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:35.723905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:19:35.723905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:35.723905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:35.723905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:35.723905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:35.723905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:35.723905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:35.723905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:35.723905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:35.723905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:35.723905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:35.723905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:35.723905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:35.723905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:35.724792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:35.724792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:35.724792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:19:35.724792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:19:35.724792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:19:35.724792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:19:35.724792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:19:35.724792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:19:35.724792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:19:35.724792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:35.724792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 254/500] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Jul 21 08:19:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:35.725350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ebc27-e3a3-4672-992b-ba66dcccced8 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:35.725559 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ebc27-e3a3-4672-992b-ba66dcccced8 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:35.725848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ebc27-e3a3-4672-992b-ba66dcccced8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:35.733148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 247/501] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:19:35.734553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df090ec-8bee-4c50-aee2-982452da2d08 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:35.734843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df090ec-8bee-4c50-aee2-982452da2d08 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:35.735119 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df090ec-8bee-4c50-aee2-982452da2d08 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:35.736518 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 248/502] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:35.737116 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df090ec-8bee-4c50-aee2-982452da2d08 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:35.742887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-288ebc27-e3a3-4672-992b-ba66dcccced8 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:35.744120 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-288ebc27-e3a3-4672-992b-ba66dcccced8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:35.780959 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:35.811964 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 255/503] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:35.812807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ebc27-e3a3-4672-992b-ba66dcccced8 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:35.845022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df090ec-8bee-4c50-aee2-982452da2d08 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:35.879583 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730a0eb-93b4-4563-ac50-f3503757356a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:35.880365 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730a0eb-93b4-4563-ac50-f3503757356a None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:35.880646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730a0eb-93b4-4563-ac50-f3503757356a None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:35.880920 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730a0eb-93b4-4563-ac50-f3503757356a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:35.881505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:35.893896 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730a0eb-93b4-4563-ac50-f3503757356a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:35.893896 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730a0eb-93b4-4563-ac50-f3503757356a None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:35.909329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-4730a0eb-93b4-4563-ac50-f3503757356a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:35.909329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:35.909329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:35.909329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:35.909329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:35.909329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:35.909329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:35.909329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:35.909329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:35.909329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:35.909329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:35.909329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:35.909329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:35.909329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:35.909329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:35.910277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:35.910277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:35.910277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:35.910277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:35.910277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:35.910277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:35.910277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:35.910277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:35.910277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:35.910277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:35.910277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:35.910277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:35.910277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:35.910277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:35.910277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:35.910277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:35.910277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:35.911152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:35.911152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:35.911152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:35.911152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:35.911152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 249/504] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:35.911419 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730a0eb-93b4-4563-ac50-f3503757356a None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:35.918672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ebc27-e3a3-4672-992b-ba66dcccced8 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:35.953552 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023ad77-4b73-4285-beae-02acbccc9bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:35.954218 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023ad77-4b73-4285-beae-02acbccc9bad None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:35.954501 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023ad77-4b73-4285-beae-02acbccc9bad None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:35.954778 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023ad77-4b73-4285-beae-02acbccc9bad None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:35.955609 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023ad77-4b73-4285-beae-02acbccc9bad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:35.955940 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023ad77-4b73-4285-beae-02acbccc9bad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:35.957360 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023ad77-4b73-4285-beae-02acbccc9bad None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:35.974056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 256/505] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Jul 21 08:19:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:35.975079 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0081851-1f84-4f9a-ad50-44961648935a None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:35.975370 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0081851-1f84-4f9a-ad50-44961648935a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:35.975650 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0081851-1f84-4f9a-ad50-44961648935a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:35.991693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-d0081851-1f84-4f9a-ad50-44961648935a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:35.992882 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-d0081851-1f84-4f9a-ad50-44961648935a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:36.007024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:36.016276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730a0eb-93b4-4563-ac50-f3503757356a None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:36.050041 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98643271-07c5-4e2b-84f9-8f3dff1ccc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:36.050823 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98643271-07c5-4e2b-84f9-8f3dff1ccc1e None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:36.051106 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98643271-07c5-4e2b-84f9-8f3dff1ccc1e None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:36.051378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98643271-07c5-4e2b-84f9-8f3dff1ccc1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:36.058018 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 257/506] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:36.059710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0081851-1f84-4f9a-ad50-44961648935a None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:36.066085 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98643271-07c5-4e2b-84f9-8f3dff1ccc1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:36.067552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98643271-07c5-4e2b-84f9-8f3dff1ccc1e None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:36.085334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-98643271-07c5-4e2b-84f9-8f3dff1ccc1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:36.085334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:36.085334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:36.085334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:36.085334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:36.085334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:36.085334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:36.085334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:36.085334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:36.085334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:36.085334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:36.085334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:36.085334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:36.085334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:36.085334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:36.090444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:36.090444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:36.090444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:36.090444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:36.090444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:36.090444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:36.090444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:36.090444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:36.090444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:36.090444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:36.090444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:36.090444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:36.090444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:36.090444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:36.090444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:36.090444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:36.090444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:36.091276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:36.091276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:36.091276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:36.091276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:36.091276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 250/507] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:36.091276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98643271-07c5-4e2b-84f9-8f3dff1ccc1e None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:36.131251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:36.175827 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0081851-1f84-4f9a-ad50-44961648935a None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:36.187584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98643271-07c5-4e2b-84f9-8f3dff1ccc1e None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:36.208778 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe993d-5119-45ed-b0b0-5d813495cc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:36.209593 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe993d-5119-45ed-b0b0-5d813495cc20 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:36.209882 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe993d-5119-45ed-b0b0-5d813495cc20 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:36.210159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe993d-5119-45ed-b0b0-5d813495cc20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:36.220526 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe993d-5119-45ed-b0b0-5d813495cc20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:36.221355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3532707-a8e8-4449-90bc-9603b3d38d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:36.222020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfe993d-5119-45ed-b0b0-5d813495cc20 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:36.222139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3532707-a8e8-4449-90bc-9603b3d38d60 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:36.222315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3532707-a8e8-4449-90bc-9603b3d38d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:36.222592 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3532707-a8e8-4449-90bc-9603b3d38d60 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:36.223313 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3532707-a8e8-4449-90bc-9603b3d38d60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:36.223621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3532707-a8e8-4449-90bc-9603b3d38d60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:36.224991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3532707-a8e8-4449-90bc-9603b3d38d60 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:36.236675 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 251/508] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:36.237456 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3532707-a8e8-4449-90bc-9603b3d38d60 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:36.240071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-6bfe993d-5119-45ed-b0b0-5d813495cc20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:36.240071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:36.240071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:36.240071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:36.240071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:36.240071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:36.240071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:36.240071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:36.240071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:36.240071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:36.240071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:36.240071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:36.240071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:36.240071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:36.240071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:36.241056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:36.241056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:36.241056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:36.241056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:36.241056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:36.241056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:36.241056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:36.241056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:36.241056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:36.241056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:36.241056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:36.241056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:36.241056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:36.241056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:36.241056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:36.241056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:36.241056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:36.242131 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:36.242131 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:36.242131 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:36.242131 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:36.242380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:36.242459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 258/509] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:36.242459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe993d-5119-45ed-b0b0-5d813495cc20 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:36.336721 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3532707-a8e8-4449-90bc-9603b3d38d60 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:36.337870 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe993d-5119-45ed-b0b0-5d813495cc20 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:36.347419 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:36.372087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed764067-0754-4651-923c-35e5353eb140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:36.372403 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85420fc-06fe-47e7-9b2f-c92aa5d47196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:36.372733 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed764067-0754-4651-923c-35e5353eb140 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:36.373018 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed764067-0754-4651-923c-35e5353eb140 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:36.373181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85420fc-06fe-47e7-9b2f-c92aa5d47196 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:36.373296 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed764067-0754-4651-923c-35e5353eb140 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:36.373463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85420fc-06fe-47e7-9b2f-c92aa5d47196 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:36.373768 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85420fc-06fe-47e7-9b2f-c92aa5d47196 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:36.384346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85420fc-06fe-47e7-9b2f-c92aa5d47196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:36.392138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-c85420fc-06fe-47e7-9b2f-c92aa5d47196 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:36.392138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:36.392138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:36.392138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:36.392138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:36.392138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:36.392138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:36.392138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:36.392138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:36.392138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:36.392138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:36.392138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:36.392138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:36.392138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:36.392138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:36.392138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:36.393117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:36.393117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:36.393117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:36.393117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:36.393117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:36.393117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:36.393117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:36.393117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:36.393117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:36.393117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:36.393117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:36.393117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:36.393117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:36.393117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:36.393117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:36.393117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:36.393949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:36.393949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:36.393949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:36.393949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:36.393949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:36.393949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:36.393949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:36.393949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:36.393949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:36.393949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:36.393949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:36.393949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:36.393949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 259/510] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:19:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:36.394640 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85420fc-06fe-47e7-9b2f-c92aa5d47196 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:36.441614 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed764067-0754-4651-923c-35e5353eb140 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:36.443012 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed764067-0754-4651-923c-35e5353eb140 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:36.444846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:36.499547 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85420fc-06fe-47e7-9b2f-c92aa5d47196 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:36.534554 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3543b-b5ea-41a4-8098-d378395125a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:36.535223 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3543b-b5ea-41a4-8098-d378395125a9 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:36.535503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3543b-b5ea-41a4-8098-d378395125a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:36.535785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3543b-b5ea-41a4-8098-d378395125a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:36.536495 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3543b-b5ea-41a4-8098-d378395125a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:36.536800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3543b-b5ea-41a4-8098-d378395125a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:36.538212 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3543b-b5ea-41a4-8098-d378395125a9 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:36.545758 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 252/511] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:19:36.546610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed764067-0754-4651-923c-35e5353eb140 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:36.554168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 260/512] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:36.554168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3543b-b5ea-41a4-8098-d378395125a9 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:36.578841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:36.650770 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed764067-0754-4651-923c-35e5353eb140 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:36.651160 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3543b-b5ea-41a4-8098-d378395125a9 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:36.652916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:36.685197 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41489aa2-03ca-485a-98dd-cd1fcaab0d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:36.685436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e0d56-462b-466c-8574-34b57ed1a3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:36.685906 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e0d56-462b-466c-8574-34b57ed1a3ca None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:36.686002 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41489aa2-03ca-485a-98dd-cd1fcaab0d6d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:36.686191 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e0d56-462b-466c-8574-34b57ed1a3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:36.686281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41489aa2-03ca-485a-98dd-cd1fcaab0d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:36.686468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e0d56-462b-466c-8574-34b57ed1a3ca None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:36.686555 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41489aa2-03ca-485a-98dd-cd1fcaab0d6d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:36.687218 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e0d56-462b-466c-8574-34b57ed1a3ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:36.687521 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e0d56-462b-466c-8574-34b57ed1a3ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:36.688900 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e0d56-462b-466c-8574-34b57ed1a3ca None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:36.693837 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41489aa2-03ca-485a-98dd-cd1fcaab0d6d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:36.695232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41489aa2-03ca-485a-98dd-cd1fcaab0d6d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:36.700650 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 261/513] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:36.701470 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e0d56-462b-466c-8574-34b57ed1a3ca None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:36.711604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-41489aa2-03ca-485a-98dd-cd1fcaab0d6d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:19:36.711604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:36.711604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:36.711604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:36.711604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:36.711604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:36.711604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:36.711604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:36.711604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:36.711604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:36.711604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:36.711604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:36.711604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:19:36.711604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:19:36.711604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:19:36.711604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:19:36.712584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:36.712584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:36.712584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:19:36.712584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:36.712584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:19:36.712584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:36.712584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:36.712584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:36.712584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:36.712584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:36.712584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:36.712584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:36.712584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:36.712584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:36.712584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:36.712584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:36.712584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:36.712584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:36.713559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:36.713559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:36.713559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:19:36.713559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:19:36.713559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:19:36.713559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:19:36.713559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:19:36.713559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:19:36.713559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:19:36.713559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:36.713559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 253/514] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:36.713559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41489aa2-03ca-485a-98dd-cd1fcaab0d6d None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:36.794584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:36.806268 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e0d56-462b-466c-8574-34b57ed1a3ca None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:36.818832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41489aa2-03ca-485a-98dd-cd1fcaab0d6d None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:36.841121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37551e5-15d3-42ee-bdbd-560119482d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:36.841814 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37551e5-15d3-42ee-bdbd-560119482d1c None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:36.842096 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37551e5-15d3-42ee-bdbd-560119482d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:36.842371 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37551e5-15d3-42ee-bdbd-560119482d1c None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:36.843110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37551e5-15d3-42ee-bdbd-560119482d1c None admin] RBAC: Adding query filter params (name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:36.843414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37551e5-15d3-42ee-bdbd-560119482d1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:36.844770 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37551e5-15d3-42ee-bdbd-560119482d1c None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:36.853138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 262/515] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:19:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:36.854064 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37551e5-15d3-42ee-bdbd-560119482d1c None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:36.855089 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f1b1b-2291-4cbd-96ad-befb26af5068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:36.855911 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f1b1b-2291-4cbd-96ad-befb26af5068 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:36.856193 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f1b1b-2291-4cbd-96ad-befb26af5068 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:36.856520 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f1b1b-2291-4cbd-96ad-befb26af5068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:36.867763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f1b1b-2291-4cbd-96ad-befb26af5068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:36.869202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5f1b1b-2291-4cbd-96ad-befb26af5068 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:36.889179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-fd5f1b1b-2291-4cbd-96ad-befb26af5068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:36.889179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:36.889179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:36.889179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:36.889179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:36.889179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:36.889179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:36.889179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:36.889179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:36.889179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:36.889179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:36.889179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:36.889179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:36.889179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:36.889179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:36.890084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:36.890084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:36.890084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:36.890084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:36.890084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:36.890084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:36.890084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:36.890084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:36.890084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:36.890084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:36.890084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:36.890084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:36.890084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:36.890084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:36.890084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:36.890084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:36.890084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:36.890936 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:36.890936 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:36.890936 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:36.890936 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:36.890936 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 254/516] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:36.891206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f1b1b-2291-4cbd-96ad-befb26af5068 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:36.914853 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:36.956601 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37551e5-15d3-42ee-bdbd-560119482d1c None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:36.992871 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083929ae-defe-4a51-ab7c-fb28daa2a540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:36.993680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083929ae-defe-4a51-ab7c-fb28daa2a540 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:36.993971 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083929ae-defe-4a51-ab7c-fb28daa2a540 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:36.994241 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083929ae-defe-4a51-ab7c-fb28daa2a540 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:37.002661 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083929ae-defe-4a51-ab7c-fb28daa2a540 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:37.004525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f1b1b-2291-4cbd-96ad-befb26af5068 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:37.004787 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083929ae-defe-4a51-ab7c-fb28daa2a540 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:37.021030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-083929ae-defe-4a51-ab7c-fb28daa2a540 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:37.021030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:37.021030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:37.021030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:37.021030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:37.021030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:37.021030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:37.021030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:37.021030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:37.021030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:37.021030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:37.021030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:37.021030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:19:37.021030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:19:37.021030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:19:37.021984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:19:37.021984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:37.021984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:37.021984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:37.021984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:37.021984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:37.021984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:37.021984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:37.021984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:37.021984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:37.021984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:37.021984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:37.021984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:37.021984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:37.021984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:37.021984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:37.021984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:37.022865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:19:37.022865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:19:37.022865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:19:37.022865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:19:37.022865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:19:37.022865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:19:37.022865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:37.022865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:37.022865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 263/517] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:37.023845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083929ae-defe-4a51-ab7c-fb28daa2a540 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:37.038019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:37.040616 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95e91c-8147-4045-94be-fb61405dbcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:37.041281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95e91c-8147-4045-94be-fb61405dbcd9 None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:37.041584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95e91c-8147-4045-94be-fb61405dbcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:37.041870 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95e91c-8147-4045-94be-fb61405dbcd9 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:37.042569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95e91c-8147-4045-94be-fb61405dbcd9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:37.044013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95e91c-8147-4045-94be-fb61405dbcd9 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:37.125518 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083929ae-defe-4a51-ab7c-fb28daa2a540 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:37.135010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 255/518] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 08:19:36 2022] POST /identity/v3/users => generated 247 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:19:37.135846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95e91c-8147-4045-94be-fb61405dbcd9 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:37.164147 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fd242-4db4-43ab-845d-ca8a38be1204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:37.165183 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fd242-4db4-43ab-845d-ca8a38be1204 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:37.165671 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fd242-4db4-43ab-845d-ca8a38be1204 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:37.165950 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fd242-4db4-43ab-845d-ca8a38be1204 None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:37.166819 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fd242-4db4-43ab-845d-ca8a38be1204 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:37.167134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fd242-4db4-43ab-845d-ca8a38be1204 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:37.168665 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3fd242-4db4-43ab-845d-ca8a38be1204 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:37.188639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 264/519] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Jul 21 08:19:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:37.189567 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fd242-4db4-43ab-845d-ca8a38be1204 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:37.233173 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:37.264424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:37.269394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95e91c-8147-4045-94be-fb61405dbcd9 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:37.300207 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fd242-4db4-43ab-845d-ca8a38be1204 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:37.307218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b823c9e-550c-4c85-a40f-785f03e66368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:37.309248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b823c9e-550c-4c85-a40f-785f03e66368 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:37.309747 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b823c9e-550c-4c85-a40f-785f03e66368 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:37.310032 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b823c9e-550c-4c85-a40f-785f03e66368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:37.322729 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b823c9e-550c-4c85-a40f-785f03e66368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:37.324192 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b823c9e-550c-4c85-a40f-785f03e66368 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:37.341744 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfa8e5-79be-4b3a-9ab5-27c65b579058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:37.342415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfa8e5-79be-4b3a-9ab5-27c65b579058 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:37.342697 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfa8e5-79be-4b3a-9ab5-27c65b579058 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:37.342970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfa8e5-79be-4b3a-9ab5-27c65b579058 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:37.343404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-8b823c9e-550c-4c85-a40f-785f03e66368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:37.343404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:37.343404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:37.343404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:37.343404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:37.343404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:37.343404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:37.343404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:37.343404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:37.343404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:37.343404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:37.343404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:37.343404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:37.343404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:37.343404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:37.344202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:37.344202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:37.344202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:37.344202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:37.344202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:37.344202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:37.344202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:37.344202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:37.344202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:37.344202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:37.344202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:37.344202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:37.344202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:37.344202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:37.344202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:37.344202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:37.344202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:37.345047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:37.345047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:37.345047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:37.345047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:37.345262 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfa8e5-79be-4b3a-9ab5-27c65b579058 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:37.345262 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfa8e5-79be-4b3a-9ab5-27c65b579058 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:37.345383 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 256/520] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:37.345888 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfa8e5-79be-4b3a-9ab5-27c65b579058 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:37.345986 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b823c9e-550c-4c85-a40f-785f03e66368 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:37.359383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 265/521] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:37.360433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfa8e5-79be-4b3a-9ab5-27c65b579058 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:37.461980 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b823c9e-550c-4c85-a40f-785f03e66368 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:37.463061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfa8e5-79be-4b3a-9ab5-27c65b579058 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:37.486481 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:37.491215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:37.499969 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc0b04-098f-45c5-91c9-dad6c021a25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:37.500624 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc0b04-098f-45c5-91c9-dad6c021a25e None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:37.500907 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc0b04-098f-45c5-91c9-dad6c021a25e None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:37.501181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc0b04-098f-45c5-91c9-dad6c021a25e None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:37.501438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b89435-8135-47dc-aa6f-1027910487ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:37.502120 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc0b04-098f-45c5-91c9-dad6c021a25e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:37.502225 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89435-8135-47dc-aa6f-1027910487ed None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:37.502396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89435-8135-47dc-aa6f-1027910487ed None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:37.502488 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc0b04-098f-45c5-91c9-dad6c021a25e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:37.502668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89435-8135-47dc-aa6f-1027910487ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:37.503854 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc0b04-098f-45c5-91c9-dad6c021a25e None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:37.526462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 257/522] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:19:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:37.526462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc0b04-098f-45c5-91c9-dad6c021a25e None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:37.582636 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b89435-8135-47dc-aa6f-1027910487ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:37.584104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b89435-8135-47dc-aa6f-1027910487ed None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:37.624301 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc0b04-098f-45c5-91c9-dad6c021a25e None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:37.663243 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b4f56-7373-4257-b4b4-9c4b27354a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:37.663911 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b4f56-7373-4257-b4b4-9c4b27354a2f None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:37.664202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b4f56-7373-4257-b4b4-9c4b27354a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:37.664483 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b4f56-7373-4257-b4b4-9c4b27354a2f None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:37.665211 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b4f56-7373-4257-b4b4-9c4b27354a2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:37.665543 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b4f56-7373-4257-b4b4-9c4b27354a2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:37.667350 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b4f56-7373-4257-b4b4-9c4b27354a2f None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:37.680375 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 258/523] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:37.681207 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b4f56-7373-4257-b4b4-9c4b27354a2f None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:37.698503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 266/524] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:19:37.699622 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b89435-8135-47dc-aa6f-1027910487ed None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:37.728806 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:37.733149 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:37.798089 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b4f56-7373-4257-b4b4-9c4b27354a2f None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:37.805236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b89435-8135-47dc-aa6f-1027910487ed None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:37.837043 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9c281-7945-4fb0-8afc-aeedb5c93c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:37.837869 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9c281-7945-4fb0-8afc-aeedb5c93c69 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:37.838156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9c281-7945-4fb0-8afc-aeedb5c93c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:37.838435 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9c281-7945-4fb0-8afc-aeedb5c93c69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:37.840508 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bb70d-9139-47a4-acfa-a63868a18d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:37.841160 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bb70d-9139-47a4-acfa-a63868a18d84 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:37.841702 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bb70d-9139-47a4-acfa-a63868a18d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:37.841773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4bb70d-9139-47a4-acfa-a63868a18d84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:37.842576 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bb70d-9139-47a4-acfa-a63868a18d84 None admin] RBAC: Adding query filter params (role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=2b27a4861d6b4ddfaca1a97efdaf008d) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:37.842889 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bb70d-9139-47a4-acfa-a63868a18d84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:37.844307 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4bb70d-9139-47a4-acfa-a63868a18d84 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:37.846421 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9c281-7945-4fb0-8afc-aeedb5c93c69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:37.848559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9c281-7945-4fb0-8afc-aeedb5c93c69 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:37.857953 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 267/525] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:19:37 2022] GET /identity/v3/role_assignments?user.id=2b27a4861d6b4ddfaca1a97efdaf008d&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:37.857953 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bb70d-9139-47a4-acfa-a63868a18d84 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:37.879599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-4cf9c281-7945-4fb0-8afc-aeedb5c93c69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:37.879599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:37.879599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:37.879599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:37.879599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:37.879599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:37.879599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:37.879599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:37.879599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:37.879599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:37.879599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:37.879599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:37.879599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:19:37.879599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:19:37.879599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:19:37.880863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:19:37.880863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:37.880863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:37.880863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:37.880863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:37.880863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:37.880863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:37.880863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:37.880863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:37.880863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:37.880863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:37.880863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:37.880863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:37.880863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:37.880863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:37.880863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:37.880863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:37.881760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:19:37.881760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:19:37.881760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:19:37.881760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:19:37.881760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:19:37.881760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:19:37.881760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:37.881760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:37.885964 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 259/526] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:37.886986 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9c281-7945-4fb0-8afc-aeedb5c93c69 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:37.968893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:37.984522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4bb70d-9139-47a4-acfa-a63868a18d84 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:38.021358 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9c281-7945-4fb0-8afc-aeedb5c93c69 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:38.024022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:38.035185 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf546b-def7-443b-988b-12d380146b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:38.036860 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf546b-def7-443b-988b-12d380146b8d None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:38.045800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf546b-def7-443b-988b-12d380146b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:38.045800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf546b-def7-443b-988b-12d380146b8d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:38.048708 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf546b-def7-443b-988b-12d380146b8d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:38.051215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf546b-def7-443b-988b-12d380146b8d None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:38.064158 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb1b21-3510-4911-a8bc-605b06ae0bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:38.064946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb1b21-3510-4911-a8bc-605b06ae0bbf None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:38.065228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb1b21-3510-4911-a8bc-605b06ae0bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:38.065580 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb1b21-3510-4911-a8bc-605b06ae0bbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:38.070726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-57bf546b-def7-443b-988b-12d380146b8d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 08:19:38.070726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:38.070726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:38.070726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:38.070726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:38.070726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:38.070726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:38.070726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:38.070726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:38.070726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:38.070726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:38.070726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:38.070726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:19:38.070726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:19:38.070726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:19:38.070726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:19:38.071602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:38.071602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:38.071602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:19:38.071602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:38.071602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:19:38.071602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:38.071602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:38.071602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:38.071602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:38.071602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:38.071602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:38.071602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:38.071602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:38.071602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:38.071602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:38.071602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:38.071602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:38.071602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:38.072482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:38.072482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:38.072482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:19:38.072482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:19:38.072482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:19:38.072482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:19:38.072482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:19:38.072482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:19:38.072482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 08:19:38.072482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:38.080398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 268/527] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:19:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:38.080398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf546b-def7-443b-988b-12d380146b8d None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:38.083165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb1b21-3510-4911-a8bc-605b06ae0bbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:38.085324 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb1b21-3510-4911-a8bc-605b06ae0bbf None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:38.104915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-afdb1b21-3510-4911-a8bc-605b06ae0bbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:38.104915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:38.104915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:38.104915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:38.104915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:38.104915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:38.104915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:38.104915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:38.104915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:38.104915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:38.104915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:38.104915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:38.104915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:38.104915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:38.104915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:38.105915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:38.105915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:38.105915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:38.105915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:38.105915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:38.105915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:38.105915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:38.105915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:38.105915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:38.105915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:38.105915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:38.105915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:38.105915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:38.105915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:38.105915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:38.105915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:38.105915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:38.106745 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:38.106745 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:38.106745 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:38.106745 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:38.106964 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 260/528] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:38.108085 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb1b21-3510-4911-a8bc-605b06ae0bbf None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:38.207409 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf546b-def7-443b-988b-12d380146b8d None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:38.225088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb1b21-3510-4911-a8bc-605b06ae0bbf None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:38.244427 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fdb5b-1832-4e90-96c9-411f0ecc13b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:38.245233 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fdb5b-1832-4e90-96c9-411f0ecc13b3 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:38.245657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fdb5b-1832-4e90-96c9-411f0ecc13b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:38.245961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619fdb5b-1832-4e90-96c9-411f0ecc13b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:38.246818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fdb5b-1832-4e90-96c9-411f0ecc13b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:38.247198 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fdb5b-1832-4e90-96c9-411f0ecc13b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:38.248931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619fdb5b-1832-4e90-96c9-411f0ecc13b3 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:38.268086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f530a82-75a6-43ea-8d6f-9a254d417872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:38.269051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f530a82-75a6-43ea-8d6f-9a254d417872 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:38.269559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f530a82-75a6-43ea-8d6f-9a254d417872 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:38.270030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f530a82-75a6-43ea-8d6f-9a254d417872 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:38.271085 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f530a82-75a6-43ea-8d6f-9a254d417872 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:38.271656 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f530a82-75a6-43ea-8d6f-9a254d417872 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:38.273285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f530a82-75a6-43ea-8d6f-9a254d417872 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:38.273771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 269/529] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:19:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:38.274731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fdb5b-1832-4e90-96c9-411f0ecc13b3 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:38.291448 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:38.336255 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 261/530] 10.222.0.57 () {56 vars in 1139 bytes} [Thu Jul 21 08:19:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:38.336255 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f530a82-75a6-43ea-8d6f-9a254d417872 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:38.351278 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:38.403258 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619fdb5b-1832-4e90-96c9-411f0ecc13b3 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:38.442981 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57edcb-ef2a-48ab-b912-06dd9cc0565c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:38.444017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57edcb-ef2a-48ab-b912-06dd9cc0565c None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:38.444520 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57edcb-ef2a-48ab-b912-06dd9cc0565c None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:38.444989 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba57edcb-ef2a-48ab-b912-06dd9cc0565c None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:38.445974 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57edcb-ef2a-48ab-b912-06dd9cc0565c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:38.446523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57edcb-ef2a-48ab-b912-06dd9cc0565c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:38.448081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba57edcb-ef2a-48ab-b912-06dd9cc0565c None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:38.462734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 270/531] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:38.463646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57edcb-ef2a-48ab-b912-06dd9cc0565c None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:38.465875 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f530a82-75a6-43ea-8d6f-9a254d417872 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:38.503493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cc827-ceff-4cd3-aa99-df203e805401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:38.504570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cc827-ceff-4cd3-aa99-df203e805401 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:38.505066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cc827-ceff-4cd3-aa99-df203e805401 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:38.505552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cc827-ceff-4cd3-aa99-df203e805401 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:38.506688 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cc827-ceff-4cd3-aa99-df203e805401 None admin] RBAC: Adding query filter params (role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=b6670a010c034f7999c9445452c02473) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:38.507206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cc827-ceff-4cd3-aa99-df203e805401 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:38.508933 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cc827-ceff-4cd3-aa99-df203e805401 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:38.516205 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 262/532] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:19:38 2022] GET /identity/v3/role_assignments?user.id=b6670a010c034f7999c9445452c02473&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:38.517220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cc827-ceff-4cd3-aa99-df203e805401 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:38.561834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:38.608364 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:38.620388 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba57edcb-ef2a-48ab-b912-06dd9cc0565c None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:38.635423 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cc827-ceff-4cd3-aa99-df203e805401 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:38.681849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a09afa-3ad5-4820-b52b-e135538f25b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:38.683037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a09afa-3ad5-4820-b52b-e135538f25b9 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:38.684060 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a09afa-3ad5-4820-b52b-e135538f25b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:38.684559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a09afa-3ad5-4820-b52b-e135538f25b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:38.693057 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a09afa-3ad5-4820-b52b-e135538f25b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:38.695273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a09afa-3ad5-4820-b52b-e135538f25b9 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:38.706343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc28a45-eb64-48fd-833d-4f1a1b2c571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:38.707015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc28a45-eb64-48fd-833d-4f1a1b2c571a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:38.707301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc28a45-eb64-48fd-833d-4f1a1b2c571a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:38.707581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc28a45-eb64-48fd-833d-4f1a1b2c571a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:38.714808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-53a09afa-3ad5-4820-b52b-e135538f25b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:38.714808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:38.714808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:38.714808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:38.714808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:38.714808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:38.714808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:38.714808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:38.714808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:38.714808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:38.714808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:38.714808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:38.714808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:19:38.714808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:19:38.714808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:19:38.715670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:19:38.715670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:38.715670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:38.715670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:38.715670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:38.715670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:38.715670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:38.715670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:38.715670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:38.715670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:38.715670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:38.715670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:38.715670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:38.715670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:38.715670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:38.715670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:38.715670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:38.716522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:19:38.716522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:19:38.716522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:19:38.716522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:19:38.716522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:19:38.716522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:19:38.716522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:38.716522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:38.719087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 263/533] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:38.724713 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a09afa-3ad5-4820-b52b-e135538f25b9 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:38.849138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc28a45-eb64-48fd-833d-4f1a1b2c571a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:38.850573 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc28a45-eb64-48fd-833d-4f1a1b2c571a None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:38.898736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a09afa-3ad5-4820-b52b-e135538f25b9 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:38.944299 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c67e74-f066-46f3-858f-69cb5bfc2bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:38.944959 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c67e74-f066-46f3-858f-69cb5bfc2bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:38.945241 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c67e74-f066-46f3-858f-69cb5bfc2bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:38.945513 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c67e74-f066-46f3-858f-69cb5bfc2bc2 None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:38.946332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c67e74-f066-46f3-858f-69cb5bfc2bc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:38.946643 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c67e74-f066-46f3-858f-69cb5bfc2bc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:38.948103 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c67e74-f066-46f3-858f-69cb5bfc2bc2 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:38.961878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:38.972205 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 264/534] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:19:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:38.978529 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c67e74-f066-46f3-858f-69cb5bfc2bc2 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:38.991216 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:39.040481 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 271/535] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:19:39.051068 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc28a45-eb64-48fd-833d-4f1a1b2c571a None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:39.163203 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c67e74-f066-46f3-858f-69cb5bfc2bc2 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:39.231188 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3537b-aff3-484e-a92a-8dda2e3014f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:39.231856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3537b-aff3-484e-a92a-8dda2e3014f1 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:39.232138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3537b-aff3-484e-a92a-8dda2e3014f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:39.232412 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3537b-aff3-484e-a92a-8dda2e3014f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:39.233256 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3537b-aff3-484e-a92a-8dda2e3014f1 None admin] RBAC: Adding query filter params (role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=aebefbc2dc0244d8a5ae7d88be6b63ad) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:39.241549 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3537b-aff3-484e-a92a-8dda2e3014f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:39.241549 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3537b-aff3-484e-a92a-8dda2e3014f1 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:39.241549 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 265/536] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:19:38 2022] GET /identity/v3/role_assignments?user.id=aebefbc2dc0244d8a5ae7d88be6b63ad&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:39.243645 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc28a45-eb64-48fd-833d-4f1a1b2c571a None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:39.282536 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a6cc1-b10f-4818-b2c4-dbbcceaeba54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:39.283355 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6cc1-b10f-4818-b2c4-dbbcceaeba54 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:39.283641 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6cc1-b10f-4818-b2c4-dbbcceaeba54 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:39.283919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6cc1-b10f-4818-b2c4-dbbcceaeba54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:39.295087 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a6cc1-b10f-4818-b2c4-dbbcceaeba54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:39.296575 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a6cc1-b10f-4818-b2c4-dbbcceaeba54 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:39.313245 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081fd27-0e80-4958-8a84-b29fbfffa04c None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:39.313600 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081fd27-0e80-4958-8a84-b29fbfffa04c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:39.313835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081fd27-0e80-4958-8a84-b29fbfffa04c None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:39.315322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 266/537] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:19:39.319269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-e09a6cc1-b10f-4818-b2c4-dbbcceaeba54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:39.319269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:39.319269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:39.319269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:39.319269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:39.319269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:39.319269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:39.319269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:39.319269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:39.319269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:39.319269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:39.319269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:39.319269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:39.319269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:39.319269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:39.320121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:39.320121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:39.320121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:39.320121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:39.320121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:39.320121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:39.320121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:39.320121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:39.320121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:39.320121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:39.320121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:39.320121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:39.320121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:39.320121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:39.320121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:39.320121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:39.320121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:39.320984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:39.320984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:39.320984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:39.320984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:39.321207 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95875557-4cef-4c60-ac41-80f7a9015973 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:39.321207 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95875557-4cef-4c60-ac41-80f7a9015973 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:39.321207 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95875557-4cef-4c60-ac41-80f7a9015973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:39.322690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 272/538] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:39.329076 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a6cc1-b10f-4818-b2c4-dbbcceaeba54 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:39.362248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:39.362697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-95875557-4cef-4c60-ac41-80f7a9015973 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:39.364795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-95875557-4cef-4c60-ac41-80f7a9015973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:39.471133 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:39.484781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a6cc1-b10f-4818-b2c4-dbbcceaeba54 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:39.489268 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 267/539] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 21 08:19:39.521378 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7e307-ecf2-456d-840b-ba610dabfffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:39.522078 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7e307-ecf2-456d-840b-ba610dabfffe None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:39.522370 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7e307-ecf2-456d-840b-ba610dabfffe None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:39.522620 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95875557-4cef-4c60-ac41-80f7a9015973 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:39.522755 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7e307-ecf2-456d-840b-ba610dabfffe None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:39.523374 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7e307-ecf2-456d-840b-ba610dabfffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:39.523690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7e307-ecf2-456d-840b-ba610dabfffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:39.525154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7e307-ecf2-456d-840b-ba610dabfffe None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:39.538872 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 273/540] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:39.544237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7e307-ecf2-456d-840b-ba610dabfffe None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:39.633741 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:39.650916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7e307-ecf2-456d-840b-ba610dabfffe None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:39.687106 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e87afe-d422-4987-a922-94c002ba6c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:39.687908 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e87afe-d422-4987-a922-94c002ba6c50 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:39.688193 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e87afe-d422-4987-a922-94c002ba6c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:39.688472 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e87afe-d422-4987-a922-94c002ba6c50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:39.695719 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e87afe-d422-4987-a922-94c002ba6c50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:39.697320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e87afe-d422-4987-a922-94c002ba6c50 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:39.712948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-d0e87afe-d422-4987-a922-94c002ba6c50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:39.712948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:39.712948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:39.712948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:39.712948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:39.712948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:39.712948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:39.712948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:39.712948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:39.712948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:39.712948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:39.712948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:39.712948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:19:39.712948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:19:39.712948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:19:39.713909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:19:39.713909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:39.713909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:39.713909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:39.713909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:39.713909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:39.713909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:39.713909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:39.713909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:39.713909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:39.713909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:39.713909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:39.713909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:39.713909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:39.713909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:39.713909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:39.713909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:39.715358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:19:39.715358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:19:39.715358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:19:39.715358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:19:39.715358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:19:39.715358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:19:39.715358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:39.715358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:39.715358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 274/541] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:39.723357 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e87afe-d422-4987-a922-94c002ba6c50 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:39.742270 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95875557-4cef-4c60-ac41-80f7a9015973 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:39.816670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb4ed0-0869-4323-afe4-e685bc7fa5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:39.817611 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb4ed0-0869-4323-afe4-e685bc7fa5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:39.817895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb4ed0-0869-4323-afe4-e685bc7fa5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:39.818172 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb4ed0-0869-4323-afe4-e685bc7fa5a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:39.833661 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e87afe-d422-4987-a922-94c002ba6c50 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:39.842508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdb4ed0-0869-4323-afe4-e685bc7fa5a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:39.850874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-1cdb4ed0-0869-4323-afe4-e685bc7fa5a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:39.850874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:39.850874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:39.850874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:39.850874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:39.850874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:39.850874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:39.850874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:39.850874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:39.850874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:39.850874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:39.850874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:39.850874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:39.850874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:39.850874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:39.850874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:39.852035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:39.852035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:39.852035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:39.852035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:39.852035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:39.852035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:39.852035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:39.852035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:39.852035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:39.852035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:39.852035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:39.852035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:39.852035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:39.852035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:39.852035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:39.852035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:39.852824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:39.852824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:39.852824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:39.852824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:39.852824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:39.852824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:39.852824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:39.852824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:39.852824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:39.852824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:39.852824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:39.852824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:39.853435 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 268/542] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:19:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:39.862710 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb4ed0-0869-4323-afe4-e685bc7fa5a7 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:39.869886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cd975-ed5f-4536-9a02-363f458a20ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:39.871205 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cd975-ed5f-4536-9a02-363f458a20ff None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:39.871490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cd975-ed5f-4536-9a02-363f458a20ff None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:39.871770 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cd975-ed5f-4536-9a02-363f458a20ff None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:39.872556 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cd975-ed5f-4536-9a02-363f458a20ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:39.872867 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cd975-ed5f-4536-9a02-363f458a20ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:39.874335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cd975-ed5f-4536-9a02-363f458a20ff None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:39.887350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 275/543] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:19:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:39.893137 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cd975-ed5f-4536-9a02-363f458a20ff None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:39.896800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:39.967422 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:40.053238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb4ed0-0869-4323-afe4-e685bc7fa5a7 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:40.056666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cd975-ed5f-4536-9a02-363f458a20ff None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:40.102449 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5c6b5-4fd2-405f-bb03-9bcc1855131b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:40.103239 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5c6b5-4fd2-405f-bb03-9bcc1855131b None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:40.103527 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5c6b5-4fd2-405f-bb03-9bcc1855131b None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:40.103812 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5c6b5-4fd2-405f-bb03-9bcc1855131b None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:40.104573 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5c6b5-4fd2-405f-bb03-9bcc1855131b None admin] RBAC: Adding query filter params (name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:40.104908 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5c6b5-4fd2-405f-bb03-9bcc1855131b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:40.106331 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5c6b5-4fd2-405f-bb03-9bcc1855131b None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:40.116111 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 269/544] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:19:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:40.121939 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5c6b5-4fd2-405f-bb03-9bcc1855131b None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:40.123154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c93994-0cb0-426a-b503-d3d6ddc9d7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:40.124054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c93994-0cb0-426a-b503-d3d6ddc9d7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:40.124642 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c93994-0cb0-426a-b503-d3d6ddc9d7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:40.125114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c93994-0cb0-426a-b503-d3d6ddc9d7b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:40.126234 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c93994-0cb0-426a-b503-d3d6ddc9d7b9 None admin] RBAC: Adding query filter params (role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=a25749f3a7c84c50b860538d1b661901) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:40.126745 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c93994-0cb0-426a-b503-d3d6ddc9d7b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:40.128395 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c93994-0cb0-426a-b503-d3d6ddc9d7b9 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:40.134968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 276/545] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:19:39 2022] GET /identity/v3/role_assignments?user.id=a25749f3a7c84c50b860538d1b661901&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:40.215329 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf33019-0470-453a-8253-1b2f813a9936 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:40.215962 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf33019-0470-453a-8253-1b2f813a9936 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:40.216467 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf33019-0470-453a-8253-1b2f813a9936 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:40.218675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 277/546] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:19:40.223789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787fcac-8541-4f5a-a7f7-84ca363137c3 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:40.224290 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787fcac-8541-4f5a-a7f7-84ca363137c3 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:40.224874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787fcac-8541-4f5a-a7f7-84ca363137c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:40.244188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-6787fcac-8541-4f5a-a7f7-84ca363137c3 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:40.246620 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-6787fcac-8541-4f5a-a7f7-84ca363137c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:40.259340 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5c6b5-4fd2-405f-bb03-9bcc1855131b None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:40.278149 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:40.302275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072ccd7-eace-40f5-a863-b4c377fde83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:40.303232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072ccd7-eace-40f5-a863-b4c377fde83d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:40.303570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072ccd7-eace-40f5-a863-b4c377fde83d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:40.303789 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072ccd7-eace-40f5-a863-b4c377fde83d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:40.318249 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072ccd7-eace-40f5-a863-b4c377fde83d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:40.320401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072ccd7-eace-40f5-a863-b4c377fde83d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:40.340792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-7072ccd7-eace-40f5-a863-b4c377fde83d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:40.340792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:40.340792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:40.340792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:40.340792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:40.340792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:40.340792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:40.340792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:40.340792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:40.340792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:40.340792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:40.340792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:40.340792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:40.340792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:40.340792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:40.341826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:40.341826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:40.341826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:40.341826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:40.341826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:40.341826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:40.341826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:40.341826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:40.341826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:40.341826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:40.341826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:40.341826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:40.341826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:40.341826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:40.341826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:40.341826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:40.341826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:40.342664 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:40.342664 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:40.342664 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:40.342664 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:40.342664 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 270/547] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:19:40.352611 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072ccd7-eace-40f5-a863-b4c377fde83d None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:40.385737 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:40.392111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 278/548] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:19:40.415618 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787fcac-8541-4f5a-a7f7-84ca363137c3 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:40.483340 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072ccd7-eace-40f5-a863-b4c377fde83d None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:40.520134 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bfa6f-1a59-495b-951c-43970256fc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:40.520894 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bfa6f-1a59-495b-951c-43970256fc07 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:40.521089 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bfa6f-1a59-495b-951c-43970256fc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:40.521396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bfa6f-1a59-495b-951c-43970256fc07 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:40.522127 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bfa6f-1a59-495b-951c-43970256fc07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:40.522439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bfa6f-1a59-495b-951c-43970256fc07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:40.524131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bfa6f-1a59-495b-951c-43970256fc07 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:40.541984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 271/549] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:40.544122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bfa6f-1a59-495b-951c-43970256fc07 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:40.575636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:40.576914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787fcac-8541-4f5a-a7f7-84ca363137c3 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:40.614178 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e9131-2991-4ded-b902-b6ae6431523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:40.615597 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e9131-2991-4ded-b902-b6ae6431523a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:40.616229 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e9131-2991-4ded-b902-b6ae6431523a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:40.617078 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e9131-2991-4ded-b902-b6ae6431523a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:40.630490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e9131-2991-4ded-b902-b6ae6431523a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:40.640364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-aa7e9131-2991-4ded-b902-b6ae6431523a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:40.640364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:40.640364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:40.640364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:40.640364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:40.640364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:40.640364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:40.640364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:40.640364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:40.640364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:40.640364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:40.640364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:40.640364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:40.640364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:40.640364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:40.640364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:40.641308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:40.641308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:40.641308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:40.641308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:40.641308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:40.641308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:40.641308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:40.641308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:40.641308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:40.641308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:40.641308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:40.641308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:40.641308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:40.641308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:40.641308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:40.641308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:40.642161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:40.642161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:40.642161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:40.642161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:40.642161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:40.642161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:40.642161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:40.642161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:40.642161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:40.642161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:40.642161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:40.642161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:40.642161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 279/550] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:19:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:40.648815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e9131-2991-4ded-b902-b6ae6431523a None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:40.668740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bfa6f-1a59-495b-951c-43970256fc07 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:40.711469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0a64c-930b-4214-94c6-efd5441e21f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:40.712858 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0a64c-930b-4214-94c6-efd5441e21f0 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:40.713341 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:40.713451 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0a64c-930b-4214-94c6-efd5441e21f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:40.714946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0a64c-930b-4214-94c6-efd5441e21f0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:40.724879 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0a64c-930b-4214-94c6-efd5441e21f0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:40.727741 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0a64c-930b-4214-94c6-efd5441e21f0 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:40.747884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-39b0a64c-930b-4214-94c6-efd5441e21f0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:19:40.747884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:40.747884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:40.747884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:40.747884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:40.747884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:40.747884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:40.747884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:40.747884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:40.747884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:40.747884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:40.747884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:40.747884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:19:40.747884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:19:40.747884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:19:40.747884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:19:40.748998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:40.748998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:40.748998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:19:40.748998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:40.748998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:19:40.748998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:40.748998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:40.748998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:40.748998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:40.748998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:40.748998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:40.748998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:40.748998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:40.748998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:40.748998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:40.748998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:40.748998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:40.748998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:40.750316 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:40.750316 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:40.750316 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:19:40.750316 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:19:40.750316 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:19:40.750316 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:19:40.750316 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:19:40.750316 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:19:40.750316 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:19:40.750316 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:40.755250 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 272/551] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:19:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:40.755250 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0a64c-930b-4214-94c6-efd5441e21f0 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:40.827777 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e9131-2991-4ded-b902-b6ae6431523a None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:40.857533 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:40.875970 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0a64c-930b-4214-94c6-efd5441e21f0 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:40.914502 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93b6b7-6467-4938-9a54-d8739296af04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:40.915439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93b6b7-6467-4938-9a54-d8739296af04 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:40.915732 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93b6b7-6467-4938-9a54-d8739296af04 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:40.916022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93b6b7-6467-4938-9a54-d8739296af04 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:40.916877 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93b6b7-6467-4938-9a54-d8739296af04 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:40.917197 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93b6b7-6467-4938-9a54-d8739296af04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:40.919822 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93b6b7-6467-4938-9a54-d8739296af04 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:40.940132 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 273/552] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Jul 21 08:19:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:40.942236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a11dea-1ec8-4bbf-abf1-186623ab4f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:40.942927 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a11dea-1ec8-4bbf-abf1-186623ab4f1d None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:40.943209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a11dea-1ec8-4bbf-abf1-186623ab4f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:40.943480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a11dea-1ec8-4bbf-abf1-186623ab4f1d None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:40.944237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a11dea-1ec8-4bbf-abf1-186623ab4f1d None admin] RBAC: Adding query filter params (name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:40.944540 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a11dea-1ec8-4bbf-abf1-186623ab4f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:40.945621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93b6b7-6467-4938-9a54-d8739296af04 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:40.945961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a11dea-1ec8-4bbf-abf1-186623ab4f1d None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:40.975812 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 280/553] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:19:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:40.986515 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a11dea-1ec8-4bbf-abf1-186623ab4f1d None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:41.056956 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93b6b7-6467-4938-9a54-d8739296af04 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:41.097725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3384f-d915-4ecb-a25e-973ca494424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:41.097725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3384f-d915-4ecb-a25e-973ca494424d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:41.097725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3384f-d915-4ecb-a25e-973ca494424d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:41.097725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3384f-d915-4ecb-a25e-973ca494424d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:41.109905 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:41.180261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3384f-d915-4ecb-a25e-973ca494424d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:41.182419 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3384f-d915-4ecb-a25e-973ca494424d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:41.185281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a11dea-1ec8-4bbf-abf1-186623ab4f1d None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:41.207772 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:41.224419 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e498f8c-c1d3-44c9-8da2-727daf1d7854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:41.225619 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e498f8c-c1d3-44c9-8da2-727daf1d7854 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:41.226100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e498f8c-c1d3-44c9-8da2-727daf1d7854 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:41.226568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e498f8c-c1d3-44c9-8da2-727daf1d7854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:41.238477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e498f8c-c1d3-44c9-8da2-727daf1d7854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:41.240228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e498f8c-c1d3-44c9-8da2-727daf1d7854 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:41.260050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-7e498f8c-c1d3-44c9-8da2-727daf1d7854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:41.260050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:41.260050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:41.260050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:41.260050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:41.260050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:41.260050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:41.260050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:41.260050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:41.260050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:41.260050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:41.260050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:41.260050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:41.260050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:41.260050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:41.260942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:41.260942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:41.260942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:41.260942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:41.260942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:41.260942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:41.260942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:41.260942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:41.260942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:41.260942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:41.260942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:41.260942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:41.260942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:41.260942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:41.260942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:41.260942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:41.260942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:41.262379 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:41.262379 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:41.262379 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:41.262379 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:41.264671 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 281/554] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:41.266282 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29d124-c2e1-47c3-b008-8386935f7384 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:41.266765 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29d124-c2e1-47c3-b008-8386935f7384 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:41.267233 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29d124-c2e1-47c3-b008-8386935f7384 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:41.272874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 282/555] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:41.274002 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29d124-c2e1-47c3-b008-8386935f7384 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:41.307253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 274/556] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 08:19:41.309378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100b4e7-865c-4620-b586-5493b7b0f23f None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:41.309925 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100b4e7-865c-4620-b586-5493b7b0f23f None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:41.310411 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100b4e7-865c-4620-b586-5493b7b0f23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:41.328500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-0100b4e7-865c-4620-b586-5493b7b0f23f None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:41.330036 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-0100b4e7-865c-4620-b586-5493b7b0f23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:41.366105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:41.409862 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 275/557] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:41.412079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100b4e7-865c-4620-b586-5493b7b0f23f None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:41.418490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29d124-c2e1-47c3-b008-8386935f7384 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:41.469008 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0d9f0-d5d9-482d-8496-9606645d5506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:41.469704 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0d9f0-d5d9-482d-8496-9606645d5506 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:41.469995 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0d9f0-d5d9-482d-8496-9606645d5506 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:41.470277 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0d9f0-d5d9-482d-8496-9606645d5506 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:41.471001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0d9f0-d5d9-482d-8496-9606645d5506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:41.471363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0d9f0-d5d9-482d-8496-9606645d5506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:41.473272 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0d9f0-d5d9-482d-8496-9606645d5506 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:41.490635 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 283/558] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:41.493107 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0d9f0-d5d9-482d-8496-9606645d5506 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:41.528618 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:41.553578 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100b4e7-865c-4620-b586-5493b7b0f23f None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:41.594620 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b862f2-fce5-46fd-991e-43f5c6f63061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:41.595411 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b862f2-fce5-46fd-991e-43f5c6f63061 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:41.595694 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b862f2-fce5-46fd-991e-43f5c6f63061 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:41.595968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b862f2-fce5-46fd-991e-43f5c6f63061 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:41.600226 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0d9f0-d5d9-482d-8496-9606645d5506 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:41.606578 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b862f2-fce5-46fd-991e-43f5c6f63061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:41.608037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b862f2-fce5-46fd-991e-43f5c6f63061 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:41.626810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-e6b862f2-fce5-46fd-991e-43f5c6f63061 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:41.626810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:41.626810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:41.626810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:41.626810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:41.626810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:41.626810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:41.626810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:41.626810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:41.626810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:41.626810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:41.626810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:41.626810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:41.626810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:41.626810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:41.627867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:41.627867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:41.627867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:41.627867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:41.627867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:41.627867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:41.627867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:41.627867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:41.627867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:41.627867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:41.627867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:41.627867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:41.627867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:41.627867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:41.627867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:41.627867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:41.627867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:41.628744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:41.628744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:41.628744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:41.628744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:41.628744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 276/559] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:41.629039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b862f2-fce5-46fd-991e-43f5c6f63061 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:41.644174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1508b03-4e4d-4da5-b196-9b777b62aa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:41.644975 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1508b03-4e4d-4da5-b196-9b777b62aa14 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:41.645248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1508b03-4e4d-4da5-b196-9b777b62aa14 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:41.645515 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1508b03-4e4d-4da5-b196-9b777b62aa14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:41.656112 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1508b03-4e4d-4da5-b196-9b777b62aa14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:41.658142 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:41.663790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-a1508b03-4e4d-4da5-b196-9b777b62aa14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:41.663790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:41.663790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:41.663790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:41.663790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:41.663790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:41.663790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:41.663790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:41.663790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:41.663790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:41.663790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:41.663790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:41.663790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:41.663790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:41.663790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:41.663790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:41.664720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:41.664720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:41.664720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:41.664720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:41.664720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:41.664720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:41.664720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:41.664720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:41.664720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:41.664720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:41.664720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:41.664720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:41.664720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:41.664720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:41.664720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:41.664720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:41.672916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:41.672916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:41.672916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:41.672916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:41.672916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:41.672916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:41.672916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:41.672916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:41.672916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:41.672916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:41.672916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:41.672916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:41.672916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 284/560] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:19:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:41.672916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f022d-bfeb-4df0-a767-b130e2af248c None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:41.673750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f022d-bfeb-4df0-a767-b130e2af248c None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:41.673750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f022d-bfeb-4df0-a767-b130e2af248c None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:41.673750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 285/561] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:41.674158 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f022d-bfeb-4df0-a767-b130e2af248c None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:41.750349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b862f2-fce5-46fd-991e-43f5c6f63061 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:41.779735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:41.789811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f022d-bfeb-4df0-a767-b130e2af248c None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:41.796184 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6db019-d3da-40c6-b223-063ad2e24f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:41.796734 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6db019-d3da-40c6-b223-063ad2e24f0f None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:41.797012 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6db019-d3da-40c6-b223-063ad2e24f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:41.797282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6db019-d3da-40c6-b223-063ad2e24f0f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:41.804828 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6db019-d3da-40c6-b223-063ad2e24f0f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:41.806305 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6db019-d3da-40c6-b223-063ad2e24f0f None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:41.820569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-5a6db019-d3da-40c6-b223-063ad2e24f0f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 08:19:41.820569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:41.820569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:41.820569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:41.820569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:41.820569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:41.820569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:41.820569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:41.820569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:41.820569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:41.820569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:41.820569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:41.820569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:19:41.820569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:19:41.820569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:19:41.820569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:19:41.821499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:41.821499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:41.821499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:19:41.821499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:41.821499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:19:41.821499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:41.821499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:41.821499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:41.821499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:41.821499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:41.821499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:41.821499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:41.821499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:41.821499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:41.821499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:41.821499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:41.821499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:41.821499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:41.822631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:41.822631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:41.822631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:19:41.822631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:19:41.822631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:19:41.822631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:19:41.822631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:19:41.822631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:19:41.822631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 08:19:41.822631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:41.822631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 277/562] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:41.822631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6db019-d3da-40c6-b223-063ad2e24f0f None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:41.833715 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b68af-744c-4fed-92b5-aefc7572ed68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:41.834383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b68af-744c-4fed-92b5-aefc7572ed68 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:41.835028 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b68af-744c-4fed-92b5-aefc7572ed68 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:41.835314 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b68af-744c-4fed-92b5-aefc7572ed68 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:41.836344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b68af-744c-4fed-92b5-aefc7572ed68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:41.836713 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b68af-744c-4fed-92b5-aefc7572ed68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:41.838369 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b68af-744c-4fed-92b5-aefc7572ed68 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:41.855494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 286/563] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:41.855494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2782596-5ea7-427c-a99f-8f4b84a01479 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:41.855494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2782596-5ea7-427c-a99f-8f4b84a01479 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:41.855494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2782596-5ea7-427c-a99f-8f4b84a01479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:41.869831 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-f2782596-5ea7-427c-a99f-8f4b84a01479 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:41.871054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f2782596-5ea7-427c-a99f-8f4b84a01479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:41.920601 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:41.937201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6db019-d3da-40c6-b223-063ad2e24f0f None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:41.949547 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 287/564] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:41.949547 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2782596-5ea7-427c-a99f-8f4b84a01479 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:41.985100 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23e02e-061c-4faa-9384-f61a390613b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:41.985863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23e02e-061c-4faa-9384-f61a390613b3 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:41.986218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23e02e-061c-4faa-9384-f61a390613b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:41.986501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23e02e-061c-4faa-9384-f61a390613b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:41.987254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23e02e-061c-4faa-9384-f61a390613b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:41.987559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23e02e-061c-4faa-9384-f61a390613b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:41.988935 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23e02e-061c-4faa-9384-f61a390613b3 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:41.997202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 278/565] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:19:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:41.998054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23e02e-061c-4faa-9384-f61a390613b3 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:42.042378 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:42.062875 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2782596-5ea7-427c-a99f-8f4b84a01479 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:42.102258 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fc1f0-409c-4f00-a464-4d6d1d821b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:42.103023 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fc1f0-409c-4f00-a464-4d6d1d821b73 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:42.103306 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fc1f0-409c-4f00-a464-4d6d1d821b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:42.103584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fc1f0-409c-4f00-a464-4d6d1d821b73 None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:42.104406 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fc1f0-409c-4f00-a464-4d6d1d821b73 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:42.104718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fc1f0-409c-4f00-a464-4d6d1d821b73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:42.106215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fc1f0-409c-4f00-a464-4d6d1d821b73 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:42.106835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23e02e-061c-4faa-9384-f61a390613b3 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:42.123970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 288/566] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Jul 21 08:19:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:42.126480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fc1f0-409c-4f00-a464-4d6d1d821b73 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:42.147287 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81268704-3670-4c9e-929b-859464d56a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:42.148110 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81268704-3670-4c9e-929b-859464d56a81 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:42.148389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81268704-3670-4c9e-929b-859464d56a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:42.149068 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81268704-3670-4c9e-929b-859464d56a81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:42.157657 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81268704-3670-4c9e-929b-859464d56a81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:42.159716 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81268704-3670-4c9e-929b-859464d56a81 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:42.174503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-81268704-3670-4c9e-929b-859464d56a81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:42.174503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:42.174503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:42.174503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:42.174503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:42.174503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:42.174503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:42.174503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:42.174503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:42.174503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:42.174503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:42.174503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:42.174503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:19:42.174503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:19:42.174503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:19:42.175428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:19:42.175428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:42.175428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:42.175428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:42.175428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:42.175428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:42.175428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:42.175428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:42.175428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:42.175428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:42.175428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:42.175428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:42.175428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:42.175428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:42.175428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:42.175428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:42.175428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:42.176345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:19:42.176345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:19:42.176345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:19:42.176345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:19:42.176345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:19:42.176345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:19:42.176345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:42.176345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:42.176345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 279/567] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:42.176816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81268704-3670-4c9e-929b-859464d56a81 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:42.188013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:42.236400 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fc1f0-409c-4f00-a464-4d6d1d821b73 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:42.272095 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12a155-6a2b-4f70-996b-9757b6402ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:42.272886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12a155-6a2b-4f70-996b-9757b6402ebf None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:42.273168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12a155-6a2b-4f70-996b-9757b6402ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:42.273491 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12a155-6a2b-4f70-996b-9757b6402ebf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:42.281273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:42.284430 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12a155-6a2b-4f70-996b-9757b6402ebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:42.285663 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81268704-3670-4c9e-929b-859464d56a81 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:42.292476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-ba12a155-6a2b-4f70-996b-9757b6402ebf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:42.292476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:42.292476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:42.292476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:42.292476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:42.292476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:42.292476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:42.292476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:42.292476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:42.292476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:42.292476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:42.292476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:42.292476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:42.292476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:42.292476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:42.292476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:42.299710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:42.299710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:42.299710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:42.299710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:42.299710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:42.299710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:42.299710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:42.299710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:42.299710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:42.299710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:42.299710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:42.299710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:42.299710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:42.299710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:42.299710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:42.299710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:42.300726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:42.300726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:42.300726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:42.300726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:42.300726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:42.300726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:42.300726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:42.300726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:42.300726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:42.300726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:42.300726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:42.300726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:42.300726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 289/568] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:19:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:42.300726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12a155-6a2b-4f70-996b-9757b6402ebf None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:42.328096 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070b3b6-af40-4afc-b79b-352f801daede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:42.328881 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070b3b6-af40-4afc-b79b-352f801daede None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:42.329163 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070b3b6-af40-4afc-b79b-352f801daede None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:42.329434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070b3b6-af40-4afc-b79b-352f801daede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:42.340175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070b3b6-af40-4afc-b79b-352f801daede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:42.341681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070b3b6-af40-4afc-b79b-352f801daede None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:42.359377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-3070b3b6-af40-4afc-b79b-352f801daede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:42.359377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:42.359377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:42.359377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:42.359377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:42.359377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:42.359377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:42.359377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:42.359377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:42.359377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:42.359377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:42.359377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:42.359377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:42.359377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:42.359377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:42.360284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:42.360284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:42.360284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:42.360284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:42.360284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:42.360284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:42.360284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:42.360284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:42.360284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:42.360284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:42.360284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:42.360284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:42.360284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:42.360284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:42.360284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:42.360284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:42.360284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:42.361184 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:42.361184 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:42.361184 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:42.361184 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:42.361184 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 280/569] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:42.361462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070b3b6-af40-4afc-b79b-352f801daede None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:42.411420 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12a155-6a2b-4f70-996b-9757b6402ebf None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:42.424592 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:42.447790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4aef22-35cc-4d34-80ef-7cc418a9bf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:42.449183 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aef22-35cc-4d34-80ef-7cc418a9bf6e None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:42.449559 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aef22-35cc-4d34-80ef-7cc418a9bf6e None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:42.449831 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aef22-35cc-4d34-80ef-7cc418a9bf6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:42.460472 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4aef22-35cc-4d34-80ef-7cc418a9bf6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:42.461939 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4aef22-35cc-4d34-80ef-7cc418a9bf6e None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:42.469568 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070b3b6-af40-4afc-b79b-352f801daede None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:42.479109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-5b4aef22-35cc-4d34-80ef-7cc418a9bf6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:42.479109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:42.479109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:42.479109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:42.479109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:42.479109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:42.479109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:42.479109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:42.479109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:42.479109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:42.479109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:42.479109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:42.479109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:42.479109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:42.479109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:42.480524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:42.480524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:42.480524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:42.480524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:42.480524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:42.480524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:42.480524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:42.480524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:42.480524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:42.480524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:42.480524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:42.480524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:42.480524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:42.480524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:42.480524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:42.480524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:42.480524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:42.481393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:42.481393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:42.481393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:42.481393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:42.481393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 290/570] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:42.482529 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4aef22-35cc-4d34-80ef-7cc418a9bf6e None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:42.509179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8121f-ae00-4ab6-ae94-9f32d1b77384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:42.509904 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8121f-ae00-4ab6-ae94-9f32d1b77384 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:42.510529 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8121f-ae00-4ab6-ae94-9f32d1b77384 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:42.510529 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8121f-ae00-4ab6-ae94-9f32d1b77384 None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:42.511293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8121f-ae00-4ab6-ae94-9f32d1b77384 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:42.511598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8121f-ae00-4ab6-ae94-9f32d1b77384 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:42.513032 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8121f-ae00-4ab6-ae94-9f32d1b77384 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:42.529615 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 281/571] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:19:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:42.529615 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8121f-ae00-4ab6-ae94-9f32d1b77384 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:42.544696 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:42.595306 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4aef22-35cc-4d34-80ef-7cc418a9bf6e None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:42.629239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c6664-f564-4683-8a44-6f5605d68970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:42.629933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c6664-f564-4683-8a44-6f5605d68970 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:42.630209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c6664-f564-4683-8a44-6f5605d68970 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:42.630481 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c6664-f564-4683-8a44-6f5605d68970 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:42.631204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c6664-f564-4683-8a44-6f5605d68970 None admin] RBAC: Adding query filter params (name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:42.631506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c6664-f564-4683-8a44-6f5605d68970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:42.632891 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c6664-f564-4683-8a44-6f5605d68970 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:42.635380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8121f-ae00-4ab6-ae94-9f32d1b77384 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:42.640691 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 291/572] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:19:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:42.641460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c6664-f564-4683-8a44-6f5605d68970 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:42.652294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:42.669727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d441a-9471-40bf-adc8-71d95dca56da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:42.670380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d441a-9471-40bf-adc8-71d95dca56da None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:42.670666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d441a-9471-40bf-adc8-71d95dca56da None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:42.670945 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d441a-9471-40bf-adc8-71d95dca56da None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:42.671670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d441a-9471-40bf-adc8-71d95dca56da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:42.671980 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d441a-9471-40bf-adc8-71d95dca56da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:42.673425 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d441a-9471-40bf-adc8-71d95dca56da None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:42.686487 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 282/573] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:42.687223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d441a-9471-40bf-adc8-71d95dca56da None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:42.740344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c6664-f564-4683-8a44-6f5605d68970 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:42.758974 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:42.778399 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785d75c-2db3-43e7-97c2-90fa7125edd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:42.779057 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785d75c-2db3-43e7-97c2-90fa7125edd4 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:42.779349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785d75c-2db3-43e7-97c2-90fa7125edd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:42.779616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785d75c-2db3-43e7-97c2-90fa7125edd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:42.780326 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785d75c-2db3-43e7-97c2-90fa7125edd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:42.780631 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785d75c-2db3-43e7-97c2-90fa7125edd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:42.782024 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785d75c-2db3-43e7-97c2-90fa7125edd4 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:42.787013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d441a-9471-40bf-adc8-71d95dca56da None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:42.794743 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 292/574] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:42.795870 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dc801-12a9-43ef-a443-065b1b270645 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:42.796153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dc801-12a9-43ef-a443-065b1b270645 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:42.796425 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dc801-12a9-43ef-a443-065b1b270645 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:42.799228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 293/575] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:42.799228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dc801-12a9-43ef-a443-065b1b270645 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:42.822906 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78648e-2f8d-49c5-99b0-d4cab7ef7933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:42.823546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78648e-2f8d-49c5-99b0-d4cab7ef7933 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:42.823823 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78648e-2f8d-49c5-99b0-d4cab7ef7933 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:42.824097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78648e-2f8d-49c5-99b0-d4cab7ef7933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:42.824945 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78648e-2f8d-49c5-99b0-d4cab7ef7933 None admin] RBAC: Adding query filter params (role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=e349e5dfcd74406b922d3d1ce0fa5ef4) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:42.825245 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78648e-2f8d-49c5-99b0-d4cab7ef7933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:42.826698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78648e-2f8d-49c5-99b0-d4cab7ef7933 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:42.832024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 283/576] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:19:42 2022] GET /identity/v3/role_assignments?user.id=e349e5dfcd74406b922d3d1ce0fa5ef4&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:42.832956 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78648e-2f8d-49c5-99b0-d4cab7ef7933 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:42.879237 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:42.919342 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dc801-12a9-43ef-a443-065b1b270645 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:42.941167 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78648e-2f8d-49c5-99b0-d4cab7ef7933 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:42.959080 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549beaf6-6994-4f79-ab5f-0d7be19ab8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:42.959885 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549beaf6-6994-4f79-ab5f-0d7be19ab8df None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:42.960165 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549beaf6-6994-4f79-ab5f-0d7be19ab8df None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:42.960434 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549beaf6-6994-4f79-ab5f-0d7be19ab8df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:42.973307 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549beaf6-6994-4f79-ab5f-0d7be19ab8df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:42.974850 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549beaf6-6994-4f79-ab5f-0d7be19ab8df None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:42.981024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372b849a-e243-445d-a299-1288eb5b7bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:42.981884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b849a-e243-445d-a299-1288eb5b7bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:42.982166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b849a-e243-445d-a299-1288eb5b7bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:42.982436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b849a-e243-445d-a299-1288eb5b7bf3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:42.990817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b849a-e243-445d-a299-1288eb5b7bf3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:42.992249 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372b849a-e243-445d-a299-1288eb5b7bf3 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:42.996349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-549beaf6-6994-4f79-ab5f-0d7be19ab8df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:42.996349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:42.996349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:42.996349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:42.996349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:42.996349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:42.996349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:42.996349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:42.996349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:42.996349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:42.996349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:42.996349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:42.996349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:42.996349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:42.996349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:42.997231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:42.997231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:42.997231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:42.997231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:42.997231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:42.997231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:42.997231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:42.997231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:42.997231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:42.997231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:42.997231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:42.997231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:42.997231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:42.997231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:42.997231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:42.997231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:42.997231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:42.998182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:42.998182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:42.998182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:42.998182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:42.998182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 294/577] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:42.998182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549beaf6-6994-4f79-ab5f-0d7be19ab8df None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:43.008612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-372b849a-e243-445d-a299-1288eb5b7bf3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:19:43.008612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:43.008612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:43.008612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:43.008612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:43.008612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:43.008612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:43.008612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:43.008612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:43.008612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:43.008612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:43.008612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:43.008612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:19:43.008612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:19:43.008612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:19:43.008612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:19:43.009727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:43.009727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:43.009727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:19:43.009727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:43.009727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:19:43.009727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:43.009727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:43.009727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:43.009727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:43.009727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:43.009727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:43.009727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:43.009727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:43.009727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:43.009727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:43.009727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:43.009727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:43.009727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:43.010839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:43.010839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:43.010839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:19:43.010839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:19:43.010839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:19:43.010839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:19:43.010839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:19:43.010839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:19:43.010839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:19:43.010839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:43.010839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 284/578] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Jul 21 08:19:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:43.014800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280527d-943d-4906-b94c-765345df59dc None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:43.015081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280527d-943d-4906-b94c-765345df59dc None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:43.015348 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280527d-943d-4906-b94c-765345df59dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:43.034204 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-6280527d-943d-4906-b94c-765345df59dc None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:43.034532 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:43.035426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-6280527d-943d-4906-b94c-765345df59dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:43.106358 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 285/579] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:43.107376 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280527d-943d-4906-b94c-765345df59dc None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:43.118328 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549beaf6-6994-4f79-ab5f-0d7be19ab8df None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:43.147885 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:43.157056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68d4bd-a14c-4c99-a4a9-1e3cd88cb13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:43.157846 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68d4bd-a14c-4c99-a4a9-1e3cd88cb13b None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:43.164569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68d4bd-a14c-4c99-a4a9-1e3cd88cb13b None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:43.164569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68d4bd-a14c-4c99-a4a9-1e3cd88cb13b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:43.165634 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68d4bd-a14c-4c99-a4a9-1e3cd88cb13b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:43.167069 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68d4bd-a14c-4c99-a4a9-1e3cd88cb13b None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:43.181614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-dd68d4bd-a14c-4c99-a4a9-1e3cd88cb13b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:43.181614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:43.181614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:43.181614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:43.181614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:43.181614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:43.181614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:43.181614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:43.181614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:43.181614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:43.181614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:43.181614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:43.181614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:19:43.181614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:19:43.181614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:19:43.182530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:19:43.182530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:43.182530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:43.182530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:43.182530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:43.182530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:43.182530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:43.182530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:43.182530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:43.182530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:43.182530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:43.182530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:43.182530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:43.182530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:43.182530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:43.182530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:43.182530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:43.183460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:19:43.183460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:19:43.183460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:19:43.183460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:19:43.183460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:19:43.183460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:19:43.183460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:43.183460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:43.183460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 295/580] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:43.183460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68d4bd-a14c-4c99-a4a9-1e3cd88cb13b None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:43.228141 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280527d-943d-4906-b94c-765345df59dc None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:43.262896 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411aa075-69f2-4bfc-839e-bc8e4349740d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:43.263548 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aa075-69f2-4bfc-839e-bc8e4349740d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:43.263829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aa075-69f2-4bfc-839e-bc8e4349740d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:43.264101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aa075-69f2-4bfc-839e-bc8e4349740d None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:43.264826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411aa075-69f2-4bfc-839e-bc8e4349740d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:43.265128 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411aa075-69f2-4bfc-839e-bc8e4349740d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:43.266532 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411aa075-69f2-4bfc-839e-bc8e4349740d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:43.279034 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 286/581] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:43.280025 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411aa075-69f2-4bfc-839e-bc8e4349740d None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:43.284818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:43.299715 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68d4bd-a14c-4c99-a4a9-1e3cd88cb13b None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:43.337493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace29cb7-4f19-48c9-92e1-c0dd283e78c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:43.338186 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace29cb7-4f19-48c9-92e1-c0dd283e78c6 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:43.338469 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace29cb7-4f19-48c9-92e1-c0dd283e78c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:43.338752 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace29cb7-4f19-48c9-92e1-c0dd283e78c6 None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:43.340144 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace29cb7-4f19-48c9-92e1-c0dd283e78c6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:43.340460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace29cb7-4f19-48c9-92e1-c0dd283e78c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:43.341911 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace29cb7-4f19-48c9-92e1-c0dd283e78c6 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:43.359687 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 296/582] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Jul 21 08:19:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:43.364815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace29cb7-4f19-48c9-92e1-c0dd283e78c6 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:43.378168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:43.388889 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411aa075-69f2-4bfc-839e-bc8e4349740d None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:43.424968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a2200-9c7e-43fd-81b8-9fbfa85786e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:43.425782 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a2200-9c7e-43fd-81b8-9fbfa85786e4 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:43.426056 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a2200-9c7e-43fd-81b8-9fbfa85786e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:43.426330 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a2200-9c7e-43fd-81b8-9fbfa85786e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:43.437348 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a2200-9c7e-43fd-81b8-9fbfa85786e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:43.444873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-862a2200-9c7e-43fd-81b8-9fbfa85786e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:43.444873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:43.444873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:43.444873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:43.444873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:43.444873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:43.444873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:43.444873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:43.444873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:43.444873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:43.444873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:43.444873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:43.444873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:43.444873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:43.444873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:43.444873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:43.445846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:43.445846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:43.445846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:43.445846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:43.445846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:43.445846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:43.445846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:43.445846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:43.445846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:43.445846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:43.445846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:43.445846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:43.445846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:43.445846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:43.445846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:43.445846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:43.446669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:43.446669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:43.446669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:43.446669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:43.446669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:43.446669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:43.446669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:43.446669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:43.446669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:43.446669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:43.446669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:43.446669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:43.446669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 287/583] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:19:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:43.448235 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a2200-9c7e-43fd-81b8-9fbfa85786e4 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:43.471755 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace29cb7-4f19-48c9-92e1-c0dd283e78c6 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:43.507525 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fae9c6-363c-40b5-b31a-9c824a68633d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:43.508122 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fae9c6-363c-40b5-b31a-9c824a68633d None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:43.508401 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fae9c6-363c-40b5-b31a-9c824a68633d None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:43.509020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fae9c6-363c-40b5-b31a-9c824a68633d None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:43.509430 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fae9c6-363c-40b5-b31a-9c824a68633d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:43.509765 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fae9c6-363c-40b5-b31a-9c824a68633d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:43.511725 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fae9c6-363c-40b5-b31a-9c824a68633d None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:43.523921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 297/584] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:19:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:43.524545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fae9c6-363c-40b5-b31a-9c824a68633d None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:43.529277 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:43.562755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a2200-9c7e-43fd-81b8-9fbfa85786e4 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:43.597839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7faef9-eab6-4dc2-b8c1-8cd42ebf2e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:43.599017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7faef9-eab6-4dc2-b8c1-8cd42ebf2e37 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:43.599017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7faef9-eab6-4dc2-b8c1-8cd42ebf2e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:43.599231 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7faef9-eab6-4dc2-b8c1-8cd42ebf2e37 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:43.607226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7faef9-eab6-4dc2-b8c1-8cd42ebf2e37 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:43.608733 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7faef9-eab6-4dc2-b8c1-8cd42ebf2e37 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:43.623333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-8b7faef9-eab6-4dc2-b8c1-8cd42ebf2e37 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:19:43.623333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:43.623333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:43.623333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:43.623333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:43.623333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:43.623333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:43.623333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:43.623333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:43.623333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:43.623333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:43.623333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:43.623333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:19:43.623333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:19:43.623333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:19:43.623333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:19:43.624273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:43.624273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:43.624273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:19:43.624273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:43.624273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:19:43.624273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:43.624273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:43.624273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:43.624273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:43.624273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:43.624273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:43.624273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:43.624273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:43.624273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:43.624273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:43.624273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:43.624273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:43.624273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:43.625224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:43.625224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:43.625224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:19:43.625224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:19:43.625224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:19:43.625224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:19:43.625224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:19:43.625224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:19:43.625224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:19:43.625224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:43.625224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 288/585] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:43.625224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7faef9-eab6-4dc2-b8c1-8cd42ebf2e37 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:43.634853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fae9c6-363c-40b5-b31a-9c824a68633d None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:43.641119 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:43.670717 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77daee48-6165-40dc-adb7-497789a7cc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:43.671711 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77daee48-6165-40dc-adb7-497789a7cc68 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:43.671824 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77daee48-6165-40dc-adb7-497789a7cc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:43.672039 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77daee48-6165-40dc-adb7-497789a7cc68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:43.683408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77daee48-6165-40dc-adb7-497789a7cc68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:43.684819 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77daee48-6165-40dc-adb7-497789a7cc68 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:43.702100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-77daee48-6165-40dc-adb7-497789a7cc68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:43.702100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:43.702100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:43.702100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:43.702100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:43.702100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:43.702100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:43.702100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:43.702100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:43.702100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:43.702100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:43.702100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:43.702100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:43.702100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:43.702100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:43.702993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:43.702993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:43.702993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:43.702993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:43.702993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:43.702993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:43.702993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:43.702993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:43.702993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:43.702993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:43.702993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:43.702993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:43.702993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:43.702993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:43.702993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:43.702993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:43.702993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:43.703886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:43.703886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:43.703886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:43.703886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:43.703886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 298/586] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:43.704169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77daee48-6165-40dc-adb7-497789a7cc68 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:43.737168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7faef9-eab6-4dc2-b8c1-8cd42ebf2e37 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:43.773269 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd614db-377d-4008-8f54-682f468e5c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:43.773994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd614db-377d-4008-8f54-682f468e5c47 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:43.774275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd614db-377d-4008-8f54-682f468e5c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:43.774556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd614db-377d-4008-8f54-682f468e5c47 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:43.775028 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:43.775300 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd614db-377d-4008-8f54-682f468e5c47 None admin] RBAC: Adding query filter params (name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:43.775609 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd614db-377d-4008-8f54-682f468e5c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:43.776986 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd614db-377d-4008-8f54-682f468e5c47 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:43.789720 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 289/587] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:19:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:43.789720 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd614db-377d-4008-8f54-682f468e5c47 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:43.831102 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77daee48-6165-40dc-adb7-497789a7cc68 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:43.866438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd208738-b93a-4bfb-9a75-0a7b219305fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:43.867333 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd208738-b93a-4bfb-9a75-0a7b219305fe None admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:43.867618 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd208738-b93a-4bfb-9a75-0a7b219305fe None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:43.867895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd208738-b93a-4bfb-9a75-0a7b219305fe None admin] PATH_INFO: `/v3/projects/83100b3a5d584e39886c234391fdb204/users/2b27a4861d6b4ddfaca1a97efdaf008d/roles/9bbdc03bd7dc4b7fb84bb74bf49e49d4` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:43.869444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:43.883729 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd208738-b93a-4bfb-9a75-0a7b219305fe None admin] RBAC: Authorizing `identity:create_grant(project_id=83100b3a5d584e39886c234391fdb204, user_id=2b27a4861d6b4ddfaca1a97efdaf008d, role_id=9bbdc03bd7dc4b7fb84bb74bf49e49d4)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:43.885184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd208738-b93a-4bfb-9a75-0a7b219305fe None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:43.899092 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd614db-377d-4008-8f54-682f468e5c47 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:43.932699 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d28bf-5963-417e-967d-84f6e96517d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:43.933934 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d28bf-5963-417e-967d-84f6e96517d5 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:43.934230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d28bf-5963-417e-967d-84f6e96517d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:43.934494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d28bf-5963-417e-967d-84f6e96517d5 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:43.935350 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d28bf-5963-417e-967d-84f6e96517d5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:43.935663 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d28bf-5963-417e-967d-84f6e96517d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:43.937116 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d28bf-5963-417e-967d-84f6e96517d5 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:43.955482 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 290/588] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Jul 21 08:19:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:43.956294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d28bf-5963-417e-967d-84f6e96517d5 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:43.971766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 299/589] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:19:43 2022] PUT /identity/v3/projects/83100b3a5d584e39886c234391fdb204/users/2b27a4861d6b4ddfaca1a97efdaf008d/roles/9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:19:43.973300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd208738-b93a-4bfb-9a75-0a7b219305fe None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:44.087578 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd208738-b93a-4bfb-9a75-0a7b219305fe None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:44.096112 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:44.110151 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d28bf-5963-417e-967d-84f6e96517d5 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:44.126885 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ca915-3d05-4c3e-9bf9-0ad7b8f293d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:44.127695 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ca915-3d05-4c3e-9bf9-0ad7b8f293d1 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:44.128036 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ca915-3d05-4c3e-9bf9-0ad7b8f293d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:44.128319 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ca915-3d05-4c3e-9bf9-0ad7b8f293d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:44.140228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ca915-3d05-4c3e-9bf9-0ad7b8f293d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:44.141893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ca915-3d05-4c3e-9bf9-0ad7b8f293d1 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:44.156539 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:44.162768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f26a3f-aa16-429c-8c51-e18f3b8e5a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:44.163000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-7e1ca915-3d05-4c3e-9bf9-0ad7b8f293d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:44.163000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:44.163000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:44.163000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:44.163000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:44.163000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:44.163000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:44.163000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:44.163000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:44.163000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:44.163000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:44.163000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:44.163000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:44.163000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:44.163000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:44.163912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:44.163912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:44.163912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:44.163912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:44.163912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:44.163912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:44.163912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:44.163912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:44.163912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:44.163912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:44.163912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:44.163912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:44.163912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:44.163912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:44.163912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:44.163912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:44.163912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:44.164797 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:44.164797 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:44.164797 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:44.164797 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:44.165024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f26a3f-aa16-429c-8c51-e18f3b8e5a8e None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:44.165024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f26a3f-aa16-429c-8c51-e18f3b8e5a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:44.165024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f26a3f-aa16-429c-8c51-e18f3b8e5a8e None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:44.165024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f26a3f-aa16-429c-8c51-e18f3b8e5a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:44.165255 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f26a3f-aa16-429c-8c51-e18f3b8e5a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:44.165764 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 300/590] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:44.166593 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ca915-3d05-4c3e-9bf9-0ad7b8f293d1 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:44.166696 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f26a3f-aa16-429c-8c51-e18f3b8e5a8e None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:44.180208 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 291/591] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:44.181042 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f26a3f-aa16-429c-8c51-e18f3b8e5a8e None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:44.298030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f26a3f-aa16-429c-8c51-e18f3b8e5a8e None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:44.310518 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ca915-3d05-4c3e-9bf9-0ad7b8f293d1 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:44.334392 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16deda9-e0cd-4184-9077-7624ffa1f580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:44.335012 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16deda9-e0cd-4184-9077-7624ffa1f580 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:44.335301 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16deda9-e0cd-4184-9077-7624ffa1f580 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:44.335571 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16deda9-e0cd-4184-9077-7624ffa1f580 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:44.336291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16deda9-e0cd-4184-9077-7624ffa1f580 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:44.336594 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16deda9-e0cd-4184-9077-7624ffa1f580 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:44.338028 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16deda9-e0cd-4184-9077-7624ffa1f580 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:44.351515 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 292/592] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:44.352667 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16deda9-e0cd-4184-9077-7624ffa1f580 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:44.360823 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fafe0-1af5-497d-9bcf-97c5499d63e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:44.361742 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fafe0-1af5-497d-9bcf-97c5499d63e5 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:44.363319 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fafe0-1af5-497d-9bcf-97c5499d63e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:44.363319 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fafe0-1af5-497d-9bcf-97c5499d63e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:44.380586 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fafe0-1af5-497d-9bcf-97c5499d63e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:44.383218 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fafe0-1af5-497d-9bcf-97c5499d63e5 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:44.409808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-ae4fafe0-1af5-497d-9bcf-97c5499d63e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:44.409808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:44.409808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:44.409808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:44.409808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:44.409808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:44.409808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:44.409808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:44.409808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:44.409808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:44.409808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:44.409808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:44.409808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:44.409808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:44.409808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:44.410754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:44.410754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:44.410754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:44.410754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:44.410754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:44.410754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:44.410754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:44.410754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:44.410754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:44.410754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:44.410754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:44.410754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:44.410754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:44.410754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:44.410754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:44.410754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:44.410754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:44.411650 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:44.411650 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:44.411650 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:44.411650 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:44.414192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 301/593] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:44.415194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fafe0-1af5-497d-9bcf-97c5499d63e5 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:44.420139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:44.435296 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:44.469093 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16deda9-e0cd-4184-9077-7624ffa1f580 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:44.516469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f676d5-4e35-423d-a492-c80e3990e5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:44.517287 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f676d5-4e35-423d-a492-c80e3990e5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:44.517595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f676d5-4e35-423d-a492-c80e3990e5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:44.517876 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f676d5-4e35-423d-a492-c80e3990e5c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:44.527784 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f676d5-4e35-423d-a492-c80e3990e5c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:44.529623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f676d5-4e35-423d-a492-c80e3990e5c5 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:44.541180 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fafe0-1af5-497d-9bcf-97c5499d63e5 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:44.548407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-b4f676d5-4e35-423d-a492-c80e3990e5c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:44.548407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:44.548407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:44.548407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:44.548407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:44.548407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:44.548407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:44.548407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:44.548407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:44.548407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:44.548407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:44.548407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:44.548407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:19:44.548407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:19:44.548407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:19:44.549286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:19:44.549286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:44.549286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:44.549286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:44.549286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:44.549286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:44.549286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:44.549286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:44.549286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:44.549286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:44.549286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:44.549286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:44.549286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:44.549286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:44.549286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:44.549286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:44.549286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:44.550194 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:19:44.550194 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:19:44.550194 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:19:44.550194 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:19:44.550194 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:19:44.550194 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:19:44.550194 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:44.550194 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:44.553605 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 293/594] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:44.554643 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f676d5-4e35-423d-a492-c80e3990e5c5 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:44.592843 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1945b0-61c7-44dd-9979-d905fdb6b10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:44.594129 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1945b0-61c7-44dd-9979-d905fdb6b10a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:44.594802 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1945b0-61c7-44dd-9979-d905fdb6b10a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:44.594802 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1945b0-61c7-44dd-9979-d905fdb6b10a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:44.604351 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1945b0-61c7-44dd-9979-d905fdb6b10a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:44.606882 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1945b0-61c7-44dd-9979-d905fdb6b10a None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:44.626774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-7e1945b0-61c7-44dd-9979-d905fdb6b10a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 08:19:44.626774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:44.626774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:44.626774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:44.626774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:44.626774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:44.626774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:44.626774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:44.626774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:44.626774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:44.626774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:44.626774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:44.626774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:19:44.626774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:19:44.626774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:19:44.626774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:19:44.627783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:44.627783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:44.627783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:19:44.627783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:44.627783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:19:44.627783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:44.627783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:44.627783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:44.627783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:44.627783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:44.627783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:44.627783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:44.627783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:44.627783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:44.627783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:44.627783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:44.627783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:44.627783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:44.628722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:44.628722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:44.628722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:19:44.628722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:19:44.628722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:19:44.628722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:19:44.628722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:19:44.628722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:19:44.628722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 08:19:44.628722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:44.632919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 302/595] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:19:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:44.634168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1945b0-61c7-44dd-9979-d905fdb6b10a None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:44.674010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f676d5-4e35-423d-a492-c80e3990e5c5 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:44.693144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:44.718273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:44.722929 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc07b75-dd04-41f8-8d7f-657acd15bcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:44.723600 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc07b75-dd04-41f8-8d7f-657acd15bcf0 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:44.723908 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc07b75-dd04-41f8-8d7f-657acd15bcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:44.724191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc07b75-dd04-41f8-8d7f-657acd15bcf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:44.724930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc07b75-dd04-41f8-8d7f-657acd15bcf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:44.725239 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc07b75-dd04-41f8-8d7f-657acd15bcf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:44.727348 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc07b75-dd04-41f8-8d7f-657acd15bcf0 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:44.751005 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 294/596] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:44.751005 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc07b75-dd04-41f8-8d7f-657acd15bcf0 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:44.762747 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1945b0-61c7-44dd-9979-d905fdb6b10a None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:44.802838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc92b83-b5dc-4b32-9a51-35e292d32bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:44.803880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc92b83-b5dc-4b32-9a51-35e292d32bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:44.804408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc92b83-b5dc-4b32-9a51-35e292d32bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:44.804876 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc92b83-b5dc-4b32-9a51-35e292d32bb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:44.805958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc92b83-b5dc-4b32-9a51-35e292d32bb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:44.806488 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc92b83-b5dc-4b32-9a51-35e292d32bb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:44.808924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc92b83-b5dc-4b32-9a51-35e292d32bb8 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:44.822291 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 303/597] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:19:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:44.823542 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc92b83-b5dc-4b32-9a51-35e292d32bb8 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:44.880342 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc07b75-dd04-41f8-8d7f-657acd15bcf0 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:44.915287 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e08e7d-90dc-4659-85c3-47a471226d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:44.916099 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e08e7d-90dc-4659-85c3-47a471226d5a None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:44.916377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e08e7d-90dc-4659-85c3-47a471226d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:44.916650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e08e7d-90dc-4659-85c3-47a471226d5a None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:44.918048 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e08e7d-90dc-4659-85c3-47a471226d5a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:44.918354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e08e7d-90dc-4659-85c3-47a471226d5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:44.919774 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e08e7d-90dc-4659-85c3-47a471226d5a None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:44.932756 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc92b83-b5dc-4b32-9a51-35e292d32bb8 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:44.944170 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 295/598] 10.222.0.57 () {56 vars in 1139 bytes} [Thu Jul 21 08:19:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:44.944170 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e08e7d-90dc-4659-85c3-47a471226d5a None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:44.966672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:44.972605 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce6f8a-0cf1-4e63-8271-50d7ad1470a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:44.973395 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce6f8a-0cf1-4e63-8271-50d7ad1470a1 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:44.973700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce6f8a-0cf1-4e63-8271-50d7ad1470a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:44.973894 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:44.973977 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce6f8a-0cf1-4e63-8271-50d7ad1470a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:44.981461 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce6f8a-0cf1-4e63-8271-50d7ad1470a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:44.982940 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce6f8a-0cf1-4e63-8271-50d7ad1470a1 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:44.997598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-10ce6f8a-0cf1-4e63-8271-50d7ad1470a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:44.997598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:44.997598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:44.997598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:44.997598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:44.997598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:44.997598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:44.997598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:44.997598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:44.997598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:44.997598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:44.997598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:44.997598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:19:44.997598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:19:44.997598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:19:44.998590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:19:44.998590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:44.998590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:44.998590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:44.998590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:44.998590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:44.998590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:44.998590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:44.998590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:44.998590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:44.998590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:44.998590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:44.998590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:44.998590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:44.998590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:44.998590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:44.998590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:45.004561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:19:45.004561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:19:45.004561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:19:45.004561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:19:45.004561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:19:45.004561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:19:45.004561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:45.004561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:45.004561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 304/599] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:45.004561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34e4c4-3232-4acf-bcc2-f36e98f7cdb4 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:45.004561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34e4c4-3232-4acf-bcc2-f36e98f7cdb4 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:45.005192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e34e4c4-3232-4acf-bcc2-f36e98f7cdb4 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:45.006819 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 305/600] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:45.007532 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34e4c4-3232-4acf-bcc2-f36e98f7cdb4 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:45.050991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e08e7d-90dc-4659-85c3-47a471226d5a None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:45.085024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b787e9f-25e5-427d-be72-0b879a272285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:45.085930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b787e9f-25e5-427d-be72-0b879a272285 None admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:45.086211 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b787e9f-25e5-427d-be72-0b879a272285 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:45.086480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b787e9f-25e5-427d-be72-0b879a272285 None admin] PATH_INFO: `/v3/projects/83100b3a5d584e39886c234391fdb204/users/b6670a010c034f7999c9445452c02473/roles/9bbdc03bd7dc4b7fb84bb74bf49e49d4` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:45.102810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b787e9f-25e5-427d-be72-0b879a272285 None admin] RBAC: Authorizing `identity:create_grant(project_id=83100b3a5d584e39886c234391fdb204, user_id=b6670a010c034f7999c9445452c02473, role_id=9bbdc03bd7dc4b7fb84bb74bf49e49d4)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:45.104245 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b787e9f-25e5-427d-be72-0b879a272285 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:45.117840 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e34e4c4-3232-4acf-bcc2-f36e98f7cdb4 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:45.150954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06014a-e8b5-4ebd-8279-7c48652b2cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:45.152173 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06014a-e8b5-4ebd-8279-7c48652b2cee None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:45.152450 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06014a-e8b5-4ebd-8279-7c48652b2cee None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:45.152797 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06014a-e8b5-4ebd-8279-7c48652b2cee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:45.162847 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06014a-e8b5-4ebd-8279-7c48652b2cee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:45.164398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06014a-e8b5-4ebd-8279-7c48652b2cee None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:45.185396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 296/601] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:19:44 2022] PUT /identity/v3/projects/83100b3a5d584e39886c234391fdb204/users/b6670a010c034f7999c9445452c02473/roles/9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:19:45.185396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b787e9f-25e5-427d-be72-0b879a272285 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:45.186043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-3f06014a-e8b5-4ebd-8279-7c48652b2cee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:45.186043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:45.186043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:45.186043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:45.186043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:45.186043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:45.186043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:45.186043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:45.186043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:45.186043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:45.186043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:45.186043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:45.186043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:45.186043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:45.186043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:45.186837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:45.186837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:45.186837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:45.186837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:45.186837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:45.186837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:45.186837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:45.186837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:45.186837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:45.186837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:45.186837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:45.186837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:45.186837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:45.186837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:45.186837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:45.186837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:45.186837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:45.187716 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:45.187716 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:45.187716 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:45.187716 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:45.187716 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 306/602] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:45.187716 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491f320-4af4-4732-a73a-ba07af81388b None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:45.187716 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491f320-4af4-4732-a73a-ba07af81388b None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:45.187716 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491f320-4af4-4732-a73a-ba07af81388b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:45.208522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-8491f320-4af4-4732-a73a-ba07af81388b None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:45.209862 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-8491f320-4af4-4732-a73a-ba07af81388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:45.254688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:45.295417 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 307/603] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:45.296545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491f320-4af4-4732-a73a-ba07af81388b None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:45.300242 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:45.326587 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b787e9f-25e5-427d-be72-0b879a272285 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:45.378146 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc1f5c-74ca-469a-a676-19438ce0e563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:45.378824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc1f5c-74ca-469a-a676-19438ce0e563 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:45.379107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc1f5c-74ca-469a-a676-19438ce0e563 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:45.379382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc1f5c-74ca-469a-a676-19438ce0e563 None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:45.381082 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc1f5c-74ca-469a-a676-19438ce0e563 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:45.381082 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc1f5c-74ca-469a-a676-19438ce0e563 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:45.382487 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc1f5c-74ca-469a-a676-19438ce0e563 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:45.398195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 297/604] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:19:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:45.398195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc1f5c-74ca-469a-a676-19438ce0e563 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:45.424514 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491f320-4af4-4732-a73a-ba07af81388b None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:45.467261 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7e250-d545-45da-9ad1-15ec12277bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:45.468038 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7e250-d545-45da-9ad1-15ec12277bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:45.468328 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7e250-d545-45da-9ad1-15ec12277bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:45.468607 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7e250-d545-45da-9ad1-15ec12277bc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:45.469334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7e250-d545-45da-9ad1-15ec12277bc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:45.469676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7e250-d545-45da-9ad1-15ec12277bc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:45.471149 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7e250-d545-45da-9ad1-15ec12277bc1 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:45.483447 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 308/605] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:45.488644 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7e250-d545-45da-9ad1-15ec12277bc1 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:45.504895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc1f5c-74ca-469a-a676-19438ce0e563 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:45.522245 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:45.541293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31836596-38d6-46b6-8623-18542f8e71b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:45.542273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31836596-38d6-46b6-8623-18542f8e71b5 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:45.542653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31836596-38d6-46b6-8623-18542f8e71b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:45.543024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31836596-38d6-46b6-8623-18542f8e71b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:45.551123 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:45.554983 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31836596-38d6-46b6-8623-18542f8e71b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:45.562673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-31836596-38d6-46b6-8623-18542f8e71b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:45.562673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:45.562673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:45.562673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:45.562673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:45.562673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:45.562673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:45.562673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:45.562673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:45.562673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:45.562673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:45.562673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:45.562673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:45.562673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:45.562673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:45.562673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:45.563817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:45.563817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:45.563817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:45.563817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:45.563817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:45.563817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:45.563817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:45.563817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:45.563817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:45.563817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:45.563817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:45.563817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:45.563817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:45.563817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:45.563817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:45.563817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:45.564844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:45.564844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:45.564844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:45.564844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:45.564844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:45.564844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:45.564844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:45.564844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:45.564844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:45.564844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:45.564844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:45.564844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:45.566922 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 298/606] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:19:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:45.567893 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31836596-38d6-46b6-8623-18542f8e71b5 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:45.603851 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7e250-d545-45da-9ad1-15ec12277bc1 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:45.647989 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381059f5-37ff-4607-8d03-6c02c9d25254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:45.649326 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381059f5-37ff-4607-8d03-6c02c9d25254 None admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:45.649701 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381059f5-37ff-4607-8d03-6c02c9d25254 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:45.650049 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381059f5-37ff-4607-8d03-6c02c9d25254 None admin] PATH_INFO: `/v3/projects/83100b3a5d584e39886c234391fdb204/users/aebefbc2dc0244d8a5ae7d88be6b63ad/roles/9bbdc03bd7dc4b7fb84bb74bf49e49d4` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:45.669713 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381059f5-37ff-4607-8d03-6c02c9d25254 None admin] RBAC: Authorizing `identity:create_grant(project_id=83100b3a5d584e39886c234391fdb204, user_id=aebefbc2dc0244d8a5ae7d88be6b63ad, role_id=9bbdc03bd7dc4b7fb84bb74bf49e49d4)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:45.671550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381059f5-37ff-4607-8d03-6c02c9d25254 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:45.676464 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31836596-38d6-46b6-8623-18542f8e71b5 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:45.712104 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdae9c6-6113-4c9d-8ac4-612cf8981da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:45.712900 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdae9c6-6113-4c9d-8ac4-612cf8981da8 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:45.713186 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdae9c6-6113-4c9d-8ac4-612cf8981da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:45.713470 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdae9c6-6113-4c9d-8ac4-612cf8981da8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:45.721145 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdae9c6-6113-4c9d-8ac4-612cf8981da8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:45.722637 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdae9c6-6113-4c9d-8ac4-612cf8981da8 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:45.736646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-5fdae9c6-6113-4c9d-8ac4-612cf8981da8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:45.736646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:45.736646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:45.736646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:45.736646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:45.736646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:45.736646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:45.736646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:45.736646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:45.736646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:45.736646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:45.736646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:45.736646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:19:45.736646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:19:45.736646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:19:45.737595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:19:45.737595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:45.737595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:45.737595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:45.737595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:45.737595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:45.737595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:45.737595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:45.737595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:45.737595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:45.737595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:45.737595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:45.737595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:45.737595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:45.737595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:45.737595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:45.737595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:45.738469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:19:45.738469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:19:45.738469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:19:45.738469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:19:45.738469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:19:45.738469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:19:45.738469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:45.738469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:45.742708 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 299/607] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:45.743409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdae9c6-6113-4c9d-8ac4-612cf8981da8 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:45.779350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 309/608] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:19:45 2022] PUT /identity/v3/projects/83100b3a5d584e39886c234391fdb204/users/aebefbc2dc0244d8a5ae7d88be6b63ad/roles/9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:19:45.782230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381059f5-37ff-4607-8d03-6c02c9d25254 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:45.849044 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:45.893556 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:45.917138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381059f5-37ff-4607-8d03-6c02c9d25254 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:45.954678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdae9c6-6113-4c9d-8ac4-612cf8981da8 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:45.970202 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bc3f9-eade-485a-8528-0b09ef4f4a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:45.971346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bc3f9-eade-485a-8528-0b09ef4f4a3c None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:45.971631 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bc3f9-eade-485a-8528-0b09ef4f4a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:45.971908 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bc3f9-eade-485a-8528-0b09ef4f4a3c None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:45.972967 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33bc3f9-eade-485a-8528-0b09ef4f4a3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:45.973493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33bc3f9-eade-485a-8528-0b09ef4f4a3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:45.975088 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33bc3f9-eade-485a-8528-0b09ef4f4a3c None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:45.996940 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 310/609] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:19:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:45.998977 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bc3f9-eade-485a-8528-0b09ef4f4a3c None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:46.007422 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99816c52-5986-43dc-8848-6822cea2c527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:46.008092 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99816c52-5986-43dc-8848-6822cea2c527 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:46.008368 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99816c52-5986-43dc-8848-6822cea2c527 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:46.008635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99816c52-5986-43dc-8848-6822cea2c527 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:46.009383 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99816c52-5986-43dc-8848-6822cea2c527 None admin] RBAC: Adding query filter params (name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:46.009734 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99816c52-5986-43dc-8848-6822cea2c527 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:46.011705 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99816c52-5986-43dc-8848-6822cea2c527 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:46.023003 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 300/610] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:19:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:46.034586 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99816c52-5986-43dc-8848-6822cea2c527 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:46.114465 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bc3f9-eade-485a-8528-0b09ef4f4a3c None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:46.156690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e684b21-cdb0-4d42-aef2-fe219d7a46f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:46.157876 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e684b21-cdb0-4d42-aef2-fe219d7a46f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:46.158312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e684b21-cdb0-4d42-aef2-fe219d7a46f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:46.158736 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e684b21-cdb0-4d42-aef2-fe219d7a46f6 None admin] PATH_INFO: `/v3/projects/83100b3a5d584e39886c234391fdb204/users/a25749f3a7c84c50b860538d1b661901/roles/9bbdc03bd7dc4b7fb84bb74bf49e49d4` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:46.171790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:46.175221 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99816c52-5986-43dc-8848-6822cea2c527 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:46.175450 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e684b21-cdb0-4d42-aef2-fe219d7a46f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=83100b3a5d584e39886c234391fdb204, user_id=a25749f3a7c84c50b860538d1b661901, role_id=9bbdc03bd7dc4b7fb84bb74bf49e49d4)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:46.177095 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e684b21-cdb0-4d42-aef2-fe219d7a46f6 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:46.200997 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:46.212886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5f358-1eec-487d-bc0c-ded3471f64f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:46.213648 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5f358-1eec-487d-bc0c-ded3471f64f9 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:46.213959 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5f358-1eec-487d-bc0c-ded3471f64f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:46.214236 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5f358-1eec-487d-bc0c-ded3471f64f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:46.224795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5f358-1eec-487d-bc0c-ded3471f64f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:46.226273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5f358-1eec-487d-bc0c-ded3471f64f9 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:46.247169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-abb5f358-1eec-487d-bc0c-ded3471f64f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:46.247169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:46.247169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:46.247169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:46.247169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:46.247169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:46.247169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:46.247169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:46.247169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:46.247169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:46.247169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:46.247169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:46.247169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:46.247169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:46.247169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:46.248458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:46.248458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:46.248458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:46.248458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:46.248458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:46.248458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:46.248458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:46.248458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:46.248458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:46.248458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:46.248458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:46.248458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:46.248458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:46.248458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:46.248458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:46.248458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:46.248458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:46.249394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:46.249394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:46.249394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:46.249394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:46.249394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 301/612] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:46.249394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99043f-1e73-4cde-ae46-52831b914c85 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:46.249394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99043f-1e73-4cde-ae46-52831b914c85 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:46.249394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99043f-1e73-4cde-ae46-52831b914c85 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:46.250302 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 311/612] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:19:45 2022] PUT /identity/v3/projects/83100b3a5d584e39886c234391fdb204/users/a25749f3a7c84c50b860538d1b661901/roles/9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:19:46.251121 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 302/613] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:46.252679 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e684b21-cdb0-4d42-aef2-fe219d7a46f6 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:46.256128 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3431d8-fd61-40df-aa19-83fd2f86250d None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:46.256345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3431d8-fd61-40df-aa19-83fd2f86250d None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:46.256585 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3431d8-fd61-40df-aa19-83fd2f86250d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:46.290056 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-8a3431d8-fd61-40df-aa19-83fd2f86250d None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:46.291288 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-8a3431d8-fd61-40df-aa19-83fd2f86250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:46.394172 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e684b21-cdb0-4d42-aef2-fe219d7a46f6 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:46.445030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 303/614] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:46.453796 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a8cdd-087a-4bd9-94f6-c1b935f84709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:46.454815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a8cdd-087a-4bd9-94f6-c1b935f84709 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:46.455301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a8cdd-087a-4bd9-94f6-c1b935f84709 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:46.455778 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184a8cdd-087a-4bd9-94f6-c1b935f84709 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:46.456738 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a8cdd-087a-4bd9-94f6-c1b935f84709 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:46.457261 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a8cdd-087a-4bd9-94f6-c1b935f84709 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:46.458874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184a8cdd-087a-4bd9-94f6-c1b935f84709 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:46.471911 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 312/615] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:46.474105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3431d8-fd61-40df-aa19-83fd2f86250d None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:46.477187 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a8cdd-087a-4bd9-94f6-c1b935f84709 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:46.553408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:46.649929 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3431d8-fd61-40df-aa19-83fd2f86250d None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:46.657484 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:46.664131 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184a8cdd-087a-4bd9-94f6-c1b935f84709 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:46.716063 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb301e5-2499-460f-bed3-4c34858b57df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:46.716860 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb301e5-2499-460f-bed3-4c34858b57df None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:46.717141 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb301e5-2499-460f-bed3-4c34858b57df None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:46.717414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb301e5-2499-460f-bed3-4c34858b57df None admin] PATH_INFO: `/v3/users/swift` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:46.732934 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb301e5-2499-460f-bed3-4c34858b57df None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:46.734332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb301e5-2499-460f-bed3-4c34858b57df None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:46.735348 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227a19c-f019-4b93-9851-8786fd459e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:46.736136 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227a19c-f019-4b93-9851-8786fd459e9e None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:46.736408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227a19c-f019-4b93-9851-8786fd459e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:46.736672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227a19c-f019-4b93-9851-8786fd459e9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:46.767480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-fdb301e5-2499-460f-bed3-4c34858b57df None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:19:46.767480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:46.767480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:46.767480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:46.767480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:46.767480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:46.767480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:46.767480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:46.767480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:46.767480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:46.767480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:46.767480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:46.767480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:19:46.767480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:19:46.767480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:19:46.767480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:19:46.768676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:46.768676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:46.768676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:19:46.768676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:46.768676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:19:46.768676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:46.768676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:46.768676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:46.768676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:46.768676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:46.768676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:46.768676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:46.768676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:46.768676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:46.768676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:46.768676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:46.768676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:46.768676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:46.770111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:46.770111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:46.770111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:19:46.770111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:19:46.770111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:19:46.770111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:19:46.770111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:19:46.770111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:19:46.770111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:19:46.770111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:46.773989 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227a19c-f019-4b93-9851-8786fd459e9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:46.782253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-a227a19c-f019-4b93-9851-8786fd459e9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:46.782253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:46.782253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:46.782253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:46.782253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:46.782253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:46.782253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:46.782253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:46.782253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:46.782253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:46.782253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:46.782253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:46.782253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:46.782253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:46.782253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:46.782253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:46.784457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:46.784457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:46.784457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:46.784457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:46.784457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:46.784457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:46.784457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:46.784457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:46.784457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:46.784457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:46.784457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:46.784457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:46.784457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:46.784457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:46.784457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:46.784457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:46.786751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:46.786751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:46.786751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:46.786751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:46.786751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:46.786751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:46.786751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:46.786751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:46.786751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:46.786751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:46.786751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:46.786751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:46.790173 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 313/616] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:19:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:46.790173 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb301e5-2499-460f-bed3-4c34858b57df None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:46.790464 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 304/617] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:19:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:46.790464 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227a19c-f019-4b93-9851-8786fd459e9e None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:46.960658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227a19c-f019-4b93-9851-8786fd459e9e None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:46.969045 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb301e5-2499-460f-bed3-4c34858b57df None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:46.993967 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:47.024353 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5acd6-c363-4a4d-a7e5-fe128039de9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:47.025027 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5acd6-c363-4a4d-a7e5-fe128039de9d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:47.025310 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5acd6-c363-4a4d-a7e5-fe128039de9d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:47.025612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5acd6-c363-4a4d-a7e5-fe128039de9d None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:47.026365 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5acd6-c363-4a4d-a7e5-fe128039de9d None admin] RBAC: Adding query filter params (name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:47.026702 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5acd6-c363-4a4d-a7e5-fe128039de9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:47.028110 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5acd6-c363-4a4d-a7e5-fe128039de9d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:47.033706 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01992aa-d159-43c1-b59a-333b1a5d3b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:47.034405 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01992aa-d159-43c1-b59a-333b1a5d3b94 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:47.034692 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01992aa-d159-43c1-b59a-333b1a5d3b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:47.034975 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01992aa-d159-43c1-b59a-333b1a5d3b94 None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:47.035848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01992aa-d159-43c1-b59a-333b1a5d3b94 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:47.036165 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01992aa-d159-43c1-b59a-333b1a5d3b94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:47.041138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01992aa-d159-43c1-b59a-333b1a5d3b94 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:47.049064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 305/618] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:19:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:47.059071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5acd6-c363-4a4d-a7e5-fe128039de9d None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:47.069772 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 314/619] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Jul 21 08:19:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:47.075386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01992aa-d159-43c1-b59a-333b1a5d3b94 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:47.124713 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:47.249201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5acd6-c363-4a4d-a7e5-fe128039de9d None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:47.259534 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01992aa-d159-43c1-b59a-333b1a5d3b94 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:47.315857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6926e9-0001-45aa-9662-bcb5b5c805f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:47.316642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6926e9-0001-45aa-9662-bcb5b5c805f6 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:47.316923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6926e9-0001-45aa-9662-bcb5b5c805f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:47.317192 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6926e9-0001-45aa-9662-bcb5b5c805f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:47.320752 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b84f4a-b98f-4567-8c5d-9a6192ddbc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:47.321565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b84f4a-b98f-4567-8c5d-9a6192ddbc67 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:47.321847 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b84f4a-b98f-4567-8c5d-9a6192ddbc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:47.322120 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b84f4a-b98f-4567-8c5d-9a6192ddbc67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:47.338572 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6926e9-0001-45aa-9662-bcb5b5c805f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:47.340553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6926e9-0001-45aa-9662-bcb5b5c805f6 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:47.344576 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b84f4a-b98f-4567-8c5d-9a6192ddbc67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:47.346575 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b84f4a-b98f-4567-8c5d-9a6192ddbc67 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:47.381508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-bb6926e9-0001-45aa-9662-bcb5b5c805f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:47.381508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:47.381508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:47.381508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:47.381508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:47.381508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:47.381508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:47.381508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:47.381508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:47.381508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:47.381508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:47.381508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:47.381508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:47.381508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:47.381508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:47.382493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:47.382493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:47.382493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:47.382493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:47.382493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:47.382493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:47.382493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:47.382493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:47.382493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:47.382493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:47.382493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:47.382493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:47.382493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:47.382493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:47.382493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:47.382493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:47.382493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:47.384091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:47.384091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:47.384091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:47.384091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:47.384091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 306/620] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:47.385278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-f7b84f4a-b98f-4567-8c5d-9a6192ddbc67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:47.385278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:47.385278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:47.385278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:47.385278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:47.385278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:47.385278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:47.385278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:47.385278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:47.385278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:47.385278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:47.385278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:47.385278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:47.385278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:47.385278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:47.386194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:47.386194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:47.386194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:47.386194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:47.386194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:47.386194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:47.386194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:47.386194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:47.386194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:47.386194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:47.386194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:47.386194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:47.386194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:47.386194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:47.386194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:47.386194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:47.386194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:47.388174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:47.388174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:47.388174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:47.388174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:47.390935 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 315/621] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:47.396247 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6926e9-0001-45aa-9662-bcb5b5c805f6 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:47.409930 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b84f4a-b98f-4567-8c5d-9a6192ddbc67 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:47.445892 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:47.554674 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:47.579841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b84f4a-b98f-4567-8c5d-9a6192ddbc67 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:47.611699 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6926e9-0001-45aa-9662-bcb5b5c805f6 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:47.619792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7054d38-18cc-4d42-8316-d12cc9bbbc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:47.621096 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7054d38-18cc-4d42-8316-d12cc9bbbc6f None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:47.621380 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7054d38-18cc-4d42-8316-d12cc9bbbc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:47.621817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7054d38-18cc-4d42-8316-d12cc9bbbc6f None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:47.622567 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7054d38-18cc-4d42-8316-d12cc9bbbc6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:47.622876 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7054d38-18cc-4d42-8316-d12cc9bbbc6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:47.624327 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7054d38-18cc-4d42-8316-d12cc9bbbc6f None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:47.638717 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 316/622] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:47.644916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7054d38-18cc-4d42-8316-d12cc9bbbc6f None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:47.683870 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869dcfb-96e0-4353-9b0b-074721d8058d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:47.684536 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869dcfb-96e0-4353-9b0b-074721d8058d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:47.684815 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869dcfb-96e0-4353-9b0b-074721d8058d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:47.685094 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869dcfb-96e0-4353-9b0b-074721d8058d None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:47.685855 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869dcfb-96e0-4353-9b0b-074721d8058d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:47.686154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869dcfb-96e0-4353-9b0b-074721d8058d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:47.687551 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869dcfb-96e0-4353-9b0b-074721d8058d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:47.701056 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 307/623] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:47.712446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89ac4b-5db5-4e6e-adb2-771a7b6398d1 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:47.712446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89ac4b-5db5-4e6e-adb2-771a7b6398d1 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:47.712446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89ac4b-5db5-4e6e-adb2-771a7b6398d1 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:47.712446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 308/624] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:47.712446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89ac4b-5db5-4e6e-adb2-771a7b6398d1 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:47.760682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7054d38-18cc-4d42-8316-d12cc9bbbc6f None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:47.789884 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:47.802208 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956e26a-fcf6-48cc-a37d-0bcb2e552222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:47.803424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956e26a-fcf6-48cc-a37d-0bcb2e552222 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:47.803701 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956e26a-fcf6-48cc-a37d-0bcb2e552222 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:47.803982 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956e26a-fcf6-48cc-a37d-0bcb2e552222 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:47.815989 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956e26a-fcf6-48cc-a37d-0bcb2e552222 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:47.817387 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956e26a-fcf6-48cc-a37d-0bcb2e552222 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:47.823078 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89ac4b-5db5-4e6e-adb2-771a7b6398d1 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:47.832414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-1956e26a-fcf6-48cc-a37d-0bcb2e552222 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 08:19:47.832414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:47.832414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:47.832414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:47.832414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:47.832414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:47.832414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:47.832414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:47.832414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:47.832414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:47.832414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:47.832414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:47.832414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:19:47.832414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:19:47.832414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:19:47.832414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:19:47.833348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:47.833348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:47.833348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:19:47.833348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:47.833348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:19:47.833348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:47.833348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:47.833348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:47.833348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:47.833348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:47.833348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:47.833348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:47.833348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:47.833348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:47.833348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:47.833348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:47.833348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:47.833348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:47.834343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:47.834343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:47.834343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:19:47.834343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:19:47.834343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:19:47.834343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:19:47.834343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:19:47.834343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:19:47.834343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 08:19:47.834343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:47.837767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 317/625] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:47.839564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd608a0-5c32-4041-94ba-912bfa1a24c4 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:47.839883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd608a0-5c32-4041-94ba-912bfa1a24c4 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:47.840165 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd608a0-5c32-4041-94ba-912bfa1a24c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:47.857628 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-2cd608a0-5c32-4041-94ba-912bfa1a24c4 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:47.858831 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2cd608a0-5c32-4041-94ba-912bfa1a24c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:47.864747 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd3687-490e-43b2-8709-6185afa05ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:47.865632 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd3687-490e-43b2-8709-6185afa05ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:47.865919 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd3687-490e-43b2-8709-6185afa05ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:47.866250 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd3687-490e-43b2-8709-6185afa05ff9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:47.875898 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd3687-490e-43b2-8709-6185afa05ff9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:47.877970 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd3687-490e-43b2-8709-6185afa05ff9 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:47.880097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:47.897923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-7ecd3687-490e-43b2-8709-6185afa05ff9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:47.897923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:47.897923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:47.897923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:47.897923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:47.897923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:47.897923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:47.897923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:47.897923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:47.897923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:47.897923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:47.897923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:47.897923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:19:47.897923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:19:47.897923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:19:47.899063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:19:47.899063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:47.899063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:47.899063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:47.899063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:47.899063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:47.899063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:47.899063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:47.899063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:47.899063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:47.899063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:47.899063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:47.899063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:47.899063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:47.899063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:47.899063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:47.899063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:47.900039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:19:47.900039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:19:47.900039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:19:47.900039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:19:47.900039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:19:47.900039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:19:47.900039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:47.900039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:47.903130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 309/626] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:47.904151 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd3687-490e-43b2-8709-6185afa05ff9 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:47.945546 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 318/627] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:47.945546 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd608a0-5c32-4041-94ba-912bfa1a24c4 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:48.029496 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:48.037264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd3687-490e-43b2-8709-6185afa05ff9 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:48.060974 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd608a0-5c32-4041-94ba-912bfa1a24c4 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:48.071430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848b9bb-0bbb-477a-b35c-c4beac863948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:48.072031 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848b9bb-0bbb-477a-b35c-c4beac863948 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:48.072319 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848b9bb-0bbb-477a-b35c-c4beac863948 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:48.072599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848b9bb-0bbb-477a-b35c-c4beac863948 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:48.073481 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848b9bb-0bbb-477a-b35c-c4beac863948 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:48.074547 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848b9bb-0bbb-477a-b35c-c4beac863948 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:48.076043 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848b9bb-0bbb-477a-b35c-c4beac863948 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:48.097984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 310/628] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Jul 21 08:19:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:48.097984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848b9bb-0bbb-477a-b35c-c4beac863948 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:48.101443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e20e8-75c4-4869-af11-71afcde9efca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:48.102403 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e20e8-75c4-4869-af11-71afcde9efca None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:48.102686 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e20e8-75c4-4869-af11-71afcde9efca None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:48.102963 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e20e8-75c4-4869-af11-71afcde9efca None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:48.103751 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e20e8-75c4-4869-af11-71afcde9efca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:48.104064 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e20e8-75c4-4869-af11-71afcde9efca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:48.106110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e20e8-75c4-4869-af11-71afcde9efca None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:48.123014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 319/629] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:19:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:48.123014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dae9bc-aac1-4683-a1fc-159b6b313590 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:48.123014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dae9bc-aac1-4683-a1fc-159b6b313590 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:48.123014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dae9bc-aac1-4683-a1fc-159b6b313590 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:48.123014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 320/630] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:48.123014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dae9bc-aac1-4683-a1fc-159b6b313590 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:48.159744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:48.206278 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848b9bb-0bbb-477a-b35c-c4beac863948 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:48.235587 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dae9bc-aac1-4683-a1fc-159b6b313590 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:48.245594 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3319ff-4d4c-4622-b2a3-5f3a60b4ee93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:48.246591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3319ff-4d4c-4622-b2a3-5f3a60b4ee93 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:48.247018 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3319ff-4d4c-4622-b2a3-5f3a60b4ee93 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:48.247484 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3319ff-4d4c-4622-b2a3-5f3a60b4ee93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:48.258007 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3319ff-4d4c-4622-b2a3-5f3a60b4ee93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:48.265509 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:48.266279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-1a3319ff-4d4c-4622-b2a3-5f3a60b4ee93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:48.266279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:48.266279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:48.266279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:48.266279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:48.266279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:48.266279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:48.266279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:48.266279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:48.266279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:48.266279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:48.266279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:48.266279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:48.266279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:48.266279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:48.266279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:48.267195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:48.267195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:48.267195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:48.267195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:48.267195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:48.267195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:48.267195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:48.267195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:48.267195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:48.267195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:48.267195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:48.267195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:48.267195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:48.267195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:48.267195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:48.267195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:48.268035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:48.268035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:48.268035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:48.268035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:48.268035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:48.268035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:48.268035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:48.268035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:48.268035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:48.268035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:48.268035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:48.268035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:48.272158 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 311/631] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:19:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:48.272958 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3319ff-4d4c-4622-b2a3-5f3a60b4ee93 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:48.273180 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc0bfe-6016-4834-9912-52f2f0862df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:48.273868 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc0bfe-6016-4834-9912-52f2f0862df0 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:48.274155 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc0bfe-6016-4834-9912-52f2f0862df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:48.274486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc0bfe-6016-4834-9912-52f2f0862df0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:48.352359 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc0bfe-6016-4834-9912-52f2f0862df0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:48.354186 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc0bfe-6016-4834-9912-52f2f0862df0 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:48.378911 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3319ff-4d4c-4622-b2a3-5f3a60b4ee93 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:48.395985 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:48.414412 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cd039-df81-4242-af93-00584947ebd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:48.415328 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cd039-df81-4242-af93-00584947ebd1 None admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:48.415616 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cd039-df81-4242-af93-00584947ebd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:48.415897 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cd039-df81-4242-af93-00584947ebd1 None admin] PATH_INFO: `/v3/projects/83100b3a5d584e39886c234391fdb204/users/e349e5dfcd74406b922d3d1ce0fa5ef4/roles/9bbdc03bd7dc4b7fb84bb74bf49e49d4` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:48.432092 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cd039-df81-4242-af93-00584947ebd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=83100b3a5d584e39886c234391fdb204, user_id=e349e5dfcd74406b922d3d1ce0fa5ef4, role_id=9bbdc03bd7dc4b7fb84bb74bf49e49d4)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:48.433577 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826cd039-df81-4242-af93-00584947ebd1 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:48.460729 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 321/632] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:19:48.462038 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89f46f-1aa8-4d52-b1a5-d34376c667c5 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:48.462325 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89f46f-1aa8-4d52-b1a5-d34376c667c5 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:48.462791 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89f46f-1aa8-4d52-b1a5-d34376c667c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:48.478683 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-3c89f46f-1aa8-4d52-b1a5-d34376c667c5 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:48.479888 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-3c89f46f-1aa8-4d52-b1a5-d34376c667c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:48.504993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:48.514352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 312/633] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:19:48 2022] PUT /identity/v3/projects/83100b3a5d584e39886c234391fdb204/users/e349e5dfcd74406b922d3d1ce0fa5ef4/roles/9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:19:48.515436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cd039-df81-4242-af93-00584947ebd1 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:48.562157 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 322/634] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:48.563353 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89f46f-1aa8-4d52-b1a5-d34376c667c5 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:48.648858 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826cd039-df81-4242-af93-00584947ebd1 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:48.686295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89f46f-1aa8-4d52-b1a5-d34376c667c5 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:48.688536 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5515112-32e6-44e1-8e22-d13a222c3ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:48.690267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5515112-32e6-44e1-8e22-d13a222c3ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:48.690712 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5515112-32e6-44e1-8e22-d13a222c3ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:48.691139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5515112-32e6-44e1-8e22-d13a222c3ea8 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:48.692054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5515112-32e6-44e1-8e22-d13a222c3ea8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:48.692537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5515112-32e6-44e1-8e22-d13a222c3ea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:48.694116 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5515112-32e6-44e1-8e22-d13a222c3ea8 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:48.704744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 313/635] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:19:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:48.705417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5515112-32e6-44e1-8e22-d13a222c3ea8 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:48.723004 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc9542-75dd-4b6b-90c4-a919f5c9d035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:48.723803 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc9542-75dd-4b6b-90c4-a919f5c9d035 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:48.724097 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc9542-75dd-4b6b-90c4-a919f5c9d035 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:48.724369 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc9542-75dd-4b6b-90c4-a919f5c9d035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:48.736329 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc9542-75dd-4b6b-90c4-a919f5c9d035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:48.737103 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:48.737906 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc9542-75dd-4b6b-90c4-a919f5c9d035 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:48.763490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-dedc9542-75dd-4b6b-90c4-a919f5c9d035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:48.763490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:48.763490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:48.763490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:48.763490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:48.763490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:48.763490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:48.763490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:48.763490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:48.763490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:48.763490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:48.763490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:48.763490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:48.763490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:48.763490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:48.764385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:48.764385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:48.764385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:48.764385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:48.764385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:48.764385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:48.764385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:48.764385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:48.764385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:48.764385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:48.764385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:48.764385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:48.764385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:48.764385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:48.764385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:48.764385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:48.764385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:48.765328 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:48.765328 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:48.765328 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:48.765328 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:48.765328 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 323/636] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:48.766524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab5dd3-6aa4-42e0-afb1-304be1c1ba69 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:48.766810 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab5dd3-6aa4-42e0-afb1-304be1c1ba69 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:48.767086 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab5dd3-6aa4-42e0-afb1-304be1c1ba69 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:48.772258 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 324/637] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:48.772258 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab5dd3-6aa4-42e0-afb1-304be1c1ba69 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:48.786342 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:48.824149 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5515112-32e6-44e1-8e22-d13a222c3ea8 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:48.861227 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9d5a1-35b6-481c-a527-b44d649243cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:48.862148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9d5a1-35b6-481c-a527-b44d649243cd None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:48.862502 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9d5a1-35b6-481c-a527-b44d649243cd None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:48.862838 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9d5a1-35b6-481c-a527-b44d649243cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:48.875289 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d9d5a1-35b6-481c-a527-b44d649243cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:48.878503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab5dd3-6aa4-42e0-afb1-304be1c1ba69 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:48.883232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-a3d9d5a1-35b6-481c-a527-b44d649243cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:48.883232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:48.883232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:48.883232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:48.883232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:48.883232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:48.883232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:48.883232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:48.883232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:48.883232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:48.883232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:48.883232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:48.883232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:48.883232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:48.883232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:48.883232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:48.884381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:48.884381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:48.884381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:48.884381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:48.884381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:48.884381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:48.884381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:48.884381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:48.884381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:48.884381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:48.884381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:48.884381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:48.884381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:48.884381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:48.884381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:48.884381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:48.885414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:48.885414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:48.885414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:48.885414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:48.885414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:48.885414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:48.885414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:48.885414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:48.885414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:48.885414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:48.885414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:48.885414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:48.890241 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 314/638] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:19:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:48.890853 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9d5a1-35b6-481c-a527-b44d649243cd None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:48.916209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735a0a7-26e5-4d11-99d9-10675c5cf9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:48.917044 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735a0a7-26e5-4d11-99d9-10675c5cf9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:48.917405 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735a0a7-26e5-4d11-99d9-10675c5cf9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:48.917779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735a0a7-26e5-4d11-99d9-10675c5cf9f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:48.928558 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735a0a7-26e5-4d11-99d9-10675c5cf9f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:48.930044 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735a0a7-26e5-4d11-99d9-10675c5cf9f5 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:48.952265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-c735a0a7-26e5-4d11-99d9-10675c5cf9f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:48.952265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:48.952265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:48.952265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:48.952265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:48.952265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:48.952265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:48.952265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:48.952265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:48.952265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:48.952265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:48.952265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:48.952265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:48.952265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:48.952265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:48.953456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:48.953456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:48.953456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:48.953456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:48.953456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:48.953456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:48.953456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:48.953456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:48.953456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:48.953456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:48.953456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:48.953456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:48.953456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:48.953456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:48.953456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:48.953456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:48.953456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:48.954672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:48.954672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:48.954672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:48.954672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:48.955091 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 325/639] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:48.956477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f13a87-6027-440c-86fd-b9184cb36ca6 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:48.956769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f13a87-6027-440c-86fd-b9184cb36ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:48.957052 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f13a87-6027-440c-86fd-b9184cb36ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:48.973700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-75f13a87-6027-440c-86fd-b9184cb36ca6 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:48.974885 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-75f13a87-6027-440c-86fd-b9184cb36ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:48.991750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:49.006411 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9d5a1-35b6-481c-a527-b44d649243cd None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:49.042100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:49.043667 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1eaee-2cdb-47d6-a3d1-34c25ddb8c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:49.044075 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1eaee-2cdb-47d6-a3d1-34c25ddb8c4b None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:49.044354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1eaee-2cdb-47d6-a3d1-34c25ddb8c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:49.044636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1eaee-2cdb-47d6-a3d1-34c25ddb8c4b None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:49.045365 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1eaee-2cdb-47d6-a3d1-34c25ddb8c4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:49.045708 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1eaee-2cdb-47d6-a3d1-34c25ddb8c4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:49.047156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c1eaee-2cdb-47d6-a3d1-34c25ddb8c4b None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:49.049835 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 326/640] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:49.056111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f13a87-6027-440c-86fd-b9184cb36ca6 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:49.066866 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 315/641] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:49.068364 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1eaee-2cdb-47d6-a3d1-34c25ddb8c4b None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:49.167070 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f13a87-6027-440c-86fd-b9184cb36ca6 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:49.185984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1eaee-2cdb-47d6-a3d1-34c25ddb8c4b None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:49.205787 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5455d-1542-4003-8b9f-f3dcb5bfac3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:49.206559 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5455d-1542-4003-8b9f-f3dcb5bfac3e None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:49.206844 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5455d-1542-4003-8b9f-f3dcb5bfac3e None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:49.207113 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5455d-1542-4003-8b9f-f3dcb5bfac3e None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:49.207843 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5455d-1542-4003-8b9f-f3dcb5bfac3e None admin] RBAC: Adding query filter params (name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:49.208145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5455d-1542-4003-8b9f-f3dcb5bfac3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:49.209506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5455d-1542-4003-8b9f-f3dcb5bfac3e None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:49.222847 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 327/642] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:19:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:49.222847 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5455d-1542-4003-8b9f-f3dcb5bfac3e None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:49.225013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b91d2-8c31-478a-b083-cb990733ec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:49.225747 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b91d2-8c31-478a-b083-cb990733ec84 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:49.225963 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b91d2-8c31-478a-b083-cb990733ec84 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:49.226234 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b91d2-8c31-478a-b083-cb990733ec84 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:49.227216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b91d2-8c31-478a-b083-cb990733ec84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:49.228118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b91d2-8c31-478a-b083-cb990733ec84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:49.228862 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b91d2-8c31-478a-b083-cb990733ec84 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:49.241177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 316/643] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:49.242023 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b91d2-8c31-478a-b083-cb990733ec84 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:49.257740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:49.288576 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:49.331515 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5455d-1542-4003-8b9f-f3dcb5bfac3e None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:49.352511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b91d2-8c31-478a-b083-cb990733ec84 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:49.366357 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033c799-3136-4e72-9294-86e6ffc18525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:49.367257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033c799-3136-4e72-9294-86e6ffc18525 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:49.367660 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033c799-3136-4e72-9294-86e6ffc18525 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:49.368079 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033c799-3136-4e72-9294-86e6ffc18525 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:49.375642 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033c799-3136-4e72-9294-86e6ffc18525 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:49.377207 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033c799-3136-4e72-9294-86e6ffc18525 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:49.388927 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befca202-075f-42bf-8c31-c52f0cc0a253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:49.389740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befca202-075f-42bf-8c31-c52f0cc0a253 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:49.390023 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befca202-075f-42bf-8c31-c52f0cc0a253 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:49.390299 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befca202-075f-42bf-8c31-c52f0cc0a253 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:49.391668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-f033c799-3136-4e72-9294-86e6ffc18525 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:49.391668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:49.391668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:49.391668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:49.391668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:49.391668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:49.391668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:49.391668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:49.391668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:49.391668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:49.391668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:49.391668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:49.391668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:19:49.391668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:19:49.391668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:19:49.394946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:19:49.394946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:49.394946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:49.394946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:49.394946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:49.394946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:49.394946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:49.394946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:49.394946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:49.394946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:49.394946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:49.394946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:49.394946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:49.394946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:49.394946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:49.394946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:49.394946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:49.395905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:19:49.395905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:19:49.395905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:19:49.395905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:19:49.395905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:19:49.395905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:19:49.395905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:49.395905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:49.395905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 328/644] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:49.395905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033c799-3136-4e72-9294-86e6ffc18525 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:49.407460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befca202-075f-42bf-8c31-c52f0cc0a253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:49.415623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-befca202-075f-42bf-8c31-c52f0cc0a253 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:49.415623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:49.415623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:49.415623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:49.415623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:49.415623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:49.415623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:49.415623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:49.415623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:49.415623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:49.415623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:49.415623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:49.415623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:49.415623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:49.415623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:49.415623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:49.416760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:49.416760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:49.416760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:49.416760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:49.416760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:49.416760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:49.416760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:49.416760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:49.416760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:49.416760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:49.416760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:49.416760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:49.416760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:49.416760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:49.416760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:49.416760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:49.418506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:49.418506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:49.418506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:49.418506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:49.418506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:49.418506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:49.418506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:49.418506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:49.418506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:49.418506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:49.418506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:49.418506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:49.419754 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 317/645] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:19:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:49.419754 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befca202-075f-42bf-8c31-c52f0cc0a253 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:49.491213 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:49.505683 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033c799-3136-4e72-9294-86e6ffc18525 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:49.523955 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:49.525984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befca202-075f-42bf-8c31-c52f0cc0a253 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:49.543560 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb992d-8aed-4020-acfd-19db16f69207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:49.544348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb992d-8aed-4020-acfd-19db16f69207 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:49.544635 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb992d-8aed-4020-acfd-19db16f69207 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:49.544928 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb992d-8aed-4020-acfd-19db16f69207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:49.555282 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb992d-8aed-4020-acfd-19db16f69207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:49.556845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb992d-8aed-4020-acfd-19db16f69207 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:49.563314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987de2f6-ccf7-4065-afc2-1963a37a7771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:49.564187 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987de2f6-ccf7-4065-afc2-1963a37a7771 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:49.564537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987de2f6-ccf7-4065-afc2-1963a37a7771 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:49.564881 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987de2f6-ccf7-4065-afc2-1963a37a7771 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:49.572578 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987de2f6-ccf7-4065-afc2-1963a37a7771 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:49.574251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987de2f6-ccf7-4065-afc2-1963a37a7771 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:49.576295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-e7eb992d-8aed-4020-acfd-19db16f69207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:49.576295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:49.576295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:49.576295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:49.576295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:49.576295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:49.576295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:49.576295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:49.576295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:49.576295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:49.576295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:49.576295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:49.576295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:49.576295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:49.576295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:49.577332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:49.577332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:49.577332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:49.577332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:49.577332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:49.577332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:49.577332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:49.577332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:49.577332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:49.577332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:49.577332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:49.577332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:49.577332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:49.577332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:49.577332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:49.577332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:49.577332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:49.578438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:49.578438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:49.578438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:49.578438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:49.578438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 329/646] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:49.578438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb992d-8aed-4020-acfd-19db16f69207 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:49.593968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-987de2f6-ccf7-4065-afc2-1963a37a7771 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:19:49.593968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:49.593968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:49.593968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:49.593968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:49.593968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:49.593968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:49.593968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:49.593968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:49.593968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:49.593968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:49.593968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:49.593968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:19:49.593968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:19:49.593968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:19:49.593968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:19:49.594999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:49.594999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:49.594999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:19:49.594999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:49.594999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:19:49.594999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:49.594999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:49.594999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:49.594999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:49.594999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:49.594999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:49.594999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:49.594999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:49.594999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:49.594999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:49.594999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:49.594999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:49.594999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:49.595940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:49.595940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:49.595940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:19:49.595940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:19:49.595940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:19:49.595940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:19:49.595940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:19:49.595940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:19:49.595940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:19:49.595940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:49.595940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 318/647] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Jul 21 08:19:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:49.595940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987de2f6-ccf7-4065-afc2-1963a37a7771 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:49.701014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb992d-8aed-4020-acfd-19db16f69207 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:49.707490 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987de2f6-ccf7-4065-afc2-1963a37a7771 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:49.736398 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:49.737831 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d14da2-1941-4a00-9a96-195814ceab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:49.738492 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d14da2-1941-4a00-9a96-195814ceab2a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:49.738776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d14da2-1941-4a00-9a96-195814ceab2a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:49.739051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d14da2-1941-4a00-9a96-195814ceab2a None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:49.742523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d14da2-1941-4a00-9a96-195814ceab2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:49.742523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d14da2-1941-4a00-9a96-195814ceab2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:49.742523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d14da2-1941-4a00-9a96-195814ceab2a None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:49.748192 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1e328-31dd-4f4b-bd68-e2fd57e55dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:49.748978 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1e328-31dd-4f4b-bd68-e2fd57e55dee None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:49.749329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1e328-31dd-4f4b-bd68-e2fd57e55dee None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:49.749720 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1e328-31dd-4f4b-bd68-e2fd57e55dee None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:49.750924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1e328-31dd-4f4b-bd68-e2fd57e55dee None admin] RBAC: Adding query filter params (name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:49.750924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1e328-31dd-4f4b-bd68-e2fd57e55dee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:49.753575 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1e328-31dd-4f4b-bd68-e2fd57e55dee None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:49.761426 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 330/648] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:19:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:49.761426 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d14da2-1941-4a00-9a96-195814ceab2a None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:49.766012 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 319/649] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:19:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:49.766956 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1e328-31dd-4f4b-bd68-e2fd57e55dee None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:49.795686 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:49.869783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d14da2-1941-4a00-9a96-195814ceab2a None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:49.879139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1e328-31dd-4f4b-bd68-e2fd57e55dee None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:49.904398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f5d74-5291-4a88-be68-f74c241b1027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:49.905059 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f5d74-5291-4a88-be68-f74c241b1027 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:49.905349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f5d74-5291-4a88-be68-f74c241b1027 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:49.905654 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f5d74-5291-4a88-be68-f74c241b1027 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:49.906372 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f5d74-5291-4a88-be68-f74c241b1027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:49.906681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f5d74-5291-4a88-be68-f74c241b1027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:49.908043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f5d74-5291-4a88-be68-f74c241b1027 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:49.914551 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3429995-6b42-4df4-b4d0-5929a70fe035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:49.915768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3429995-6b42-4df4-b4d0-5929a70fe035 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:49.916174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3429995-6b42-4df4-b4d0-5929a70fe035 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:49.916552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3429995-6b42-4df4-b4d0-5929a70fe035 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:49.918566 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3429995-6b42-4df4-b4d0-5929a70fe035 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:49.919108 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3429995-6b42-4df4-b4d0-5929a70fe035 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:49.920613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3429995-6b42-4df4-b4d0-5929a70fe035 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:49.925335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 331/650] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:49.926017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f5d74-5291-4a88-be68-f74c241b1027 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:49.942838 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 320/651] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Jul 21 08:19:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:49.942838 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3429995-6b42-4df4-b4d0-5929a70fe035 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:49.993035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:50.025850 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:50.035911 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f5d74-5291-4a88-be68-f74c241b1027 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:50.048471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3429995-6b42-4df4-b4d0-5929a70fe035 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:50.071437 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c19f05-205e-4365-9084-959128e4d90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:50.072257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c19f05-205e-4365-9084-959128e4d90f None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:50.072615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c19f05-205e-4365-9084-959128e4d90f None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:50.072894 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c19f05-205e-4365-9084-959128e4d90f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:50.074247 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c19f05-205e-4365-9084-959128e4d90f None admin] RBAC: Adding query filter params (role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=2b27a4861d6b4ddfaca1a97efdaf008d) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:50.074559 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c19f05-205e-4365-9084-959128e4d90f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:50.076015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c19f05-205e-4365-9084-959128e4d90f None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:50.082116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 332/652] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:19:49 2022] GET /identity/v3/role_assignments?user.id=2b27a4861d6b4ddfaca1a97efdaf008d&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:50.082967 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c19f05-205e-4365-9084-959128e4d90f None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:50.102185 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe465268-c973-46ca-85dd-bf2166c2557f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:50.103662 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe465268-c973-46ca-85dd-bf2166c2557f None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:50.104586 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe465268-c973-46ca-85dd-bf2166c2557f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:50.105032 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe465268-c973-46ca-85dd-bf2166c2557f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:50.122462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe465268-c973-46ca-85dd-bf2166c2557f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:50.123958 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe465268-c973-46ca-85dd-bf2166c2557f None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:50.144722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-fe465268-c973-46ca-85dd-bf2166c2557f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:50.144722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:50.144722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:50.144722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:50.144722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:50.144722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:50.144722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:50.144722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:50.144722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:50.144722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:50.144722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:50.144722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:50.144722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:50.144722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:50.144722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:50.145912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:50.145912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:50.145912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:50.145912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:50.145912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:50.145912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:50.145912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:50.145912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:50.145912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:50.145912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:50.145912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:50.145912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:50.145912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:50.145912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:50.145912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:50.145912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:50.145912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:50.146977 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:50.146977 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:50.146977 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:50.146977 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:50.150754 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 321/653] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:50.152337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe465268-c973-46ca-85dd-bf2166c2557f None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:50.223669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c19f05-205e-4365-9084-959128e4d90f None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:50.267161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fc86e-6ede-403b-81fd-cea83fb5d81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:50.267890 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fc86e-6ede-403b-81fd-cea83fb5d81f None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:50.268177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fc86e-6ede-403b-81fd-cea83fb5d81f None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:50.268456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fc86e-6ede-403b-81fd-cea83fb5d81f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:50.277906 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fc86e-6ede-403b-81fd-cea83fb5d81f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:50.278423 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fc86e-6ede-403b-81fd-cea83fb5d81f None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:50.279612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:50.283433 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe465268-c973-46ca-85dd-bf2166c2557f None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:50.294834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-299fc86e-6ede-403b-81fd-cea83fb5d81f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:19:50.294834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:50.294834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:50.294834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:50.294834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:50.294834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:50.294834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:50.294834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:50.294834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:50.294834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:50.294834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:50.294834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:50.294834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:19:50.294834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:19:50.294834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:19:50.294834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:19:50.306926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:50.306926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:50.306926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:19:50.306926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:50.306926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:19:50.306926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:50.306926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:50.306926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:50.306926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:50.306926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:50.306926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:50.306926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:50.306926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:50.306926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:50.306926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:50.306926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:50.306926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:50.306926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:50.308396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:50.308396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:50.308396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:19:50.308396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:19:50.308396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:19:50.308396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:19:50.308396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:19:50.308396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:19:50.308396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:19:50.308396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:50.308396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 333/654] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:50.308396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fc86e-6ede-403b-81fd-cea83fb5d81f None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:50.319798 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:50.328756 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908bf8f-8dad-4c3d-9b0e-90b9c0bceb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:50.329415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908bf8f-8dad-4c3d-9b0e-90b9c0bceb5d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:50.329788 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908bf8f-8dad-4c3d-9b0e-90b9c0bceb5d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:50.330041 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908bf8f-8dad-4c3d-9b0e-90b9c0bceb5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:50.414349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908bf8f-8dad-4c3d-9b0e-90b9c0bceb5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:50.417776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908bf8f-8dad-4c3d-9b0e-90b9c0bceb5d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:50.429390 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fc86e-6ede-403b-81fd-cea83fb5d81f None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:50.464499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87d16d-57a0-4bf3-bb3c-ff799c5fd1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:50.465256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87d16d-57a0-4bf3-bb3c-ff799c5fd1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:50.465673 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87d16d-57a0-4bf3-bb3c-ff799c5fd1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:50.466020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87d16d-57a0-4bf3-bb3c-ff799c5fd1c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:50.466814 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87d16d-57a0-4bf3-bb3c-ff799c5fd1c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:50.467188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87d16d-57a0-4bf3-bb3c-ff799c5fd1c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:50.468618 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87d16d-57a0-4bf3-bb3c-ff799c5fd1c1 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:50.481205 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 334/655] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:50.482376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87d16d-57a0-4bf3-bb3c-ff799c5fd1c1 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:50.545791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:50.549847 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 322/656] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:19:50.550880 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908bf8f-8dad-4c3d-9b0e-90b9c0bceb5d None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:50.581829 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:50.609030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87d16d-57a0-4bf3-bb3c-ff799c5fd1c1 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:50.645697 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac0247-884e-484b-9306-2287fb71eaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:50.646431 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac0247-884e-484b-9306-2287fb71eaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:50.646710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac0247-884e-484b-9306-2287fb71eaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:50.646980 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac0247-884e-484b-9306-2287fb71eaf7 None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:50.647812 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac0247-884e-484b-9306-2287fb71eaf7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:50.648116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac0247-884e-484b-9306-2287fb71eaf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:50.649565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac0247-884e-484b-9306-2287fb71eaf7 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:50.661618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908bf8f-8dad-4c3d-9b0e-90b9c0bceb5d None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:50.667027 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 335/657] 10.222.0.57 () {56 vars in 1137 bytes} [Thu Jul 21 08:19:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:50.667859 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac0247-884e-484b-9306-2287fb71eaf7 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:50.699654 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9933e2f-7454-4612-8281-008b81ad413a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:50.700443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9933e2f-7454-4612-8281-008b81ad413a None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:50.700727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9933e2f-7454-4612-8281-008b81ad413a None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:50.701000 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9933e2f-7454-4612-8281-008b81ad413a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:50.708736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9933e2f-7454-4612-8281-008b81ad413a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:50.710244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9933e2f-7454-4612-8281-008b81ad413a None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:50.724457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-a9933e2f-7454-4612-8281-008b81ad413a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 08:19:50.724457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:50.724457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:50.724457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:50.724457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:50.724457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:50.724457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:50.724457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:50.724457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:50.724457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:50.724457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:50.724457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:50.724457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:19:50.724457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:19:50.724457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:19:50.724457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:19:50.725590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:50.725590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:50.725590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:19:50.725590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:50.725590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:19:50.725590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:50.725590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:50.725590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:50.725590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:50.725590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:50.725590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:50.725590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:50.725590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:50.725590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:50.725590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:50.725590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:50.725590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:50.725590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:50.727382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:50.727382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:50.727382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:19:50.727382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:19:50.727382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:19:50.727382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:19:50.727382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:19:50.727382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:19:50.727382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 08:19:50.727382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:50.727382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 323/658] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:19:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:50.727382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07826a9-7e6f-4423-8923-9d2950fd4974 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:50.727382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07826a9-7e6f-4423-8923-9d2950fd4974 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:50.728166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07826a9-7e6f-4423-8923-9d2950fd4974 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:50.733745 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 324/659] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:50.733745 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07826a9-7e6f-4423-8923-9d2950fd4974 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:50.781499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac0247-884e-484b-9306-2287fb71eaf7 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:50.824177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3faaa4d-ba51-4b04-8faf-6dfcb6ab269b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:50.824893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faaa4d-ba51-4b04-8faf-6dfcb6ab269b None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:50.825179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faaa4d-ba51-4b04-8faf-6dfcb6ab269b None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:50.825454 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faaa4d-ba51-4b04-8faf-6dfcb6ab269b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:50.836282 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3faaa4d-ba51-4b04-8faf-6dfcb6ab269b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:50.837753 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3faaa4d-ba51-4b04-8faf-6dfcb6ab269b None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:50.838885 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07826a9-7e6f-4423-8923-9d2950fd4974 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:50.857852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-b3faaa4d-ba51-4b04-8faf-6dfcb6ab269b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:50.857852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:50.857852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:50.857852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:50.857852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:50.857852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:50.857852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:50.857852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:50.857852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:50.857852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:50.857852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:50.857852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:50.857852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:50.857852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:50.857852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:50.858834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:50.858834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:50.858834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:50.858834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:50.858834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:50.858834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:50.858834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:50.858834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:50.858834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:50.858834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:50.858834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:50.858834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:50.858834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:50.858834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:50.858834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:50.858834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:50.858834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:50.859746 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:50.859746 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:50.859746 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:50.859746 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:50.859746 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 336/660] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:50.860043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3faaa4d-ba51-4b04-8faf-6dfcb6ab269b None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:50.876372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449b061-fa34-4763-9021-e79360744b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:50.877024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449b061-fa34-4763-9021-e79360744b60 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:50.877307 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449b061-fa34-4763-9021-e79360744b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:50.877621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449b061-fa34-4763-9021-e79360744b60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:50.887847 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:50.928111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:50.948268 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449b061-fa34-4763-9021-e79360744b60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:50.949902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449b061-fa34-4763-9021-e79360744b60 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:50.960997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3faaa4d-ba51-4b04-8faf-6dfcb6ab269b None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:50.997995 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bdffd-eb07-41b3-8bd7-a72b934e559c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:50.998800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bdffd-eb07-41b3-8bd7-a72b934e559c None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:50.999157 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bdffd-eb07-41b3-8bd7-a72b934e559c None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:50.999517 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bdffd-eb07-41b3-8bd7-a72b934e559c None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:51.000423 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bdffd-eb07-41b3-8bd7-a72b934e559c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:51.000807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bdffd-eb07-41b3-8bd7-a72b934e559c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:51.002336 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bdffd-eb07-41b3-8bd7-a72b934e559c None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:51.010977 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:51.024174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 337/661] 10.222.0.57 () {56 vars in 1139 bytes} [Thu Jul 21 08:19:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:51.024174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17be7a-3302-48d3-94d1-ad98b2d53ca3 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:51.024174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17be7a-3302-48d3-94d1-ad98b2d53ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:51.024174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17be7a-3302-48d3-94d1-ad98b2d53ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:51.038553 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-4c17be7a-3302-48d3-94d1-ad98b2d53ca3 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:51.039817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4c17be7a-3302-48d3-94d1-ad98b2d53ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:51.061921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 325/662] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:19:51.062873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449b061-fa34-4763-9021-e79360744b60 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:51.079627 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:51.113135 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 338/663] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:51.114003 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17be7a-3302-48d3-94d1-ad98b2d53ca3 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:51.176337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449b061-fa34-4763-9021-e79360744b60 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:51.208869 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72265c45-6729-4b1d-b540-5a0f9fc811b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:51.209542 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72265c45-6729-4b1d-b540-5a0f9fc811b1 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:51.209827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72265c45-6729-4b1d-b540-5a0f9fc811b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:51.210097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72265c45-6729-4b1d-b540-5a0f9fc811b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:51.210813 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72265c45-6729-4b1d-b540-5a0f9fc811b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:51.211115 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72265c45-6729-4b1d-b540-5a0f9fc811b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:51.212472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72265c45-6729-4b1d-b540-5a0f9fc811b1 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:51.219790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17be7a-3302-48d3-94d1-ad98b2d53ca3 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:51.223852 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 326/664] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:51.224637 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72265c45-6729-4b1d-b540-5a0f9fc811b1 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:51.250211 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:51.256241 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24561538-295a-4c7e-a927-b623c717e819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:51.256882 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24561538-295a-4c7e-a927-b623c717e819 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:51.257160 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24561538-295a-4c7e-a927-b623c717e819 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:51.257430 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24561538-295a-4c7e-a927-b623c717e819 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:51.300099 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:51.327678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24561538-295a-4c7e-a927-b623c717e819 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:51.329259 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24561538-295a-4c7e-a927-b623c717e819 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:51.331835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72265c45-6729-4b1d-b540-5a0f9fc811b1 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:51.371962 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d86f1-5553-46f1-a858-95d074e269c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:51.373028 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d86f1-5553-46f1-a858-95d074e269c7 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:51.373455 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d86f1-5553-46f1-a858-95d074e269c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:51.373961 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d86f1-5553-46f1-a858-95d074e269c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:51.386975 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d86f1-5553-46f1-a858-95d074e269c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:51.388558 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d86f1-5553-46f1-a858-95d074e269c7 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:51.406254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-c43d86f1-5553-46f1-a858-95d074e269c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:51.406254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:51.406254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:51.406254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:51.406254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:51.406254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:51.406254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:51.406254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:51.406254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:51.406254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:51.406254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:51.406254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:51.406254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:51.406254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:51.406254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:51.407169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:51.407169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:51.407169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:51.407169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:51.407169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:51.407169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:51.407169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:51.407169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:51.407169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:51.407169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:51.407169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:51.407169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:51.407169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:51.407169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:51.407169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:51.407169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:51.407169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:51.408064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:51.408064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:51.408064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:51.408064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:51.411822 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 327/665] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:51.412665 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d86f1-5553-46f1-a858-95d074e269c7 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:51.440596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 339/666] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:19:51.441443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24561538-295a-4c7e-a927-b623c717e819 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:51.491967 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:51.515852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:51.522033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d86f1-5553-46f1-a858-95d074e269c7 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:51.545173 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24561538-295a-4c7e-a927-b623c717e819 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:51.559367 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201ccb9-39c5-4c92-abba-a2581328b49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:51.560157 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201ccb9-39c5-4c92-abba-a2581328b49f None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:51.560438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201ccb9-39c5-4c92-abba-a2581328b49f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:51.560712 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201ccb9-39c5-4c92-abba-a2581328b49f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:51.570900 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201ccb9-39c5-4c92-abba-a2581328b49f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:51.579285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-4201ccb9-39c5-4c92-abba-a2581328b49f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:51.579285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:51.579285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:51.579285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:51.579285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:51.579285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:51.579285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:51.579285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:51.579285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:51.579285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:51.579285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:51.579285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:51.579285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:51.579285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:51.579285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:51.579285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:51.580238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:51.580238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:51.580238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:51.580238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:51.580238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:51.580238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:51.580238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:51.580238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:51.580238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:51.580238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:51.580238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:51.580238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:51.580238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:51.580238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:51.580238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:51.580238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:51.581087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:51.581087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:51.581087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:51.581087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:51.581087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:51.581087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:51.581087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:51.581087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:51.581087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:51.581087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:51.581087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:51.581087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:51.581087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 328/667] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:19:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:51.582271 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201ccb9-39c5-4c92-abba-a2581328b49f None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:51.593345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619823b8-d98a-4657-8e11-a97c4ba42237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:51.594385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619823b8-d98a-4657-8e11-a97c4ba42237 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:51.594943 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619823b8-d98a-4657-8e11-a97c4ba42237 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:51.595372 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619823b8-d98a-4657-8e11-a97c4ba42237 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:51.603258 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619823b8-d98a-4657-8e11-a97c4ba42237 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:51.605003 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619823b8-d98a-4657-8e11-a97c4ba42237 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:51.619896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-619823b8-d98a-4657-8e11-a97c4ba42237 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:51.619896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:51.619896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:51.619896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:51.619896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:51.619896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:51.619896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:51.619896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:51.619896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:51.619896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:51.619896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:51.619896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:51.619896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:19:51.619896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:19:51.619896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:19:51.621014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:19:51.621014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:51.621014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:51.621014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:51.621014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:51.621014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:51.621014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:51.621014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:51.621014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:51.621014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:51.621014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:51.621014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:51.621014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:51.621014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:51.621014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:51.621014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:51.621014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:51.622294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:19:51.622294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:19:51.622294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:19:51.622294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:19:51.622294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:19:51.622294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:19:51.622294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:51.622294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:51.624212 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 340/668] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:51.625240 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619823b8-d98a-4657-8e11-a97c4ba42237 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:51.686577 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201ccb9-39c5-4c92-abba-a2581328b49f None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:51.717015 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:51.722269 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb40bf-a38c-4e91-9b5a-a4c8c61e9208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:51.723052 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb40bf-a38c-4e91-9b5a-a4c8c61e9208 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:51.723443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb40bf-a38c-4e91-9b5a-a4c8c61e9208 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:51.723722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb40bf-a38c-4e91-9b5a-a4c8c61e9208 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:51.724444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb40bf-a38c-4e91-9b5a-a4c8c61e9208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:51.724749 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb40bf-a38c-4e91-9b5a-a4c8c61e9208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:51.726219 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb40bf-a38c-4e91-9b5a-a4c8c61e9208 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:51.732026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619823b8-d98a-4657-8e11-a97c4ba42237 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:51.738390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 329/669] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:51.745903 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb40bf-a38c-4e91-9b5a-a4c8c61e9208 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:51.766906 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:51.772024 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3ed75-a8f5-4376-b93b-eb6158754a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:51.772810 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3ed75-a8f5-4376-b93b-eb6158754a56 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:51.773090 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3ed75-a8f5-4376-b93b-eb6158754a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:51.773362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3ed75-a8f5-4376-b93b-eb6158754a56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:51.784687 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3ed75-a8f5-4376-b93b-eb6158754a56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:51.786374 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3ed75-a8f5-4376-b93b-eb6158754a56 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:51.804451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-2eb3ed75-a8f5-4376-b93b-eb6158754a56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:51.804451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:51.804451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:51.804451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:51.804451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:51.804451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:51.804451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:51.804451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:51.804451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:51.804451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:51.804451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:51.804451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:51.804451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:51.804451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:51.804451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:51.805598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:51.805598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:51.805598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:51.805598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:51.805598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:51.805598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:51.805598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:51.805598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:51.805598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:51.805598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:51.805598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:51.805598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:51.805598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:51.805598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:51.805598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:51.805598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:51.805598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:51.806545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:51.806545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:51.806545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:51.806545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:51.806545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 341/670] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:51.806841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3ed75-a8f5-4376-b93b-eb6158754a56 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:51.859831 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb40bf-a38c-4e91-9b5a-a4c8c61e9208 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:51.896601 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7ce15-9a87-4e32-a2ff-4c2f8d165e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:51.897276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7ce15-9a87-4e32-a2ff-4c2f8d165e33 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:51.897582 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7ce15-9a87-4e32-a2ff-4c2f8d165e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:51.897860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7ce15-9a87-4e32-a2ff-4c2f8d165e33 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:51.898610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7ce15-9a87-4e32-a2ff-4c2f8d165e33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:51.898915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7ce15-9a87-4e32-a2ff-4c2f8d165e33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:51.900281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7ce15-9a87-4e32-a2ff-4c2f8d165e33 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:51.908661 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 330/671] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:19:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:51.909549 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7ce15-9a87-4e32-a2ff-4c2f8d165e33 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:51.917992 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3ed75-a8f5-4376-b93b-eb6158754a56 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:51.953246 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddf0cb-1b84-429e-bce1-dc182afad508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:51.953952 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddf0cb-1b84-429e-bce1-dc182afad508 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:51.954240 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddf0cb-1b84-429e-bce1-dc182afad508 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:51.954504 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddf0cb-1b84-429e-bce1-dc182afad508 None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:51.955286 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddf0cb-1b84-429e-bce1-dc182afad508 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:51.955598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddf0cb-1b84-429e-bce1-dc182afad508 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:51.957026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddf0cb-1b84-429e-bce1-dc182afad508 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:51.968518 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:51.969429 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 342/672] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:19:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:51.970275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddf0cb-1b84-429e-bce1-dc182afad508 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:52.018513 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:52.024528 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7ce15-9a87-4e32-a2ff-4c2f8d165e33 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:52.059680 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb173f-27af-43e9-8197-a5c2cdc4cb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:52.060609 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb173f-27af-43e9-8197-a5c2cdc4cb32 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:52.060998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb173f-27af-43e9-8197-a5c2cdc4cb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:52.061378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb173f-27af-43e9-8197-a5c2cdc4cb32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:52.068310 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb173f-27af-43e9-8197-a5c2cdc4cb32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:52.069812 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb173f-27af-43e9-8197-a5c2cdc4cb32 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:52.076041 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddf0cb-1b84-429e-bce1-dc182afad508 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:52.084690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-91bb173f-27af-43e9-8197-a5c2cdc4cb32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:52.084690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:52.084690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:52.084690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:52.084690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:52.084690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:52.084690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:52.084690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:52.084690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:52.084690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:52.084690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:52.084690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:52.084690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:19:52.084690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:19:52.084690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:19:52.085672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:19:52.085672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:52.085672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:52.085672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:52.085672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:52.085672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:52.085672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:52.085672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:52.085672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:52.085672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:52.085672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:52.085672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:52.085672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:52.085672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:52.085672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:52.085672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:52.085672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:52.086570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:19:52.086570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:19:52.086570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:19:52.086570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:19:52.086570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:19:52.086570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:19:52.086570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:52.086570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:52.086570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 331/673] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:52.087048 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb173f-27af-43e9-8197-a5c2cdc4cb32 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:52.118505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e7015-5530-4834-92d2-ed5210fec576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:52.119097 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e7015-5530-4834-92d2-ed5210fec576 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:52.119378 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e7015-5530-4834-92d2-ed5210fec576 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:52.119655 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e7015-5530-4834-92d2-ed5210fec576 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:52.120897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e7015-5530-4834-92d2-ed5210fec576 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:52.121208 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e7015-5530-4834-92d2-ed5210fec576 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:52.122682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e7015-5530-4834-92d2-ed5210fec576 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:52.138864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 343/674] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:52.138864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e7015-5530-4834-92d2-ed5210fec576 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:52.197760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb173f-27af-43e9-8197-a5c2cdc4cb32 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:52.213492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:52.234857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41956abe-563f-4ee3-a1e5-2661262407a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:52.235642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41956abe-563f-4ee3-a1e5-2661262407a5 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:52.235931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41956abe-563f-4ee3-a1e5-2661262407a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:52.236202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41956abe-563f-4ee3-a1e5-2661262407a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:52.242563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e7015-5530-4834-92d2-ed5210fec576 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:52.245682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:52.248248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41956abe-563f-4ee3-a1e5-2661262407a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:52.249754 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41956abe-563f-4ee3-a1e5-2661262407a5 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:52.267389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-41956abe-563f-4ee3-a1e5-2661262407a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:52.267389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:52.267389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:52.267389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:52.267389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:52.267389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:52.267389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:52.267389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:52.267389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:52.267389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:52.267389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:52.267389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:52.267389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:52.267389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:52.267389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:52.268293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:52.268293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:52.268293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:52.268293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:52.268293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:52.268293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:52.268293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:52.268293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:52.268293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:52.268293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:52.268293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:52.268293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:52.268293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:52.268293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:52.268293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:52.268293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:52.268293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:52.269206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:52.269206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:52.269206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:52.269206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:52.269206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 332/675] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:52.269957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41956abe-563f-4ee3-a1e5-2661262407a5 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:52.284664 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf529a4-906f-4339-859a-1cad34d8fb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:52.285326 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf529a4-906f-4339-859a-1cad34d8fb93 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:52.285637 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf529a4-906f-4339-859a-1cad34d8fb93 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:52.285913 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf529a4-906f-4339-859a-1cad34d8fb93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:52.286739 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf529a4-906f-4339-859a-1cad34d8fb93 None admin] RBAC: Adding query filter params (role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=b6670a010c034f7999c9445452c02473) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:52.287053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf529a4-906f-4339-859a-1cad34d8fb93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:52.288484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf529a4-906f-4339-859a-1cad34d8fb93 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:52.295370 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 344/676] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:19:52 2022] GET /identity/v3/role_assignments?user.id=b6670a010c034f7999c9445452c02473&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:52.298399 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf529a4-906f-4339-859a-1cad34d8fb93 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:52.384903 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41956abe-563f-4ee3-a1e5-2661262407a5 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:52.412014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf529a4-906f-4339-859a-1cad34d8fb93 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:52.423755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46f35d-c569-497f-aa3b-f7b9a6bd0592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:52.424786 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46f35d-c569-497f-aa3b-f7b9a6bd0592 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:52.425219 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46f35d-c569-497f-aa3b-f7b9a6bd0592 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:52.425722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46f35d-c569-497f-aa3b-f7b9a6bd0592 None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:52.426787 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46f35d-c569-497f-aa3b-f7b9a6bd0592 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:52.427248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46f35d-c569-497f-aa3b-f7b9a6bd0592 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:52.428949 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46f35d-c569-497f-aa3b-f7b9a6bd0592 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:52.443629 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 333/677] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:19:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:52.444484 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46f35d-c569-497f-aa3b-f7b9a6bd0592 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:52.453983 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8d037-d2c9-4237-8a41-fa5333872be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:52.454780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8d037-d2c9-4237-8a41-fa5333872be2 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:52.455577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8d037-d2c9-4237-8a41-fa5333872be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:52.455577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8d037-d2c9-4237-8a41-fa5333872be2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:52.463439 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8d037-d2c9-4237-8a41-fa5333872be2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:52.464976 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8d037-d2c9-4237-8a41-fa5333872be2 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:52.478517 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:52.481648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-42e8d037-d2c9-4237-8a41-fa5333872be2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:52.481648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:52.481648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:52.481648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:52.481648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:52.481648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:52.481648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:52.481648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:52.481648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:52.481648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:52.481648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:52.481648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:52.481648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:19:52.481648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:19:52.481648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:19:52.482676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:19:52.482676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:52.482676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:52.482676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:52.482676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:52.482676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:52.482676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:52.482676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:52.482676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:52.482676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:52.482676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:52.482676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:52.482676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:52.482676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:52.482676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:52.482676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:52.482676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:52.483565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:19:52.483565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:19:52.483565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:19:52.483565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:19:52.483565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:19:52.483565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:19:52.483565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:52.483565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:52.483565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 345/678] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:52.485027 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87657e41-d547-4603-b20f-5850a196b6f4 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:52.485027 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87657e41-d547-4603-b20f-5850a196b6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:52.485027 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87657e41-d547-4603-b20f-5850a196b6f4 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:52.485818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 346/679] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:52.486505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87657e41-d547-4603-b20f-5850a196b6f4 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:52.518202 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:52.569856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46f35d-c569-497f-aa3b-f7b9a6bd0592 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:52.600935 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87657e41-d547-4603-b20f-5850a196b6f4 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:52.605281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6530a2-5f78-45b9-9ca8-c4e5c0a8a4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:52.605962 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6530a2-5f78-45b9-9ca8-c4e5c0a8a4fc None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:52.606241 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6530a2-5f78-45b9-9ca8-c4e5c0a8a4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:52.606509 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6530a2-5f78-45b9-9ca8-c4e5c0a8a4fc None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:52.607228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6530a2-5f78-45b9-9ca8-c4e5c0a8a4fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:52.607529 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6530a2-5f78-45b9-9ca8-c4e5c0a8a4fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:52.608891 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6530a2-5f78-45b9-9ca8-c4e5c0a8a4fc None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:52.625084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 334/680] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:52.625084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6530a2-5f78-45b9-9ca8-c4e5c0a8a4fc None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:52.644207 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d081d5-2947-42dc-80cc-5deaca1ee8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:52.644856 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d081d5-2947-42dc-80cc-5deaca1ee8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:52.645199 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d081d5-2947-42dc-80cc-5deaca1ee8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:52.645564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d081d5-2947-42dc-80cc-5deaca1ee8d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:52.646762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d081d5-2947-42dc-80cc-5deaca1ee8d3 None admin] RBAC: Adding query filter params (role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=aebefbc2dc0244d8a5ae7d88be6b63ad) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:52.647043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d081d5-2947-42dc-80cc-5deaca1ee8d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:52.648516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d081d5-2947-42dc-80cc-5deaca1ee8d3 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:52.657171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 347/681] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:19:52 2022] GET /identity/v3/role_assignments?user.id=aebefbc2dc0244d8a5ae7d88be6b63ad&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:52.658779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50338c3-8256-403a-bbbf-f7d4853929d9 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:52.659285 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50338c3-8256-403a-bbbf-f7d4853929d9 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:52.659831 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50338c3-8256-403a-bbbf-f7d4853929d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:52.687556 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-e50338c3-8256-403a-bbbf-f7d4853929d9 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:52.688962 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e50338c3-8256-403a-bbbf-f7d4853929d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:52.726135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:52.755635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6530a2-5f78-45b9-9ca8-c4e5c0a8a4fc None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:52.785927 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 348/682] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:52.787087 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50338c3-8256-403a-bbbf-f7d4853929d9 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:52.808880 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94440c11-cef6-4a44-8906-79e80c323012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:52.809957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440c11-cef6-4a44-8906-79e80c323012 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:52.810392 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440c11-cef6-4a44-8906-79e80c323012 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:52.810816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440c11-cef6-4a44-8906-79e80c323012 None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:52.812047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94440c11-cef6-4a44-8906-79e80c323012 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:52.812363 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94440c11-cef6-4a44-8906-79e80c323012 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:52.813869 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94440c11-cef6-4a44-8906-79e80c323012 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:52.827249 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 335/683] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:19:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:52.828196 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94440c11-cef6-4a44-8906-79e80c323012 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:52.832859 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:52.928169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50338c3-8256-403a-bbbf-f7d4853929d9 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:52.964735 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94440c11-cef6-4a44-8906-79e80c323012 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:52.970171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356530f-ea7d-4204-bda7-2b88afc0d569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:52.970965 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356530f-ea7d-4204-bda7-2b88afc0d569 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:52.971246 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356530f-ea7d-4204-bda7-2b88afc0d569 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:52.971522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356530f-ea7d-4204-bda7-2b88afc0d569 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:52.981666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356530f-ea7d-4204-bda7-2b88afc0d569 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:52.983661 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356530f-ea7d-4204-bda7-2b88afc0d569 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:53.002669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-1356530f-ea7d-4204-bda7-2b88afc0d569 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:19:53.002669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:53.002669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:53.002669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:53.002669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:53.002669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:53.002669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:53.002669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:53.002669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:53.002669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:53.002669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:53.002669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:53.002669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:19:53.002669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:19:53.002669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:19:53.002669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:19:53.003874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:53.003874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:53.003874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:19:53.003874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:53.003874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:19:53.003874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:53.003874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:53.003874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:53.003874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:53.003874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:53.003874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:53.003874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:53.003874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:53.003874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:53.003874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:53.003874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:53.003874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:53.003874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:53.005029 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:53.005029 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:53.005029 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:19:53.005029 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:19:53.005029 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:19:53.005029 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:19:53.005029 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:19:53.005029 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:19:53.005029 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:19:53.005029 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:53.005675 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4e4a1-bb66-4cc5-83f3-2c2e369290df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:53.005675 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e4a1-bb66-4cc5-83f3-2c2e369290df None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:53.005675 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e4a1-bb66-4cc5-83f3-2c2e369290df None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:53.005883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 349/684] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:19:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:53.005883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356530f-ea7d-4204-bda7-2b88afc0d569 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:53.009165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e4a1-bb66-4cc5-83f3-2c2e369290df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:53.027185 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4e4a1-bb66-4cc5-83f3-2c2e369290df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:53.029399 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4e4a1-bb66-4cc5-83f3-2c2e369290df None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:53.038604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:53.052681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-93b4e4a1-bb66-4cc5-83f3-2c2e369290df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:53.052681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:53.052681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:53.052681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:53.052681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:53.052681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:53.052681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:53.052681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:53.052681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:53.052681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:53.052681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:53.052681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:53.052681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:53.052681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:53.052681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:53.066191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:53.066191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:53.066191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:53.066191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:53.066191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:53.066191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:53.066191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:53.066191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:53.066191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:53.066191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:53.066191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:53.066191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:53.066191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:53.066191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:53.066191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:53.066191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:53.066191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:53.067244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:53.067244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:53.067244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:53.067244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:53.067244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 336/685] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:53.067244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4e4a1-bb66-4cc5-83f3-2c2e369290df None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:53.112232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:53.135373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356530f-ea7d-4204-bda7-2b88afc0d569 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:53.180510 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28176f2-af67-4e95-96f8-603895cbd5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:53.181865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28176f2-af67-4e95-96f8-603895cbd5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:53.182443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28176f2-af67-4e95-96f8-603895cbd5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:53.182870 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28176f2-af67-4e95-96f8-603895cbd5c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:53.184004 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28176f2-af67-4e95-96f8-603895cbd5c9 None admin] RBAC: Adding query filter params (role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=a25749f3a7c84c50b860538d1b661901) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:53.184769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28176f2-af67-4e95-96f8-603895cbd5c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:53.186838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28176f2-af67-4e95-96f8-603895cbd5c9 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:53.191166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4e4a1-bb66-4cc5-83f3-2c2e369290df None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:53.195225 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 350/686] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:19:53 2022] GET /identity/v3/role_assignments?user.id=a25749f3a7c84c50b860538d1b661901&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:53.196232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28176f2-af67-4e95-96f8-603895cbd5c9 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:53.250925 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7541f9-a741-4c62-9fec-46dce7e7d76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:53.251618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7541f9-a741-4c62-9fec-46dce7e7d76f None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:53.251903 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7541f9-a741-4c62-9fec-46dce7e7d76f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:53.252181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7541f9-a741-4c62-9fec-46dce7e7d76f None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:53.253038 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7541f9-a741-4c62-9fec-46dce7e7d76f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:53.253350 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7541f9-a741-4c62-9fec-46dce7e7d76f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:53.254849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7541f9-a741-4c62-9fec-46dce7e7d76f None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:53.310041 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 337/687] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Jul 21 08:19:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:53.327251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7541f9-a741-4c62-9fec-46dce7e7d76f None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:53.381689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28176f2-af67-4e95-96f8-603895cbd5c9 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:53.411704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:53.431205 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187a6c3-e9be-4db0-a266-d09f48a88c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:53.431810 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187a6c3-e9be-4db0-a266-d09f48a88c43 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:53.432098 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187a6c3-e9be-4db0-a266-d09f48a88c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:53.433740 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187a6c3-e9be-4db0-a266-d09f48a88c43 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:53.433740 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187a6c3-e9be-4db0-a266-d09f48a88c43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:53.433986 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187a6c3-e9be-4db0-a266-d09f48a88c43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:53.435377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187a6c3-e9be-4db0-a266-d09f48a88c43 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:53.451408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 351/688] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:53.456652 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187a6c3-e9be-4db0-a266-d09f48a88c43 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:53.466738 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7541f9-a741-4c62-9fec-46dce7e7d76f None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:53.470469 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:53.506814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d514327-39db-48c5-a1f8-7f3ab11b08f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:53.507848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d514327-39db-48c5-a1f8-7f3ab11b08f2 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:53.508355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d514327-39db-48c5-a1f8-7f3ab11b08f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:53.508844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d514327-39db-48c5-a1f8-7f3ab11b08f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:53.595087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d514327-39db-48c5-a1f8-7f3ab11b08f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:53.597050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187a6c3-e9be-4db0-a266-d09f48a88c43 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:53.597578 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d514327-39db-48c5-a1f8-7f3ab11b08f2 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:53.663309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc812748-5648-44a4-9933-61f48b522d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:53.664387 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc812748-5648-44a4-9933-61f48b522d2f None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:53.664885 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc812748-5648-44a4-9933-61f48b522d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:53.665391 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc812748-5648-44a4-9933-61f48b522d2f None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:53.666354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc812748-5648-44a4-9933-61f48b522d2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:53.668101 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc812748-5648-44a4-9933-61f48b522d2f None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:53.701384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:53.745766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 338/689] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:19:53.755387 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d514327-39db-48c5-a1f8-7f3ab11b08f2 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:53.761885 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 352/690] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 08:19:53 2022] POST /identity/v3/users => generated 254 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:19:53.883904 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d514327-39db-48c5-a1f8-7f3ab11b08f2 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:53.936286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c6aa7-11f9-42df-99ac-dbe1e17a78d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:53.937110 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c6aa7-11f9-42df-99ac-dbe1e17a78d9 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:53.937397 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c6aa7-11f9-42df-99ac-dbe1e17a78d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:53.937703 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c6aa7-11f9-42df-99ac-dbe1e17a78d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:53.955511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c6aa7-11f9-42df-99ac-dbe1e17a78d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:53.956916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c6aa7-11f9-42df-99ac-dbe1e17a78d9 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:53.986251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-961c6aa7-11f9-42df-99ac-dbe1e17a78d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:53.986251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:53.986251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:53.986251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:53.986251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:53.986251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:53.986251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:53.986251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:53.986251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:53.986251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:53.986251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:53.986251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:53.986251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:53.986251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:53.986251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:53.987202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:53.987202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:53.987202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:53.987202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:53.987202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:53.987202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:53.987202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:53.987202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:53.987202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:53.987202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:53.987202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:53.987202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:53.987202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:53.987202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:53.987202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:53.987202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:53.987202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:53.988136 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:53.988136 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:53.988136 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:53.988136 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:53.988136 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 339/691] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:19:53.994004 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc812748-5648-44a4-9933-61f48b522d2f None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:54.067077 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:54.108117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc812748-5648-44a4-9933-61f48b522d2f None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:54.144930 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2f101-ea8a-4478-a71c-6fc8b20147b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:54.145589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f101-ea8a-4478-a71c-6fc8b20147b9 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:54.145923 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f101-ea8a-4478-a71c-6fc8b20147b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:54.146205 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2f101-ea8a-4478-a71c-6fc8b20147b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:54.146929 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2f101-ea8a-4478-a71c-6fc8b20147b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:54.147233 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2f101-ea8a-4478-a71c-6fc8b20147b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:54.148608 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2f101-ea8a-4478-a71c-6fc8b20147b9 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:54.161984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 353/692] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:54.168073 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c6aa7-11f9-42df-99ac-dbe1e17a78d9 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:54.186344 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:54.295275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c6aa7-11f9-42df-99ac-dbe1e17a78d9 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:54.342230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47948c-7555-4dc8-8c85-a7a05770f5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:54.343027 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47948c-7555-4dc8-8c85-a7a05770f5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:54.343313 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47948c-7555-4dc8-8c85-a7a05770f5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:54.343590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47948c-7555-4dc8-8c85-a7a05770f5f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:54.350653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47948c-7555-4dc8-8c85-a7a05770f5f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:54.352367 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d47948c-7555-4dc8-8c85-a7a05770f5f6 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:54.366979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-5d47948c-7555-4dc8-8c85-a7a05770f5f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:54.366979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:54.366979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:54.366979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:54.366979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:54.366979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:54.366979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:54.366979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:54.366979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:54.366979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:54.366979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:54.366979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:54.366979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:19:54.366979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:19:54.366979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:19:54.367982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:19:54.367982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:54.367982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:54.367982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:54.367982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:54.367982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:54.367982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:54.367982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:54.367982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:54.367982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:54.367982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:54.367982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:54.367982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:54.367982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:54.367982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:54.367982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:54.367982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:54.368884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:19:54.368884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:19:54.368884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:19:54.368884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:19:54.368884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:19:54.368884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:19:54.368884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:54.368884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:54.368884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 340/693] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:54.373951 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2f101-ea8a-4478-a71c-6fc8b20147b9 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:54.525042 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2f101-ea8a-4478-a71c-6fc8b20147b9 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:54.556153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:54.568188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396af6c1-3dd0-4e60-9653-58bc0dfd2334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:54.576702 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396af6c1-3dd0-4e60-9653-58bc0dfd2334 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:54.576702 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396af6c1-3dd0-4e60-9653-58bc0dfd2334 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:54.576702 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396af6c1-3dd0-4e60-9653-58bc0dfd2334 None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:54.576702 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396af6c1-3dd0-4e60-9653-58bc0dfd2334 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:54.576702 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396af6c1-3dd0-4e60-9653-58bc0dfd2334 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:54.576702 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396af6c1-3dd0-4e60-9653-58bc0dfd2334 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:54.591521 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 354/694] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:19:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:54.597750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47948c-7555-4dc8-8c85-a7a05770f5f6 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:54.627970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6a602-f841-4009-a815-c26a479c9106 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:54.628603 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6a602-f841-4009-a815-c26a479c9106 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:54.629085 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6a602-f841-4009-a815-c26a479c9106 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:54.631022 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 355/695] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:19:54.637004 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feb2e9-ff01-4d27-876a-1afb251d4305 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:54.637568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feb2e9-ff01-4d27-876a-1afb251d4305 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:54.638049 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43feb2e9-ff01-4d27-876a-1afb251d4305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:54.656475 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-43feb2e9-ff01-4d27-876a-1afb251d4305 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:54.658104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-43feb2e9-ff01-4d27-876a-1afb251d4305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:54.721684 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:54.769073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 356/696] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:19:54.778014 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47948c-7555-4dc8-8c85-a7a05770f5f6 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:54.813286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451418a6-92de-4a97-ae01-45287d2c87e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:54.814391 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451418a6-92de-4a97-ae01-45287d2c87e7 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:54.814889 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451418a6-92de-4a97-ae01-45287d2c87e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:54.815363 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451418a6-92de-4a97-ae01-45287d2c87e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:54.816394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451418a6-92de-4a97-ae01-45287d2c87e7 None admin] RBAC: Adding query filter params (role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=e349e5dfcd74406b922d3d1ce0fa5ef4) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:54.816907 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451418a6-92de-4a97-ae01-45287d2c87e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:54.818573 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451418a6-92de-4a97-ae01-45287d2c87e7 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:54.824443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43feb2e9-ff01-4d27-876a-1afb251d4305 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:54.836561 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 341/697] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:19:54 2022] GET /identity/v3/role_assignments?user.id=e349e5dfcd74406b922d3d1ce0fa5ef4&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:54.939021 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43feb2e9-ff01-4d27-876a-1afb251d4305 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:54.954604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:54.977475 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de54dd-32fe-4a10-8334-54b082c7987f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:54.978307 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de54dd-32fe-4a10-8334-54b082c7987f None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:54.978586 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de54dd-32fe-4a10-8334-54b082c7987f None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:54.978857 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de54dd-32fe-4a10-8334-54b082c7987f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:54.991246 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de54dd-32fe-4a10-8334-54b082c7987f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:55.000154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-d6de54dd-32fe-4a10-8334-54b082c7987f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:19:55.000154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:55.000154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:55.000154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:55.000154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:55.000154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:55.000154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:55.000154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:55.000154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:55.000154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:55.000154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:55.000154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:55.000154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:55.000154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:55.000154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:55.000154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:55.001061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:55.001061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:55.001061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:55.001061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:55.001061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:55.001061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:55.001061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:55.001061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:55.001061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:55.001061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:55.001061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:55.001061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:55.001061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:55.001061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:55.001061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:55.001061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:55.001931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:55.001931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:55.001931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:55.001931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:55.001931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:55.001931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:55.001931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:55.001931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:55.001931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:55.001931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:55.001931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:19:55.001931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:55.001931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 357/698] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:19:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:19:55.011490 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451418a6-92de-4a97-ae01-45287d2c87e7 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:55.135172 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451418a6-92de-4a97-ae01-45287d2c87e7 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:55.167048 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:55.176653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c6474-568e-4664-8f70-a9cb560a3f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:55.177574 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c6474-568e-4664-8f70-a9cb560a3f80 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:55.177994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c6474-568e-4664-8f70-a9cb560a3f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:55.178398 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c6474-568e-4664-8f70-a9cb560a3f80 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:55.179162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c6474-568e-4664-8f70-a9cb560a3f80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:55.179470 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c6474-568e-4664-8f70-a9cb560a3f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:55.181159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c6474-568e-4664-8f70-a9cb560a3f80 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:55.192231 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 342/699] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:55.197573 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de54dd-32fe-4a10-8334-54b082c7987f None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:55.234365 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbca033-cc2f-4ecd-9d1b-f64d4b854d9f None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:55.234697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbca033-cc2f-4ecd-9d1b-f64d4b854d9f None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:55.234928 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbca033-cc2f-4ecd-9d1b-f64d4b854d9f None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:55.236546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 343/700] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:19:55.249155 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc58727-a721-4503-bacf-043dbe2bf16c None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:55.249444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc58727-a721-4503-bacf-043dbe2bf16c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:55.249756 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc58727-a721-4503-bacf-043dbe2bf16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:55.268019 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-edc58727-a721-4503-bacf-043dbe2bf16c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:55.269218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-edc58727-a721-4503-bacf-043dbe2bf16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:55.323303 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de54dd-32fe-4a10-8334-54b082c7987f None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:55.345627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 344/701] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 08:19:55.371158 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc58727-a721-4503-bacf-043dbe2bf16c None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:55.382066 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667632fd-a19d-4885-bbd9-99aa58ea7167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:55.383244 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667632fd-a19d-4885-bbd9-99aa58ea7167 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:55.383527 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667632fd-a19d-4885-bbd9-99aa58ea7167 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:55.383802 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667632fd-a19d-4885-bbd9-99aa58ea7167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:55.400065 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667632fd-a19d-4885-bbd9-99aa58ea7167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:55.401626 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667632fd-a19d-4885-bbd9-99aa58ea7167 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:55.421471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-667632fd-a19d-4885-bbd9-99aa58ea7167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:55.421471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:55.421471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:55.421471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:55.421471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:55.421471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:55.421471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:55.421471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:55.421471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:55.421471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:55.421471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:55.421471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:55.421471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:55.421471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:55.421471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:55.423577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:55.423577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:55.423577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:55.423577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:55.423577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:55.423577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:55.423577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:55.423577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:55.423577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:55.423577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:55.423577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:55.423577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:55.423577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:55.423577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:55.423577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:55.423577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:55.423577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:55.425779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:55.425779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:55.425779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:55.425779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:55.427786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 358/702] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:19:55.428655 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667632fd-a19d-4885-bbd9-99aa58ea7167 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:55.458856 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:55.485322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc58727-a721-4503-bacf-043dbe2bf16c None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:55.511867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:55.523397 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f719f6-9784-4ff1-ad2d-f4db8fbdbf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:55.524218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f719f6-9784-4ff1-ad2d-f4db8fbdbf92 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:55.524498 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f719f6-9784-4ff1-ad2d-f4db8fbdbf92 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:55.524774 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f719f6-9784-4ff1-ad2d-f4db8fbdbf92 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:55.525433 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f719f6-9784-4ff1-ad2d-f4db8fbdbf92 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:55.526843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f719f6-9784-4ff1-ad2d-f4db8fbdbf92 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:55.541101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-48f719f6-9784-4ff1-ad2d-f4db8fbdbf92 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:19:55.541101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:55.541101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:19:55.541101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:19:55.541101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:19:55.541101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:19:55.541101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:19:55.541101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:19:55.541101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:19:55.541101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:55.541101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:19:55.541101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:55.541101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:55.541101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:55.541101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:55.541101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:55.543999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:55.543999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:55.543999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:55.543999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:55.543999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:55.543999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:55.543999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:55.543999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:19:55.543999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:19:55.543999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:19:55.543999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:19:55.543999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:55.543999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:55.543999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:55.543999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:55.543999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:55.545988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:55.545988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:55.545988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:55.545988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:55.545988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:55.545988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:55.545988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:55.545988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:55.545988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:55.545988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:55.545988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:55.545988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:19:55.545988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:19:55.545988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:19:55.545988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:55.545988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 345/703] 10.222.0.57 () {56 vars in 1129 bytes} [Thu Jul 21 08:19:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:19:55.553641 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f719f6-9784-4ff1-ad2d-f4db8fbdbf92 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:55.570576 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667632fd-a19d-4885-bbd9-99aa58ea7167 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:55.659194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844f1a6-5050-41ed-a1c1-970b30b6d958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:55.660199 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844f1a6-5050-41ed-a1c1-970b30b6d958 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:55.660696 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844f1a6-5050-41ed-a1c1-970b30b6d958 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:55.661168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844f1a6-5050-41ed-a1c1-970b30b6d958 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:55.661380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f719f6-9784-4ff1-ad2d-f4db8fbdbf92 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:55.662731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844f1a6-5050-41ed-a1c1-970b30b6d958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:55.663253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844f1a6-5050-41ed-a1c1-970b30b6d958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:55.665014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844f1a6-5050-41ed-a1c1-970b30b6d958 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:55.691735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 359/704] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:55.693062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844f1a6-5050-41ed-a1c1-970b30b6d958 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:55.697512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828de666-81e4-45f3-907b-a7804d3ad30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:55.698830 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828de666-81e4-45f3-907b-a7804d3ad30f None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:55.699115 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828de666-81e4-45f3-907b-a7804d3ad30f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:55.699387 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828de666-81e4-45f3-907b-a7804d3ad30f None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:55.700098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828de666-81e4-45f3-907b-a7804d3ad30f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:55.700404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828de666-81e4-45f3-907b-a7804d3ad30f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:55.701826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828de666-81e4-45f3-907b-a7804d3ad30f None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:55.706811 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 346/705] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Jul 21 08:19:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:55.722525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828de666-81e4-45f3-907b-a7804d3ad30f None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:55.794620 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:55.812443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844f1a6-5050-41ed-a1c1-970b30b6d958 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:55.827079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:55.849074 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e419d6c-62dc-498a-8597-f76f380940b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:55.849951 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e419d6c-62dc-498a-8597-f76f380940b1 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:55.850238 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e419d6c-62dc-498a-8597-f76f380940b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:55.850512 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e419d6c-62dc-498a-8597-f76f380940b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:55.859836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e419d6c-62dc-498a-8597-f76f380940b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:55.861301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e419d6c-62dc-498a-8597-f76f380940b1 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:55.878184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-6e419d6c-62dc-498a-8597-f76f380940b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:19:55.878184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:55.878184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:55.878184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:55.878184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:55.878184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:55.878184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:55.878184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:55.878184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:55.878184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:55.878184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:55.878184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:55.878184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:19:55.878184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:19:55.878184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:19:55.878184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:19:55.883758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:55.883758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:55.883758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:19:55.883758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:55.883758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:19:55.883758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:55.883758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:55.883758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:55.883758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:55.883758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:55.883758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:55.883758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:55.883758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:55.883758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:55.883758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:55.883758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:55.883758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:55.883758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:55.884932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:55.884932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:55.884932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:19:55.884932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:19:55.884932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:19:55.884932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:19:55.884932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:19:55.884932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:19:55.884932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:19:55.884932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:55.884932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 360/706] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Jul 21 08:19:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:55.889174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e419d6c-62dc-498a-8597-f76f380940b1 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:55.928451 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828de666-81e4-45f3-907b-a7804d3ad30f None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:55.977319 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d0c7a-7fb7-4fb0-85e3-bd8aed25b0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:55.978302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d0c7a-7fb7-4fb0-85e3-bd8aed25b0bf None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:55.978973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d0c7a-7fb7-4fb0-85e3-bd8aed25b0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:55.979915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d0c7a-7fb7-4fb0-85e3-bd8aed25b0bf None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:55.981390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d0c7a-7fb7-4fb0-85e3-bd8aed25b0bf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:55.982010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d0c7a-7fb7-4fb0-85e3-bd8aed25b0bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:55.983868 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d0c7a-7fb7-4fb0-85e3-bd8aed25b0bf None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:55.991605 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 347/707] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Jul 21 08:19:55 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:55.993100 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaf822-f857-450f-b66a-2f68600d9645 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:55.993514 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaf822-f857-450f-b66a-2f68600d9645 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:55.993978 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaaf822-f857-450f-b66a-2f68600d9645 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:56.000890 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 348/708] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:56.002985 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7004f4-ceaf-4d43-8aa9-3c61f116ff11 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:56.003452 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7004f4-ceaf-4d43-8aa9-3c61f116ff11 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:56.003873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7004f4-ceaf-4d43-8aa9-3c61f116ff11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:56.023799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-6c7004f4-ceaf-4d43-8aa9-3c61f116ff11 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:56.025888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-6c7004f4-ceaf-4d43-8aa9-3c61f116ff11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:56.067427 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e419d6c-62dc-498a-8597-f76f380940b1 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:56.113703 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 349/709] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:56.140961 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7004f4-ceaf-4d43-8aa9-3c61f116ff11 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:56.171289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f635eea-2740-4204-b55b-762df1c96e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:56.172128 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f635eea-2740-4204-b55b-762df1c96e8f None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:56.172512 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f635eea-2740-4204-b55b-762df1c96e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:56.172891 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f635eea-2740-4204-b55b-762df1c96e8f None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:56.173874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f635eea-2740-4204-b55b-762df1c96e8f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:56.174293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f635eea-2740-4204-b55b-762df1c96e8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:56.175831 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f635eea-2740-4204-b55b-762df1c96e8f None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:56.198822 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:56.219969 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 361/710] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Jul 21 08:19:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:56.225809 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f635eea-2740-4204-b55b-762df1c96e8f None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:56.229371 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:56.275997 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7004f4-ceaf-4d43-8aa9-3c61f116ff11 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:56.321491 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14adfb-e689-4bd2-bb12-35f9615e2960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:56.322852 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14adfb-e689-4bd2-bb12-35f9615e2960 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:56.323820 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14adfb-e689-4bd2-bb12-35f9615e2960 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:56.324478 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14adfb-e689-4bd2-bb12-35f9615e2960 None admin] PATH_INFO: `/v3/services/network` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:56.325254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14adfb-e689-4bd2-bb12-35f9615e2960 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:56.326936 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14adfb-e689-4bd2-bb12-35f9615e2960 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:56.340385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-cc14adfb-e689-4bd2-bb12-35f9615e2960 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:19:56.340385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:56.340385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:19:56.340385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:19:56.340385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:19:56.340385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:19:56.340385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:19:56.340385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:19:56.340385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:19:56.340385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:56.340385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:19:56.340385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:56.340385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:56.340385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:56.340385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:56.340385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:56.340385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:56.341380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:56.341380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:56.341380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:56.341380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:56.341380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:56.341380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:56.341380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:19:56.341380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:19:56.341380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:19:56.341380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:19:56.341380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:56.341380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:56.341380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:56.341380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:56.341380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:56.341380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:56.342244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:56.342244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:56.342244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:56.342244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:56.342244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:56.342244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:56.342244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:56.342244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:56.342244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:56.342244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:56.342244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:19:56.342244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:19:56.342244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:19:56.342244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:56.345177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 350/711] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:56 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:19:56.350245 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f635eea-2740-4204-b55b-762df1c96e8f None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:56.351300 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14adfb-e689-4bd2-bb12-35f9615e2960 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:56.421045 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e62e4-1339-4c01-b11c-26c74558e2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:56.422072 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e62e4-1339-4c01-b11c-26c74558e2bf None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:56.423330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e62e4-1339-4c01-b11c-26c74558e2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:56.426284 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e62e4-1339-4c01-b11c-26c74558e2bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:56.515346 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14adfb-e689-4bd2-bb12-35f9615e2960 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:56.545888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:56.568876 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e62e4-1339-4c01-b11c-26c74558e2bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:56.570383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e62e4-1339-4c01-b11c-26c74558e2bf None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:56.574141 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:56.586589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d40fa-cbf2-4732-a59d-2ec20e3ffdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:56.587256 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d40fa-cbf2-4732-a59d-2ec20e3ffdf1 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:56.587536 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d40fa-cbf2-4732-a59d-2ec20e3ffdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:56.587807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d40fa-cbf2-4732-a59d-2ec20e3ffdf1 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:56.588552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d40fa-cbf2-4732-a59d-2ec20e3ffdf1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:56.588915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d40fa-cbf2-4732-a59d-2ec20e3ffdf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:56.592561 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76d40fa-cbf2-4732-a59d-2ec20e3ffdf1 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:56.601932 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 351/712] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 08:19:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:56.603819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bb7a8-8f4f-4655-8fdc-ff608a96210b None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:56.604380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bb7a8-8f4f-4655-8fdc-ff608a96210b None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:56.604920 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bb7a8-8f4f-4655-8fdc-ff608a96210b None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:56.606678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 352/713] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:56.611324 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bb7a8-8f4f-4655-8fdc-ff608a96210b None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:56.710554 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 362/714] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:19:56.711857 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac87d5-179a-4b50-9847-37c9dcd9f142 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:56.712142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac87d5-179a-4b50-9847-37c9dcd9f142 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:56.712885 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac87d5-179a-4b50-9847-37c9dcd9f142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:56.730060 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-f3ac87d5-179a-4b50-9847-37c9dcd9f142 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:56.731089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f3ac87d5-179a-4b50-9847-37c9dcd9f142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:56.752067 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bb7a8-8f4f-4655-8fdc-ff608a96210b None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:56.791435 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deab1e2-1958-4133-8ff6-02702ac8e09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:56.793006 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deab1e2-1958-4133-8ff6-02702ac8e09c None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:56.793516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deab1e2-1958-4133-8ff6-02702ac8e09c None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:56.794024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deab1e2-1958-4133-8ff6-02702ac8e09c None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:56.794958 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deab1e2-1958-4133-8ff6-02702ac8e09c None admin] RBAC: Adding query filter params (type=network) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:56.795471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deab1e2-1958-4133-8ff6-02702ac8e09c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:56.797053 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deab1e2-1958-4133-8ff6-02702ac8e09c None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:56.802432 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 353/715] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 08:19:56 2022] GET /identity/v3/services?type=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:56.803427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deab1e2-1958-4133-8ff6-02702ac8e09c None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:56.828146 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 363/716] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:56.868470 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:56.886828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac87d5-179a-4b50-9847-37c9dcd9f142 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:56.947210 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deab1e2-1958-4133-8ff6-02702ac8e09c None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:56.950581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:56.983804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29821771-a8e8-4817-abed-ab8167af3f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:56.984997 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29821771-a8e8-4817-abed-ab8167af3f87 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:56.985484 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29821771-a8e8-4817-abed-ab8167af3f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:56.985993 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29821771-a8e8-4817-abed-ab8167af3f87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:56.998929 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29821771-a8e8-4817-abed-ab8167af3f87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:57.000779 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29821771-a8e8-4817-abed-ab8167af3f87 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:57.019650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-29821771-a8e8-4817-abed-ab8167af3f87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:57.019650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:57.019650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:57.019650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:57.019650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:57.019650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:57.019650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:57.019650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:57.019650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:57.019650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:57.019650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:57.019650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:57.019650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:57.019650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:57.019650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:57.020625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:57.020625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:57.020625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:57.020625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:57.020625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:57.020625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:57.020625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:57.020625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:57.020625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:57.020625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:57.020625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:57.020625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:57.020625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:57.020625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:57.020625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:57.020625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:57.020625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:57.021634 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:57.021634 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:57.021634 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:57.021634 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:57.023896 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 354/717] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:57.030544 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29821771-a8e8-4817-abed-ab8167af3f87 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:57.062085 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac87d5-179a-4b50-9847-37c9dcd9f142 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:57.102054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e01ff-99ca-46c7-ae86-21558c605617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:57.103158 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e01ff-99ca-46c7-ae86-21558c605617 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:57.103292 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e01ff-99ca-46c7-ae86-21558c605617 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:57.103485 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e01ff-99ca-46c7-ae86-21558c605617 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:57.115558 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e01ff-99ca-46c7-ae86-21558c605617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:57.127312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-b90e01ff-99ca-46c7-ae86-21558c605617 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:57.127312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:57.127312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:57.127312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:57.127312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:57.127312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:57.127312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:57.127312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:57.127312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:57.127312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:57.127312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:57.127312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:57.127312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:57.127312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:57.127312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:57.127312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:57.133785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:57.133785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:57.133785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:57.133785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:57.133785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:57.133785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:57.133785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:57.133785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:57.133785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:57.133785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:57.133785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:57.133785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:57.133785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:57.133785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:57.133785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:57.133785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:57.134649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:57.134649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:57.134649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:57.134649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:57.134649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:57.134649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:57.134649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:57.134649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:57.134649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:57.134649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:57.134649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:19:57.134649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:57.134649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 364/718] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:19:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:57.139474 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e01ff-99ca-46c7-ae86-21558c605617 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:57.152241 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:57.167418 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29821771-a8e8-4817-abed-ab8167af3f87 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:57.238997 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f9bf0-31ac-4c76-82c3-d96462c8031e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:57.240555 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f9bf0-31ac-4c76-82c3-d96462c8031e None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:57.241441 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f9bf0-31ac-4c76-82c3-d96462c8031e None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:57.241987 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f9bf0-31ac-4c76-82c3-d96462c8031e None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:57.243037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f9bf0-31ac-4c76-82c3-d96462c8031e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:57.243545 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f9bf0-31ac-4c76-82c3-d96462c8031e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:57.245629 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f9bf0-31ac-4c76-82c3-d96462c8031e None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:57.260098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 355/719] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:57.274715 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f9bf0-31ac-4c76-82c3-d96462c8031e None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:57.305083 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:57.328435 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e01ff-99ca-46c7-ae86-21558c605617 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:57.411564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24be8e5-e241-445a-8a91-52bb1602bc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:57.412226 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24be8e5-e241-445a-8a91-52bb1602bc06 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:57.412510 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24be8e5-e241-445a-8a91-52bb1602bc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:57.412785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24be8e5-e241-445a-8a91-52bb1602bc06 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:57.413559 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24be8e5-e241-445a-8a91-52bb1602bc06 None admin] RBAC: Adding query filter params (name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:57.413860 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24be8e5-e241-445a-8a91-52bb1602bc06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:57.415306 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24be8e5-e241-445a-8a91-52bb1602bc06 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:57.423923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f9bf0-31ac-4c76-82c3-d96462c8031e None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:57.433205 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 365/720] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:19:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:57.439612 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24be8e5-e241-445a-8a91-52bb1602bc06 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:57.462667 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dab07f-2b10-4a28-8f9b-a3c82c1a05c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:57.464446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dab07f-2b10-4a28-8f9b-a3c82c1a05c7 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:57.465348 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dab07f-2b10-4a28-8f9b-a3c82c1a05c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:57.465850 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dab07f-2b10-4a28-8f9b-a3c82c1a05c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:57.473932 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dab07f-2b10-4a28-8f9b-a3c82c1a05c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:57.475707 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dab07f-2b10-4a28-8f9b-a3c82c1a05c7 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:57.492639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-c9dab07f-2b10-4a28-8f9b-a3c82c1a05c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:57.492639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:57.492639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:57.492639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:57.492639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:57.492639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:57.492639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:57.492639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:57.492639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:57.492639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:57.492639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:57.492639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:57.492639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:19:57.492639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:19:57.492639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:19:57.494275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:19:57.494275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:57.494275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:57.494275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:57.494275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:57.494275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:57.494275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:57.494275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:57.494275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:57.494275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:57.494275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:57.494275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:57.494275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:57.494275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:57.494275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:57.494275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:57.494275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:57.495750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:19:57.495750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:19:57.495750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:19:57.495750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:19:57.495750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:19:57.495750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:19:57.495750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:19:57.495750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:57.498149 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 356/721] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:57.504266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dab07f-2b10-4a28-8f9b-a3c82c1a05c7 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:57.533874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:57.658875 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24be8e5-e241-445a-8a91-52bb1602bc06 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:57.706806 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dab07f-2b10-4a28-8f9b-a3c82c1a05c7 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:57.730966 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508e967-2273-4319-b5e8-edc1fa8c9436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:57.732161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508e967-2273-4319-b5e8-edc1fa8c9436 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:57.732447 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508e967-2273-4319-b5e8-edc1fa8c9436 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:57.732981 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508e967-2273-4319-b5e8-edc1fa8c9436 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:57.749294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508e967-2273-4319-b5e8-edc1fa8c9436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:57.754201 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508e967-2273-4319-b5e8-edc1fa8c9436 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:57.762641 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749df81a-2525-4fc8-b2d3-006805d61ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:57.763408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749df81a-2525-4fc8-b2d3-006805d61ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:57.763698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749df81a-2525-4fc8-b2d3-006805d61ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:57.763972 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749df81a-2525-4fc8-b2d3-006805d61ef8 None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:57.764768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749df81a-2525-4fc8-b2d3-006805d61ef8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:57.765108 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749df81a-2525-4fc8-b2d3-006805d61ef8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:57.766646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749df81a-2525-4fc8-b2d3-006805d61ef8 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:57.777159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-0508e967-2273-4319-b5e8-edc1fa8c9436 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:57.777159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:57.777159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:57.777159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:57.777159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:57.777159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:57.777159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:57.777159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:57.777159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:57.777159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:57.777159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:57.777159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:57.777159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:57.777159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:57.777159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:57.778119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:57.778119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:57.778119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:57.778119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:57.778119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:57.778119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:57.778119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:57.778119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:57.778119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:57.778119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:57.778119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:57.778119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:57.778119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:57.778119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:57.778119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:57.778119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:57.778119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:57.779022 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:57.779022 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:57.779022 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:57.779022 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:57.779022 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 366/722] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:57.781571 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 357/723] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:19:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:57.781707 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fade97-d916-48c7-a560-7961343c19a8 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:57.781707 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fade97-d916-48c7-a560-7961343c19a8 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:57.781707 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fade97-d916-48c7-a560-7961343c19a8 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:57.785559 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 367/724] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:57.786968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fade97-d916-48c7-a560-7961343c19a8 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:57.787799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749df81a-2525-4fc8-b2d3-006805d61ef8 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:57.799149 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:57.873817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:57.911305 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749df81a-2525-4fc8-b2d3-006805d61ef8 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:57.913628 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fade97-d916-48c7-a560-7961343c19a8 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:57.957025 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b040a3a-f363-46c0-a5fb-08dd3308a697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:57.957710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b040a3a-f363-46c0-a5fb-08dd3308a697 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:57.957995 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b040a3a-f363-46c0-a5fb-08dd3308a697 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:57.958272 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b040a3a-f363-46c0-a5fb-08dd3308a697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:57.959117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b040a3a-f363-46c0-a5fb-08dd3308a697 None admin] RBAC: Adding query filter params (role.id=beed8caad097496292e544146859df5c, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=b6670a010c034f7999c9445452c02473) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:57.959408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b040a3a-f363-46c0-a5fb-08dd3308a697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:57.960136 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e1f98-891c-4bf4-ad82-7cd42f5c06ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:57.960836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b040a3a-f363-46c0-a5fb-08dd3308a697 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:57.961217 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e1f98-891c-4bf4-ad82-7cd42f5c06ae None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:57.961728 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e1f98-891c-4bf4-ad82-7cd42f5c06ae None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:57.962255 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e1f98-891c-4bf4-ad82-7cd42f5c06ae None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:57.964721 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e1f98-891c-4bf4-ad82-7cd42f5c06ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:57.965234 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e1f98-891c-4bf4-ad82-7cd42f5c06ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:57.967039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e1f98-891c-4bf4-ad82-7cd42f5c06ae None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:57.967717 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 368/725] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:19:57 2022] GET /identity/v3/role_assignments?user.id=b6670a010c034f7999c9445452c02473&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=beed8caad097496292e544146859df5c => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:57.969086 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa1e54-57ea-4e86-95b9-0e3c285d1d46 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:57.969534 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa1e54-57ea-4e86-95b9-0e3c285d1d46 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:57.969960 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa1e54-57ea-4e86-95b9-0e3c285d1d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:57.984149 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 358/726] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:57.991050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-f2fa1e54-57ea-4e86-95b9-0e3c285d1d46 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:57.992164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f2fa1e54-57ea-4e86-95b9-0e3c285d1d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:57.992515 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e1f98-891c-4bf4-ad82-7cd42f5c06ae None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:58.065898 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:58.073322 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 369/727] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:58.095423 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa1e54-57ea-4e86-95b9-0e3c285d1d46 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:58.216257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa1e54-57ea-4e86-95b9-0e3c285d1d46 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:58.256473 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e1f98-891c-4bf4-ad82-7cd42f5c06ae None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:58.260083 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9026b51-f011-4f3a-874f-e8ed1660509e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:58.261929 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9026b51-f011-4f3a-874f-e8ed1660509e None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:58.263331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9026b51-f011-4f3a-874f-e8ed1660509e None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:58.263829 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9026b51-f011-4f3a-874f-e8ed1660509e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:58.277113 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9026b51-f011-4f3a-874f-e8ed1660509e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:19:58.287594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-f9026b51-f011-4f3a-874f-e8ed1660509e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:19:58.287594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:58.287594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:58.287594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:58.287594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:58.287594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:58.287594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:58.287594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:58.287594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:58.287594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:58.287594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:58.287594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:58.287594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:19:58.287594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:19:58.287594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:19:58.287594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:19:58.288579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:19:58.288579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:19:58.288579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:19:58.288579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:19:58.288579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:58.288579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:58.288579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:58.288579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:58.288579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:58.288579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:58.288579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:58.288579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:58.288579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:58.288579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:58.288579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:58.288579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:58.289407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:58.289407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:58.289407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:58.289407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:58.289407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:19:58.289407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:19:58.289407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:19:58.289407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:19:58.289407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:19:58.289407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:19:58.289407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:19:58.289407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:58.295826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 370/728] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:19:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:58.295826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390fd36-c16f-4c95-9d91-e303f69cee42 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:58.295826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390fd36-c16f-4c95-9d91-e303f69cee42 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:58.295826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390fd36-c16f-4c95-9d91-e303f69cee42 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:58.296314 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 371/729] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:19:58.297594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390fd36-c16f-4c95-9d91-e303f69cee42 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:58.304131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:58.310208 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903ba73-7268-46c5-97a8-8c2fdf05583d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:58.311093 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903ba73-7268-46c5-97a8-8c2fdf05583d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:58.311534 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903ba73-7268-46c5-97a8-8c2fdf05583d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:58.311876 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903ba73-7268-46c5-97a8-8c2fdf05583d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:58.320440 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903ba73-7268-46c5-97a8-8c2fdf05583d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:58.322109 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903ba73-7268-46c5-97a8-8c2fdf05583d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:58.339190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-f903ba73-7268-46c5-97a8-8c2fdf05583d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:19:58.339190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:58.339190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:58.339190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:58.339190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:58.339190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:58.339190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:58.339190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:58.339190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:58.339190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:58.339190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:58.339190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:58.339190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:19:58.339190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:19:58.339190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:19:58.339190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:19:58.340228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:58.340228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:58.340228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:19:58.340228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:58.340228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:19:58.340228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:58.340228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:58.340228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:58.340228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:58.340228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:58.340228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:58.340228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:58.340228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:58.340228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:58.340228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:58.340228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:58.340228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:58.340228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:58.341178 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:58.341178 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:58.341178 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:19:58.341178 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:19:58.341178 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:19:58.341178 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:19:58.341178 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:19:58.341178 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:19:58.341178 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:19:58.341178 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:58.341178 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 359/730] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Jul 21 08:19:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:58.342492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb087a-e71b-4591-9b0a-0414ee5317f5 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:58.343149 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb087a-e71b-4591-9b0a-0414ee5317f5 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:58.343535 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb087a-e71b-4591-9b0a-0414ee5317f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:58.361033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-27bb087a-e71b-4591-9b0a-0414ee5317f5 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:58.362471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-27bb087a-e71b-4591-9b0a-0414ee5317f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:58.376707 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:58.425837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390fd36-c16f-4c95-9d91-e303f69cee42 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:58.446137 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 360/731] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:58.447235 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb087a-e71b-4591-9b0a-0414ee5317f5 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:58.479742 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a05144-e4fc-42ef-9d67-52ce1f28a099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:58.480532 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a05144-e4fc-42ef-9d67-52ce1f28a099 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:58.480933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a05144-e4fc-42ef-9d67-52ce1f28a099 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:58.481357 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a05144-e4fc-42ef-9d67-52ce1f28a099 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:58.482310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a05144-e4fc-42ef-9d67-52ce1f28a099 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:58.482723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a05144-e4fc-42ef-9d67-52ce1f28a099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:58.484233 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a05144-e4fc-42ef-9d67-52ce1f28a099 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:58.497895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 372/732] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:19:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:19:58.498888 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a05144-e4fc-42ef-9d67-52ce1f28a099 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:58.579851 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb087a-e71b-4591-9b0a-0414ee5317f5 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:58.606367 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:58.614692 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a05144-e4fc-42ef-9d67-52ce1f28a099 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:58.624750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2512567-85f0-4ca1-85b7-5bc5cc643760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:58.626002 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2512567-85f0-4ca1-85b7-5bc5cc643760 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:58.626429 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2512567-85f0-4ca1-85b7-5bc5cc643760 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:58.626843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2512567-85f0-4ca1-85b7-5bc5cc643760 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:58.628378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2512567-85f0-4ca1-85b7-5bc5cc643760 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:58.628854 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2512567-85f0-4ca1-85b7-5bc5cc643760 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:58.630610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2512567-85f0-4ca1-85b7-5bc5cc643760 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:58.642432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:58.654579 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 361/733] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Jul 21 08:19:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:58.655478 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a2e9e-0c2a-4ba7-baae-25fa27e935a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:58.655904 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2512567-85f0-4ca1-85b7-5bc5cc643760 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:58.656379 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a2e9e-0c2a-4ba7-baae-25fa27e935a3 None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:58.656760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a2e9e-0c2a-4ba7-baae-25fa27e935a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:58.657132 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a2e9e-0c2a-4ba7-baae-25fa27e935a3 None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:58.657992 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a2e9e-0c2a-4ba7-baae-25fa27e935a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:58.659609 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a2e9e-0c2a-4ba7-baae-25fa27e935a3 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:58.741686 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 373/734] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 08:19:58 2022] POST /identity/v3/services => generated 251 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:19:58.742806 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a2e9e-0c2a-4ba7-baae-25fa27e935a3 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:58.798900 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2512567-85f0-4ca1-85b7-5bc5cc643760 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:58.882780 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75677f-c173-4782-92d4-0fbea7ec8adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:58.883578 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75677f-c173-4782-92d4-0fbea7ec8adf None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:58.883855 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75677f-c173-4782-92d4-0fbea7ec8adf None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:58.884127 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75677f-c173-4782-92d4-0fbea7ec8adf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:58.910224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75677f-c173-4782-92d4-0fbea7ec8adf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:58.911717 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75677f-c173-4782-92d4-0fbea7ec8adf None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:58.941156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-8e75677f-c173-4782-92d4-0fbea7ec8adf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:58.941156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:58.941156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:58.941156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:58.941156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:58.941156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:58.941156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:58.941156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:58.941156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:58.941156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:58.941156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:58.941156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:58.941156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:58.941156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:58.941156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:58.942139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:58.942139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:58.942139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:58.942139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:58.942139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:58.942139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:58.942139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:58.942139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:58.942139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:58.942139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:58.942139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:58.942139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:58.942139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:58.942139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:58.942139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:58.942139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:58.942139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:58.943653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:58.943653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:58.943653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:58.943653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:58.943653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 362/735] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:58.950448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75677f-c173-4782-92d4-0fbea7ec8adf None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:58.962658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a2e9e-0c2a-4ba7-baae-25fa27e935a3 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:58.994083 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:59.016624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c05da4-01f0-4c69-8d79-714055b9114b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:59.017469 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c05da4-01f0-4c69-8d79-714055b9114b None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:59.018147 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c05da4-01f0-4c69-8d79-714055b9114b None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:59.018147 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c05da4-01f0-4c69-8d79-714055b9114b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:59.079777 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:59.094315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75677f-c173-4782-92d4-0fbea7ec8adf None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:59.099311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c05da4-01f0-4c69-8d79-714055b9114b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:59.100805 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c05da4-01f0-4c69-8d79-714055b9114b None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:59.132222 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5371e5-9f41-408f-a93c-08250aff05e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:59.133042 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5371e5-9f41-408f-a93c-08250aff05e8 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:59.133329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5371e5-9f41-408f-a93c-08250aff05e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:59.133627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5371e5-9f41-408f-a93c-08250aff05e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:59.134685 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5371e5-9f41-408f-a93c-08250aff05e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:59.134995 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5371e5-9f41-408f-a93c-08250aff05e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:59.136847 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5371e5-9f41-408f-a93c-08250aff05e8 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:59.155472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 363/736] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:59.160680 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5371e5-9f41-408f-a93c-08250aff05e8 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:59.255863 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 374/737] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:58 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:19:59.257550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca5438-2a9e-40ca-90af-e07656fca9f6 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:59.257851 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca5438-2a9e-40ca-90af-e07656fca9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:59.258127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca5438-2a9e-40ca-90af-e07656fca9f6 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:59.263446 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 375/738] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:19:59.264261 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca5438-2a9e-40ca-90af-e07656fca9f6 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:59.270104 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:59.297047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5371e5-9f41-408f-a93c-08250aff05e8 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:59.349691 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925cec3-9761-4b7c-8eec-458bf6ff0465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:59.350735 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925cec3-9761-4b7c-8eec-458bf6ff0465 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:59.351163 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925cec3-9761-4b7c-8eec-458bf6ff0465 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:59.351832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925cec3-9761-4b7c-8eec-458bf6ff0465 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:59.362228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:59.363486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925cec3-9761-4b7c-8eec-458bf6ff0465 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:59.365374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925cec3-9761-4b7c-8eec-458bf6ff0465 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:59.381806 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca5438-2a9e-40ca-90af-e07656fca9f6 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:59.385510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-1925cec3-9761-4b7c-8eec-458bf6ff0465 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:19:59.385510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:59.385510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:59.385510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:59.385510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:59.385510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:59.385510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:59.385510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:59.385510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:59.385510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:59.385510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:59.385510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:59.385510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:19:59.385510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:19:59.385510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:19:59.385510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:19:59.386658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:59.386658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:59.386658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:19:59.386658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:59.386658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:19:59.386658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:19:59.386658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:59.386658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:59.386658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:59.386658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:59.386658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:59.386658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:59.386658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:59.386658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:59.386658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:59.386658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:59.386658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:59.386658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:59.387740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:59.387740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:59.387740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:19:59.387740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:19:59.387740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:19:59.387740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:19:59.387740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:19:59.387740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:19:59.387740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:19:59.387740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:19:59.394329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 364/739] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:19:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:59.396466 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae5de6-69ad-4fcf-811c-727512fde1d1 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:59.397176 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae5de6-69ad-4fcf-811c-727512fde1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:59.397636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae5de6-69ad-4fcf-811c-727512fde1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:59.415783 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-baae5de6-69ad-4fcf-811c-727512fde1d1 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:19:59.417991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-baae5de6-69ad-4fcf-811c-727512fde1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:19:59.420360 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e5bfe-0da0-4e7c-9441-66c351140a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:59.421555 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e5bfe-0da0-4e7c-9441-66c351140a81 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:59.421676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e5bfe-0da0-4e7c-9441-66c351140a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:59.422223 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e5bfe-0da0-4e7c-9441-66c351140a81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:59.433142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e5bfe-0da0-4e7c-9441-66c351140a81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:59.435061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e5bfe-0da0-4e7c-9441-66c351140a81 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:59.454531 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-011e5bfe-0da0-4e7c-9441-66c351140a81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:59.454531 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:19:59.454531 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:19:59.454531 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:19:59.454531 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:19:59.454531 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:19:59.454531 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:19:59.454531 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:19:59.454531 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:19:59.454531 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:19:59.454531 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:19:59.454531 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:19:59.454531 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:19:59.454531 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:19:59.454531 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:19:59.455658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:19:59.455658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:19:59.455658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:19:59.455658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:19:59.455658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:19:59.455658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:19:59.455658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:19:59.455658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:19:59.455658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:19:59.455658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:19:59.455658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:19:59.455658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:19:59.455658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:19:59.455658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:19:59.455658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:19:59.455658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:19:59.455658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:19:59.456700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:19:59.456700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:19:59.456700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:19:59.456700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:19:59.456700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 376/740] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:19:59.457020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e5bfe-0da0-4e7c-9441-66c351140a81 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:59.493791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 365/741] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:19:59 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 08:19:59.494962 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae5de6-69ad-4fcf-811c-727512fde1d1 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:59.573883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:59.588135 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e5bfe-0da0-4e7c-9441-66c351140a81 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:59.598150 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae5de6-69ad-4fcf-811c-727512fde1d1 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:59.626276 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a619da-9d85-4b46-b080-d3ada5b768bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:59.627022 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a619da-9d85-4b46-b080-d3ada5b768bc None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:59.627226 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a619da-9d85-4b46-b080-d3ada5b768bc None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:59.627506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a619da-9d85-4b46-b080-d3ada5b768bc None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:59.628344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a619da-9d85-4b46-b080-d3ada5b768bc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:59.628749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a619da-9d85-4b46-b080-d3ada5b768bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:59.630356 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a619da-9d85-4b46-b080-d3ada5b768bc None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:59.632276 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:59.638488 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7d1d5-9888-4148-979b-330d9498e45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:59.639330 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7d1d5-9888-4148-979b-330d9498e45a None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:59.639758 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7d1d5-9888-4148-979b-330d9498e45a None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:59.640178 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7d1d5-9888-4148-979b-330d9498e45a None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:59.641047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7d1d5-9888-4148-979b-330d9498e45a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:19:59.646649 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7d1d5-9888-4148-979b-330d9498e45a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:59.646649 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7d1d5-9888-4148-979b-330d9498e45a None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:59.656594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 377/742] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Jul 21 08:19:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:59.656594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a619da-9d85-4b46-b080-d3ada5b768bc None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:59.659939 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 366/743] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:19:59.661757 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7d1d5-9888-4148-979b-330d9498e45a None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:19:59.789690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a619da-9d85-4b46-b080-d3ada5b768bc None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:59.801330 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7d1d5-9888-4148-979b-330d9498e45a None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:19:59.836452 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad53c0-6559-4efd-a63c-0245027c06a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:59.837076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a01478-ee6b-4258-a40a-955eea2abf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:19:59.837208 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad53c0-6559-4efd-a63c-0245027c06a8 None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:59.837564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad53c0-6559-4efd-a63c-0245027c06a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:59.837918 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad53c0-6559-4efd-a63c-0245027c06a8 None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:59.838374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a01478-ee6b-4258-a40a-955eea2abf90 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:19:59.839295 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a01478-ee6b-4258-a40a-955eea2abf90 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:19:59.839406 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad53c0-6559-4efd-a63c-0245027c06a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:59.839799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a01478-ee6b-4258-a40a-955eea2abf90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:19:59.840987 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad53c0-6559-4efd-a63c-0245027c06a8 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:59.844543 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:19:59.909613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a01478-ee6b-4258-a40a-955eea2abf90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:19:59.911085 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a01478-ee6b-4258-a40a-955eea2abf90 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:19:59.920734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 378/744] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 08:19:59 2022] POST /identity/v3/services => generated 240 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:19:59.922438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad53c0-6559-4efd-a63c-0245027c06a8 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:00.001569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:00.085128 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad53c0-6559-4efd-a63c-0245027c06a8 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:00.118814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 367/745] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:19:59 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 08:20:00.125233 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a01478-ee6b-4258-a40a-955eea2abf90 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:00.140235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cac15a-4b3d-4d19-b7f6-cd2e1031b9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:00.141112 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cac15a-4b3d-4d19-b7f6-cd2e1031b9dd None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:00.141391 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cac15a-4b3d-4d19-b7f6-cd2e1031b9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:00.141722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cac15a-4b3d-4d19-b7f6-cd2e1031b9dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:00.148921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cac15a-4b3d-4d19-b7f6-cd2e1031b9dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:00.150423 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cac15a-4b3d-4d19-b7f6-cd2e1031b9dd None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:00.166338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-53cac15a-4b3d-4d19-b7f6-cd2e1031b9dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:00.166338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:00.166338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:00.166338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:00.166338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:00.166338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:00.166338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:00.166338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:00.166338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:00.166338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:00.166338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:00.166338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:00.166338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:00.166338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:00.166338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:00.167338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:00.167338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:00.167338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:00.167338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:00.167338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:00.167338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:00.167338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:00.167338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:00.167338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:00.167338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:00.167338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:00.167338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:00.167338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:00.167338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:00.167338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:00.167338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:00.167338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:00.168213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:00.168213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:00.168213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:00.168213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:00.168213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:00.168213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:00.168213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:00.168213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:00.176274 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 379/746] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:19:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:00.179841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cac15a-4b3d-4d19-b7f6-cd2e1031b9dd None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:00.221086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:00.339407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cac15a-4b3d-4d19-b7f6-cd2e1031b9dd None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:00.352936 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:00.359643 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a01478-ee6b-4258-a40a-955eea2abf90 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:00.384554 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34dbe4b-25ce-43c9-8da2-381743d9796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:00.386016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dbe4b-25ce-43c9-8da2-381743d9796a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:00.387992 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dbe4b-25ce-43c9-8da2-381743d9796a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:00.388274 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34dbe4b-25ce-43c9-8da2-381743d9796a None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:00.389073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34dbe4b-25ce-43c9-8da2-381743d9796a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:00.389383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34dbe4b-25ce-43c9-8da2-381743d9796a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:00.390854 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34dbe4b-25ce-43c9-8da2-381743d9796a None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:00.402739 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9016c1f-1387-4ea0-9b48-bec60eff6fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:00.403353 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9016c1f-1387-4ea0-9b48-bec60eff6fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:00.403641 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9016c1f-1387-4ea0-9b48-bec60eff6fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:00.403918 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9016c1f-1387-4ea0-9b48-bec60eff6fb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:00.407542 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 380/747] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:20:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:00.409025 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de72273-3b5c-4c43-a107-72dc24a337fd None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:00.409540 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de72273-3b5c-4c43-a107-72dc24a337fd None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:00.410015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de72273-3b5c-4c43-a107-72dc24a337fd None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:00.411636 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 381/748] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:00.418597 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de72273-3b5c-4c43-a107-72dc24a337fd None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:00.420165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9016c1f-1387-4ea0-9b48-bec60eff6fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:00.421830 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9016c1f-1387-4ea0-9b48-bec60eff6fb4 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:00.444175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-b9016c1f-1387-4ea0-9b48-bec60eff6fb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:00.444175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:00.444175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:00.444175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:00.444175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:00.444175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:00.444175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:00.444175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:00.444175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:00.444175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:00.444175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:00.444175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:00.444175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:00.444175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:00.444175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:00.445114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:00.445114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:00.445114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:00.445114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:00.445114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:00.445114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:00.445114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:00.445114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:00.445114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:00.445114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:00.445114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:00.445114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:00.445114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:00.445114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:00.445114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:00.445114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:00.445114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:00.446060 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:00.446060 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:00.446060 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:00.446060 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:00.446060 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 368/749] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:00.446874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e0c33-dfa0-4f4c-b577-a7e4e5502a23 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:00.447154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e0c33-dfa0-4f4c-b577-a7e4e5502a23 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:00.447425 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e0c33-dfa0-4f4c-b577-a7e4e5502a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:00.468429 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-381e0c33-dfa0-4f4c-b577-a7e4e5502a23 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:00.470038 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-381e0c33-dfa0-4f4c-b577-a7e4e5502a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:00.545771 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 369/750] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:00.545958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de72273-3b5c-4c43-a107-72dc24a337fd None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:00.547070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e0c33-dfa0-4f4c-b577-a7e4e5502a23 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:00.577816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:00.586168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1d84d-7ba1-493a-9d09-4fc8b2fad026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:00.591916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1d84d-7ba1-493a-9d09-4fc8b2fad026 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:00.591916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1d84d-7ba1-493a-9d09-4fc8b2fad026 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:00.591916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1d84d-7ba1-493a-9d09-4fc8b2fad026 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:00.591916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1d84d-7ba1-493a-9d09-4fc8b2fad026 None admin] RBAC: Adding query filter params (role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=22750d44d710439da1d18a78419b1adf) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:00.591916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1d84d-7ba1-493a-9d09-4fc8b2fad026 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:00.591916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf1d84d-7ba1-493a-9d09-4fc8b2fad026 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:00.596664 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 382/751] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:20:00 2022] GET /identity/v3/role_assignments?user.id=22750d44d710439da1d18a78419b1adf&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:00.597315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1d84d-7ba1-493a-9d09-4fc8b2fad026 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:00.636147 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:00.703081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e0c33-dfa0-4f4c-b577-a7e4e5502a23 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:00.725258 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1d84d-7ba1-493a-9d09-4fc8b2fad026 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:00.746364 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c15a2-55f2-4267-aabf-329c8ce1b8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:00.747462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c15a2-55f2-4267-aabf-329c8ce1b8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:00.747981 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c15a2-55f2-4267-aabf-329c8ce1b8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:00.748470 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94c15a2-55f2-4267-aabf-329c8ce1b8e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:00.749443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c15a2-55f2-4267-aabf-329c8ce1b8e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:00.749987 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c15a2-55f2-4267-aabf-329c8ce1b8e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:00.752661 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94c15a2-55f2-4267-aabf-329c8ce1b8e2 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:00.779071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 370/752] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:00.785186 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c15a2-55f2-4267-aabf-329c8ce1b8e2 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:00.810287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89859f35-8092-4642-a09e-caa8d3302137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:00.811109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89859f35-8092-4642-a09e-caa8d3302137 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:00.811390 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89859f35-8092-4642-a09e-caa8d3302137 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:00.811662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89859f35-8092-4642-a09e-caa8d3302137 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:00.840916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89859f35-8092-4642-a09e-caa8d3302137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:20:00.848766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-89859f35-8092-4642-a09e-caa8d3302137 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:20:00.848766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:00.848766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:00.848766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:00.848766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:00.848766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:00.848766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:00.848766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:00.848766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:00.848766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:00.848766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:00.848766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:00.848766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:20:00.848766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:20:00.848766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:20:00.848766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:20:00.849799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:20:00.849799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:20:00.849799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:20:00.849799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:20:00.849799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:00.849799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:00.849799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:00.849799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:00.849799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:00.849799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:00.849799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:00.849799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:00.849799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:00.849799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:00.849799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:00.849799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:00.850656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:00.850656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:00.850656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:00.850656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:00.850656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:20:00.850656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:20:00.850656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:20:00.850656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:20:00.850656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:20:00.850656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:20:00.850656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:20:00.850656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:00.850656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 383/753] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:20:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:00.860987 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89859f35-8092-4642-a09e-caa8d3302137 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:00.883139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:00.913098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94c15a2-55f2-4267-aabf-329c8ce1b8e2 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:00.953401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4691811-3372-4545-9645-ed6c073f2ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:00.955145 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4691811-3372-4545-9645-ed6c073f2ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:00.955428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4691811-3372-4545-9645-ed6c073f2ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:00.955705 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4691811-3372-4545-9645-ed6c073f2ea9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:00.971131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4691811-3372-4545-9645-ed6c073f2ea9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:00.972640 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4691811-3372-4545-9645-ed6c073f2ea9 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:00.988081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-e4691811-3372-4545-9645-ed6c073f2ea9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:00.988081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:00.988081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:00.988081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:00.988081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:00.988081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:00.988081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:00.988081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:00.988081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:00.988081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:00.988081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:00.988081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:00.988081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:00.988081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:00.988081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:00.990201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:00.990201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:00.990201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:00.990201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:00.990201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:00.990201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:00.990201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:00.990201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:00.990201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:00.990201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:00.990201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:00.990201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:00.990201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:00.990201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:00.990201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:00.990201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:00.990201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:00.992384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:00.992384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:00.992384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:00.992384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:00.992384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:00.992384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:00.992384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:00.992384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:00.992384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 371/754] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:00.999656 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4691811-3372-4545-9645-ed6c073f2ea9 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:01.026327 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:01.039658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89859f35-8092-4642-a09e-caa8d3302137 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:01.134216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4691811-3372-4545-9645-ed6c073f2ea9 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:01.149597 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35930c88-435b-4f96-a6ae-f1f5eaf9ad53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:01.150288 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35930c88-435b-4f96-a6ae-f1f5eaf9ad53 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:01.150664 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35930c88-435b-4f96-a6ae-f1f5eaf9ad53 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:01.150982 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35930c88-435b-4f96-a6ae-f1f5eaf9ad53 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:01.151747 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35930c88-435b-4f96-a6ae-f1f5eaf9ad53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:01.152054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35930c88-435b-4f96-a6ae-f1f5eaf9ad53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:01.153552 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35930c88-435b-4f96-a6ae-f1f5eaf9ad53 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:01.163821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 384/755] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:20:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:01.165183 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51806e52-f8a8-4f06-8c1f-ea09169014cf None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:01.165477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51806e52-f8a8-4f06-8c1f-ea09169014cf None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:01.165812 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51806e52-f8a8-4f06-8c1f-ea09169014cf None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:01.167160 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 385/756] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:01.172087 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51806e52-f8a8-4f06-8c1f-ea09169014cf None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:01.176489 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494523d-2371-47f5-b8f8-b30ad4d5b007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:01.177158 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494523d-2371-47f5-b8f8-b30ad4d5b007 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:01.177438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494523d-2371-47f5-b8f8-b30ad4d5b007 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:01.177750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494523d-2371-47f5-b8f8-b30ad4d5b007 None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:01.178545 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494523d-2371-47f5-b8f8-b30ad4d5b007 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:01.178852 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494523d-2371-47f5-b8f8-b30ad4d5b007 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:01.180272 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494523d-2371-47f5-b8f8-b30ad4d5b007 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:01.188225 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:01.194426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 372/757] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:20:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:01.195798 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dc699-2733-491c-8e83-c7fe876a2c11 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:01.196088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dc699-2733-491c-8e83-c7fe876a2c11 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:01.196429 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dc699-2733-491c-8e83-c7fe876a2c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:01.216083 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-b66dc699-2733-491c-8e83-c7fe876a2c11 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:01.217347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b66dc699-2733-491c-8e83-c7fe876a2c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:01.290257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51806e52-f8a8-4f06-8c1f-ea09169014cf None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:01.297012 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 373/758] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:01.297913 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dc699-2733-491c-8e83-c7fe876a2c11 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:01.341222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15248e-71f9-4b93-8939-044965442593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:01.342042 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15248e-71f9-4b93-8939-044965442593 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:01.342318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15248e-71f9-4b93-8939-044965442593 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:01.342765 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15248e-71f9-4b93-8939-044965442593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:01.355074 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15248e-71f9-4b93-8939-044965442593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:01.356682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15248e-71f9-4b93-8939-044965442593 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:01.375117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-5c15248e-71f9-4b93-8939-044965442593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:01.375117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:01.375117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:01.375117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:01.375117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:01.375117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:01.375117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:01.375117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:01.375117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:01.375117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:01.375117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:01.375117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:01.375117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:01.375117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:01.375117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:01.376196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:01.376196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:01.376196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:01.376196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:01.376196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:01.376196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:01.376196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:01.376196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:01.376196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:01.376196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:01.376196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:01.376196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:01.376196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:01.376196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:01.376196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:01.376196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:01.376196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:01.377174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:01.377174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:01.377174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:01.377174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:01.378942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 386/759] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:01.379894 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15248e-71f9-4b93-8939-044965442593 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:01.388771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:01.420665 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dc699-2733-491c-8e83-c7fe876a2c11 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:01.450956 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:01.459670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a396067-d16b-46ca-86bd-2b1635066dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:01.460540 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a396067-d16b-46ca-86bd-2b1635066dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:01.461038 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a396067-d16b-46ca-86bd-2b1635066dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:01.461460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a396067-d16b-46ca-86bd-2b1635066dc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:01.462616 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a396067-d16b-46ca-86bd-2b1635066dc9 None admin] RBAC: Adding query filter params (role.id=beed8caad097496292e544146859df5c, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=e349e5dfcd74406b922d3d1ce0fa5ef4) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:01.466741 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a396067-d16b-46ca-86bd-2b1635066dc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:01.466741 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a396067-d16b-46ca-86bd-2b1635066dc9 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:01.470989 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 374/760] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:20:01 2022] GET /identity/v3/role_assignments?user.id=e349e5dfcd74406b922d3d1ce0fa5ef4&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=beed8caad097496292e544146859df5c => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:01.472008 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a396067-d16b-46ca-86bd-2b1635066dc9 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:01.491813 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15248e-71f9-4b93-8939-044965442593 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:01.558308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa577291-d695-46aa-aea7-691d83425b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:01.559422 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa577291-d695-46aa-aea7-691d83425b57 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:01.559845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa577291-d695-46aa-aea7-691d83425b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:01.560259 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa577291-d695-46aa-aea7-691d83425b57 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:01.561110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa577291-d695-46aa-aea7-691d83425b57 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:01.562750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa577291-d695-46aa-aea7-691d83425b57 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:01.585360 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a396067-d16b-46ca-86bd-2b1635066dc9 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:01.587354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-fa577291-d695-46aa-aea7-691d83425b57 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:20:01.587354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:01.587354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:01.587354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:01.587354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:01.587354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:01.587354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:01.587354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:01.587354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:20:01.587354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:01.587354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:01.587354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:01.587354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:01.587354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:01.587354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:01.587354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:01.588482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:01.588482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:01.588482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:01.588482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:01.588482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:01.588482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:01.588482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:01.588482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:01.588482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:01.588482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:01.588482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:01.588482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:01.588482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:01.588482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:01.588482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:01.588482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:01.589564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:01.589564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:01.589564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:01.589564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:01.589564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:01.589564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:01.589564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:01.589564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:01.589564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:01.589564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:01.589564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:01.589564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:01.589564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:01.589564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:20:01.589564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:01.589564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 387/761] 10.222.0.57 () {56 vars in 1129 bytes} [Thu Jul 21 08:20:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:01.599666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa577291-d695-46aa-aea7-691d83425b57 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:01.631101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b67c5-8d37-47f8-b457-070afe8843f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:01.631776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b67c5-8d37-47f8-b457-070afe8843f6 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:01.632068 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b67c5-8d37-47f8-b457-070afe8843f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:01.632346 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b67c5-8d37-47f8-b457-070afe8843f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:01.633092 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b67c5-8d37-47f8-b457-070afe8843f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:01.633403 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b67c5-8d37-47f8-b457-070afe8843f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:01.634871 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b67c5-8d37-47f8-b457-070afe8843f6 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:01.649025 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 375/762] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:01.654480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b67c5-8d37-47f8-b457-070afe8843f6 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:01.746106 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:01.769998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:01.773342 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa577291-d695-46aa-aea7-691d83425b57 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:01.839535 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79a681-2c99-4c10-bd42-b38c76e07f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:01.840204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79a681-2c99-4c10-bd42-b38c76e07f19 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:01.840486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79a681-2c99-4c10-bd42-b38c76e07f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:01.840761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79a681-2c99-4c10-bd42-b38c76e07f19 None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:01.841469 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79a681-2c99-4c10-bd42-b38c76e07f19 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:01.841799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79a681-2c99-4c10-bd42-b38c76e07f19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:01.843172 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79a681-2c99-4c10-bd42-b38c76e07f19 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:01.848248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b67c5-8d37-47f8-b457-070afe8843f6 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:01.858995 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 388/763] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Jul 21 08:20:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:01.861912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79a681-2c99-4c10-bd42-b38c76e07f19 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:01.913462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a2e11-0291-436c-9de8-1ad5bd233461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:01.914288 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a2e11-0291-436c-9de8-1ad5bd233461 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:01.914572 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a2e11-0291-436c-9de8-1ad5bd233461 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:01.914844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a2e11-0291-436c-9de8-1ad5bd233461 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:01.923821 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a2e11-0291-436c-9de8-1ad5bd233461 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:01.925519 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a2e11-0291-436c-9de8-1ad5bd233461 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:01.951537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-c72a2e11-0291-436c-9de8-1ad5bd233461 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:20:01.951537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:01.951537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:01.951537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:01.951537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:01.951537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:01.951537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:01.951537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:01.951537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:01.951537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:01.951537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:01.951537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:01.951537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:20:01.951537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:20:01.951537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:20:01.951537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:20:01.952550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:01.952550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:01.952550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:20:01.952550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:01.952550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:20:01.952550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:01.952550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:01.952550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:01.952550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:01.952550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:01.952550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:01.952550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:01.952550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:01.952550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:01.952550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:01.952550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:01.952550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:01.952550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:01.953553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:01.953553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:01.953553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:20:01.953553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:20:01.953553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:20:01.953553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:20:01.953553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:20:01.953553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:20:01.953553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:20:01.953553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:01.954117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 376/764] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Jul 21 08:20:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:01.962658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a2e11-0291-436c-9de8-1ad5bd233461 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:02.070774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79a681-2c99-4c10-bd42-b38c76e07f19 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:02.134172 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a2e11-0291-436c-9de8-1ad5bd233461 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:02.137887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed805d76-e95f-4626-993d-bcfc2ab92815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:02.138559 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805d76-e95f-4626-993d-bcfc2ab92815 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:02.138840 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805d76-e95f-4626-993d-bcfc2ab92815 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:02.139116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805d76-e95f-4626-993d-bcfc2ab92815 None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:02.139825 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed805d76-e95f-4626-993d-bcfc2ab92815 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:02.140132 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed805d76-e95f-4626-993d-bcfc2ab92815 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:02.141509 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed805d76-e95f-4626-993d-bcfc2ab92815 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:02.148171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:02.158716 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 389/765] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Jul 21 08:20:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:02.162036 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed805d76-e95f-4626-993d-bcfc2ab92815 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:02.170085 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:02.200738 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b8acb-3dbc-4bad-9f31-b2609adac794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:02.201420 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b8acb-3dbc-4bad-9f31-b2609adac794 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:02.201722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b8acb-3dbc-4bad-9f31-b2609adac794 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:02.201990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b8acb-3dbc-4bad-9f31-b2609adac794 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:02.202842 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b8acb-3dbc-4bad-9f31-b2609adac794 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:02.203146 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b8acb-3dbc-4bad-9f31-b2609adac794 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:02.204581 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b8acb-3dbc-4bad-9f31-b2609adac794 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:02.230255 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 377/766] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Jul 21 08:20:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:02.234148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974a0e5-e778-4220-a8e5-d72af95a1e2c None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:02.234433 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974a0e5-e778-4220-a8e5-d72af95a1e2c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:02.234709 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974a0e5-e778-4220-a8e5-d72af95a1e2c None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:02.236291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 378/767] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:02.237001 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974a0e5-e778-4220-a8e5-d72af95a1e2c None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:02.289497 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed805d76-e95f-4626-993d-bcfc2ab92815 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:02.337034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2cad8-3160-42ca-872d-9ecb3bc4d406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:02.337887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2cad8-3160-42ca-872d-9ecb3bc4d406 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:02.338199 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2cad8-3160-42ca-872d-9ecb3bc4d406 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:02.338908 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2cad8-3160-42ca-872d-9ecb3bc4d406 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:02.339989 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2cad8-3160-42ca-872d-9ecb3bc4d406 None admin] RBAC: Adding query filter params (interface=public, service_id=0e7f8d49368d4320860e23602a17c11c, region_id=RegionOne) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:02.340310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2cad8-3160-42ca-872d-9ecb3bc4d406 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:02.342358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2cad8-3160-42ca-872d-9ecb3bc4d406 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:02.348591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974a0e5-e778-4220-a8e5-d72af95a1e2c None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:02.353066 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 390/768] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Jul 21 08:20:02 2022] GET /identity/v3/endpoints?service_id=0e7f8d49368d4320860e23602a17c11c&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:02.354588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141f226-cdac-4a69-bfb4-d67d7689b985 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:02.354882 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141f226-cdac-4a69-bfb4-d67d7689b985 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:02.355163 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141f226-cdac-4a69-bfb4-d67d7689b985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:02.376620 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-c141f226-cdac-4a69-bfb4-d67d7689b985 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:02.378517 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-c141f226-cdac-4a69-bfb4-d67d7689b985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:02.393922 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5b276-aa05-451e-b930-de9d92458383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:02.394722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5b276-aa05-451e-b930-de9d92458383 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:02.395006 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5b276-aa05-451e-b930-de9d92458383 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:02.395534 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac5b276-aa05-451e-b930-de9d92458383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:02.410387 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5b276-aa05-451e-b930-de9d92458383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:02.412512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac5b276-aa05-451e-b930-de9d92458383 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:02.435799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-0ac5b276-aa05-451e-b930-de9d92458383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:02.435799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:02.435799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:02.435799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:02.435799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:02.435799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:02.435799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:02.435799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:02.435799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:02.435799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:02.435799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:02.435799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:02.435799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:02.435799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:02.435799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:02.437426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:02.437426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:02.437426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:02.437426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:02.437426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:02.437426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:02.437426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:02.437426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:02.437426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:02.437426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:02.437426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:02.437426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:02.437426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:02.437426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:02.437426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:02.437426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:02.437426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:02.439268 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:02.439268 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:02.439268 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:02.439268 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:02.442445 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 379/769] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:02.442445 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5b276-aa05-451e-b930-de9d92458383 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:02.445479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:02.463519 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 391/770] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:02.464548 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141f226-cdac-4a69-bfb4-d67d7689b985 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:02.485804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:02.580679 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac5b276-aa05-451e-b930-de9d92458383 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:02.596003 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141f226-cdac-4a69-bfb4-d67d7689b985 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:02.621070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048889e-c2dd-40a7-9ffe-cfa49dea9cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:02.621896 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048889e-c2dd-40a7-9ffe-cfa49dea9cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:02.622404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048889e-c2dd-40a7-9ffe-cfa49dea9cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:02.622669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048889e-c2dd-40a7-9ffe-cfa49dea9cc1 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:02.623450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048889e-c2dd-40a7-9ffe-cfa49dea9cc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:02.624916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048889e-c2dd-40a7-9ffe-cfa49dea9cc1 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:02.630830 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 380/771] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Jul 21 08:20:02 2022] GET /identity/v3/services => generated 772 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:02.631724 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048889e-c2dd-40a7-9ffe-cfa49dea9cc1 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:02.650250 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fdb41-64fa-4886-be1f-e47b105bebdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:02.650250 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fdb41-64fa-4886-be1f-e47b105bebdb None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:02.650250 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fdb41-64fa-4886-be1f-e47b105bebdb None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:02.650250 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760fdb41-64fa-4886-be1f-e47b105bebdb None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:02.650739 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fdb41-64fa-4886-be1f-e47b105bebdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:02.650739 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fdb41-64fa-4886-be1f-e47b105bebdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:02.650739 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760fdb41-64fa-4886-be1f-e47b105bebdb None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:02.679002 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 392/772] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:02.686262 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fdb41-64fa-4886-be1f-e47b105bebdb None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:02.799317 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:02.799636 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:02.812964 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048889e-c2dd-40a7-9ffe-cfa49dea9cc1 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:02.855712 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760fdb41-64fa-4886-be1f-e47b105bebdb None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:02.861145 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8435664-8bc0-44d3-a444-14c460c5ca25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:02.861985 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8435664-8bc0-44d3-a444-14c460c5ca25 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:02.862272 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8435664-8bc0-44d3-a444-14c460c5ca25 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:02.862548 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8435664-8bc0-44d3-a444-14c460c5ca25 None admin] PATH_INFO: `/v3/services/network` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:02.863211 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8435664-8bc0-44d3-a444-14c460c5ca25 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:02.864673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8435664-8bc0-44d3-a444-14c460c5ca25 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:02.879374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-a8435664-8bc0-44d3-a444-14c460c5ca25 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:20:02.879374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:02.879374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:02.879374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:02.879374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:02.879374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:02.879374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:02.879374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:02.879374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:20:02.879374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:02.879374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:02.879374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:02.879374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:02.879374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:02.879374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:02.879374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:02.879374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:02.880402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:02.880402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:02.880402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:02.880402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:02.880402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:02.880402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:02.880402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:02.880402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:02.880402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:02.880402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:02.880402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:02.880402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:02.880402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:02.880402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:02.880402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:02.880402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:02.881238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:02.881238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:02.881238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:02.881238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:02.881238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:02.881238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:02.881238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:02.881238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:02.881238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:02.881238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:02.881238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:02.881238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:02.881238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:20:02.881238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:02.881238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 381/773] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:02 2022] GET /identity/v3/services/network => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:02.898632 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8435664-8bc0-44d3-a444-14c460c5ca25 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:02.900522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec5041-c8b3-4e04-9ea1-6608c32283f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:02.901364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec5041-c8b3-4e04-9ea1-6608c32283f0 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:02.901676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec5041-c8b3-4e04-9ea1-6608c32283f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:02.902053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec5041-c8b3-4e04-9ea1-6608c32283f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:02.910420 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec5041-c8b3-4e04-9ea1-6608c32283f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:02.912300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec5041-c8b3-4e04-9ea1-6608c32283f0 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:02.928569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-edec5041-c8b3-4e04-9ea1-6608c32283f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:02.928569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:02.928569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:02.928569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:02.928569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:02.928569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:02.928569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:02.928569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:02.928569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:02.928569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:02.928569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:02.928569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:02.928569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:02.928569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:02.928569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:02.929505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:02.929505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:02.929505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:02.929505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:02.929505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:02.929505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:02.929505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:02.929505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:02.929505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:02.929505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:02.929505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:02.929505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:02.929505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:02.929505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:02.929505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:02.929505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:02.929505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:02.930436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:02.930436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:02.930436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:02.930436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:02.930436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:02.930436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:02.930436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:02.930436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:02.930861 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 393/774] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:02.936913 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec5041-c8b3-4e04-9ea1-6608c32283f0 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:03.067836 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8435664-8bc0-44d3-a444-14c460c5ca25 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:03.089163 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec5041-c8b3-4e04-9ea1-6608c32283f0 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:03.105026 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae2e8d-6216-4d7a-8981-1c8e6109daac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:03.105866 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae2e8d-6216-4d7a-8981-1c8e6109daac None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:03.106160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae2e8d-6216-4d7a-8981-1c8e6109daac None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:03.106511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae2e8d-6216-4d7a-8981-1c8e6109daac None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:03.107318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:03.108325 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae2e8d-6216-4d7a-8981-1c8e6109daac None admin] RBAC: Adding query filter params (name=network) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:03.108700 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae2e8d-6216-4d7a-8981-1c8e6109daac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:03.110143 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae2e8d-6216-4d7a-8981-1c8e6109daac None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:03.115248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 382/775] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 08:20:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:03.116619 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20055a-691f-4582-8213-7e9a8daf1aea None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:03.116911 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20055a-691f-4582-8213-7e9a8daf1aea None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:03.117191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20055a-691f-4582-8213-7e9a8daf1aea None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:03.124259 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 383/776] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:03.124654 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20055a-691f-4582-8213-7e9a8daf1aea None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:03.136991 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678fa97-8280-4aac-9fef-27c643d197f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:03.138137 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678fa97-8280-4aac-9fef-27c643d197f2 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:03.138414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678fa97-8280-4aac-9fef-27c643d197f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:03.138690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678fa97-8280-4aac-9fef-27c643d197f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:03.140081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678fa97-8280-4aac-9fef-27c643d197f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:03.140874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678fa97-8280-4aac-9fef-27c643d197f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:03.142951 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f678fa97-8280-4aac-9fef-27c643d197f2 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:03.144462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:03.159285 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 394/777] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:20:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:03.160563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed9377-0625-45fa-8a19-74ee6ffcb210 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:03.160856 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed9377-0625-45fa-8a19-74ee6ffcb210 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:03.161134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed9377-0625-45fa-8a19-74ee6ffcb210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:03.188872 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-66ed9377-0625-45fa-8a19-74ee6ffcb210 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:03.190503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-66ed9377-0625-45fa-8a19-74ee6ffcb210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:03.254079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20055a-691f-4582-8213-7e9a8daf1aea None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:03.273691 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 395/778] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:03.274904 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed9377-0625-45fa-8a19-74ee6ffcb210 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:03.290671 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d929c5-a15f-4756-93a9-1fc8d1da5d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:03.291453 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d929c5-a15f-4756-93a9-1fc8d1da5d89 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:03.291794 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d929c5-a15f-4756-93a9-1fc8d1da5d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:03.292139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d929c5-a15f-4756-93a9-1fc8d1da5d89 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:03.292912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d929c5-a15f-4756-93a9-1fc8d1da5d89 None admin] RBAC: Adding query filter params (type=network) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:03.293328 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d929c5-a15f-4756-93a9-1fc8d1da5d89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:03.295169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d929c5-a15f-4756-93a9-1fc8d1da5d89 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:03.300190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 384/779] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 08:20:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:03.305906 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d929c5-a15f-4756-93a9-1fc8d1da5d89 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:03.391092 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:03.400088 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed9377-0625-45fa-8a19-74ee6ffcb210 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:03.402269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:03.414523 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d929c5-a15f-4756-93a9-1fc8d1da5d89 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:03.438056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfba1c0-2a24-45d9-b162-447d54382d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:03.439349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfba1c0-2a24-45d9-b162-447d54382d35 None admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:03.439817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfba1c0-2a24-45d9-b162-447d54382d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:03.440372 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfba1c0-2a24-45d9-b162-447d54382d35 None admin] PATH_INFO: `/v3/projects/83100b3a5d584e39886c234391fdb204/users/b6670a010c034f7999c9445452c02473/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:03.442745 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfba1c0-2a24-45d9-b162-447d54382d35 None admin] RBAC: Authorizing `identity:create_grant(project_id=83100b3a5d584e39886c234391fdb204, user_id=b6670a010c034f7999c9445452c02473, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:03.444553 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfba1c0-2a24-45d9-b162-447d54382d35 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:03.454087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708ec34-6d42-4b64-a8d6-4cc904e636d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:03.454750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708ec34-6d42-4b64-a8d6-4cc904e636d6 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:03.455045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708ec34-6d42-4b64-a8d6-4cc904e636d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:03.455310 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708ec34-6d42-4b64-a8d6-4cc904e636d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:03.456105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708ec34-6d42-4b64-a8d6-4cc904e636d6 None admin] RBAC: Adding query filter params (interface=public, service_id=f788abfdf7554d54a306b592260c5634, region_id=RegionOne) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:03.456427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708ec34-6d42-4b64-a8d6-4cc904e636d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:03.457805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708ec34-6d42-4b64-a8d6-4cc904e636d6 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:03.470412 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 385/780] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Jul 21 08:20:03 2022] GET /identity/v3/endpoints?service_id=f788abfdf7554d54a306b592260c5634&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:03.470412 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708ec34-6d42-4b64-a8d6-4cc904e636d6 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:03.537712 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 396/781] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:20:03 2022] PUT /identity/v3/projects/83100b3a5d584e39886c234391fdb204/users/b6670a010c034f7999c9445452c02473/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:20:03.538742 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfba1c0-2a24-45d9-b162-447d54382d35 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:03.596140 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708ec34-6d42-4b64-a8d6-4cc904e636d6 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:03.639550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb601d-cc9a-4488-bba7-bc26fbcade30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:03.640834 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb601d-cc9a-4488-bba7-bc26fbcade30 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:03.641387 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb601d-cc9a-4488-bba7-bc26fbcade30 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:03.642095 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb601d-cc9a-4488-bba7-bc26fbcade30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:03.655901 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb601d-cc9a-4488-bba7-bc26fbcade30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:20:03.665829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-3cdb601d-cc9a-4488-bba7-bc26fbcade30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:20:03.665829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:03.665829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:03.665829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:03.665829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:03.665829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:03.665829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:03.665829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:03.665829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:03.665829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:03.665829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:03.665829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:03.665829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:20:03.665829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:20:03.665829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:20:03.665829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:20:03.667408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:20:03.667408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:20:03.667408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:20:03.667408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:20:03.667408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:03.667408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:03.667408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:03.667408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:03.667408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:03.667408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:03.667408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:03.667408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:03.667408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:03.667408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:03.667408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:03.667408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:03.668248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:03.668248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:03.668248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:03.668248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:03.668248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:20:03.668248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:20:03.668248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:20:03.668248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:20:03.668248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:20:03.668248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:20:03.668248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:20:03.668248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:03.671759 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 386/782] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:20:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:03.678802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb601d-cc9a-4488-bba7-bc26fbcade30 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:03.685368 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:03.781628 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfba1c0-2a24-45d9-b162-447d54382d35 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:03.824543 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546415f9-ea87-4648-be5c-45081efdce4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:03.825220 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546415f9-ea87-4648-be5c-45081efdce4f None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:03.825508 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546415f9-ea87-4648-be5c-45081efdce4f None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:03.826351 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546415f9-ea87-4648-be5c-45081efdce4f None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:03.827045 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546415f9-ea87-4648-be5c-45081efdce4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:03.828722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546415f9-ea87-4648-be5c-45081efdce4f None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:03.835570 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 397/783] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Jul 21 08:20:03 2022] GET /identity/v3/services => generated 772 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:03.836840 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f7552-e6f1-4ba3-95f8-e34978fbab71 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:03.837125 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f7552-e6f1-4ba3-95f8-e34978fbab71 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:03.837402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f7552-e6f1-4ba3-95f8-e34978fbab71 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:03.844620 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 398/784] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:03.844817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb601d-cc9a-4488-bba7-bc26fbcade30 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:03.846969 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bb205-5978-4a85-8d98-ad329e57654e None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:03.847251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bb205-5978-4a85-8d98-ad329e57654e None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:03.847522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bb205-5978-4a85-8d98-ad329e57654e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:03.875594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-c40bb205-5978-4a85-8d98-ad329e57654e None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:03.876811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-c40bb205-5978-4a85-8d98-ad329e57654e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:03.926354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:03.929441 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e32e8-b057-4689-8900-98a27e3acd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:03.930150 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e32e8-b057-4689-8900-98a27e3acd02 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:03.930438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e32e8-b057-4689-8900-98a27e3acd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:03.930716 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e32e8-b057-4689-8900-98a27e3acd02 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:03.931485 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e32e8-b057-4689-8900-98a27e3acd02 None admin] RBAC: Adding query filter params (name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:03.931795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e32e8-b057-4689-8900-98a27e3acd02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:03.933735 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e32e8-b057-4689-8900-98a27e3acd02 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:03.950511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 387/785] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:20:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:03.956715 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e32e8-b057-4689-8900-98a27e3acd02 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:03.976250 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 399/786] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:20:04.015101 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bb205-5978-4a85-8d98-ad329e57654e None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:04.076627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:04.131087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e32e8-b057-4689-8900-98a27e3acd02 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:04.157514 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bb205-5978-4a85-8d98-ad329e57654e None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:04.182871 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff87bea-7682-472d-8f27-8bf89e06693b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:04.183594 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff87bea-7682-472d-8f27-8bf89e06693b None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:04.183974 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff87bea-7682-472d-8f27-8bf89e06693b None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:04.184255 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff87bea-7682-472d-8f27-8bf89e06693b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:04.196902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff87bea-7682-472d-8f27-8bf89e06693b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:04.199438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff87bea-7682-472d-8f27-8bf89e06693b None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:04.201491 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34703b0a-c816-49f4-98ca-ec3603feb7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:04.202654 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34703b0a-c816-49f4-98ca-ec3603feb7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:04.202948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34703b0a-c816-49f4-98ca-ec3603feb7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:04.203225 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34703b0a-c816-49f4-98ca-ec3603feb7e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:04.215370 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34703b0a-c816-49f4-98ca-ec3603feb7e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:20:04.218291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-eff87bea-7682-472d-8f27-8bf89e06693b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:04.218291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:04.218291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:04.218291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:04.218291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:04.218291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:04.218291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:04.218291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:04.218291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:04.218291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:04.218291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:04.218291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:04.218291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:04.218291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:04.218291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:04.220118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:04.220118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:04.220118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:04.220118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:04.220118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:04.220118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:04.220118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:04.220118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:04.220118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:04.220118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:04.220118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:04.220118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:04.220118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:04.220118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:04.220118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:04.220118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:04.220118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:04.221209 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:04.221209 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:04.221209 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:04.221209 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:04.221209 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 388/787] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:04.227817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-34703b0a-c816-49f4-98ca-ec3603feb7e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:20:04.227817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:04.227817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:04.227817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:04.227817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:04.227817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:04.227817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:04.227817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:04.227817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:04.227817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:04.227817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:04.227817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:04.227817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:20:04.227817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:20:04.227817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:20:04.227817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:20:04.230589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:20:04.230589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:20:04.230589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:20:04.230589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:20:04.230589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:04.230589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:04.230589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:04.230589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:04.230589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:04.230589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:04.230589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:04.230589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:04.230589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:04.230589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:04.230589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:04.230589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:04.232537 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:04.232537 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:04.232537 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:04.232537 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:04.232537 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:20:04.232537 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:20:04.232537 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:20:04.232537 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:20:04.232537 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:20:04.232537 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:20:04.232537 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:20:04.232537 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:04.232537 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 400/788] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:20:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:04.233949 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff87bea-7682-472d-8f27-8bf89e06693b None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:04.241579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34703b0a-c816-49f4-98ca-ec3603feb7e5 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:04.285886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:04.359565 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff87bea-7682-472d-8f27-8bf89e06693b None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:04.379591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:04.397367 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a22616-a2ee-4030-bc17-db10b0125fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:04.398084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a22616-a2ee-4030-bc17-db10b0125fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:04.398368 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a22616-a2ee-4030-bc17-db10b0125fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:04.398654 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a22616-a2ee-4030-bc17-db10b0125fa9 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:04.399568 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a22616-a2ee-4030-bc17-db10b0125fa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:04.399881 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a22616-a2ee-4030-bc17-db10b0125fa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:04.401737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a22616-a2ee-4030-bc17-db10b0125fa9 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:04.414561 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 389/789] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:04.420898 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a22616-a2ee-4030-bc17-db10b0125fa9 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:04.529430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a22616-a2ee-4030-bc17-db10b0125fa9 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:04.567626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127d22b-ee32-4f2f-9c3f-bc653faa6dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:04.568439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127d22b-ee32-4f2f-9c3f-bc653faa6dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:04.568726 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127d22b-ee32-4f2f-9c3f-bc653faa6dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:04.569004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127d22b-ee32-4f2f-9c3f-bc653faa6dd8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:04.577251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127d22b-ee32-4f2f-9c3f-bc653faa6dd8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:04.578878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127d22b-ee32-4f2f-9c3f-bc653faa6dd8 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:04.601990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-a127d22b-ee32-4f2f-9c3f-bc653faa6dd8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:20:04.601990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:04.601990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:04.601990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:04.601990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:04.601990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:04.601990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:04.601990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:04.601990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:04.601990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:04.601990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:04.601990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:04.601990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:20:04.601990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:20:04.601990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:20:04.601990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:20:04.604857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:04.604857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:04.604857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:20:04.604857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:04.604857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:20:04.604857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:04.604857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:04.604857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:04.604857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:04.604857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:04.604857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:04.604857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:04.604857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:04.604857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:04.604857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:04.604857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:04.604857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:04.604857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:04.607261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:04.607261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:04.607261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:20:04.607261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:20:04.607261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:20:04.607261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:20:04.607261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:20:04.607261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:20:04.607261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:20:04.607261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:04.607261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 390/790] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Jul 21 08:20:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:04.611154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127d22b-ee32-4f2f-9c3f-bc653faa6dd8 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:04.623478 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34703b0a-c816-49f4-98ca-ec3603feb7e5 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:04.647063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:04.701989 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec7a75-3069-4d16-8780-9c6f434e45e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:04.702670 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec7a75-3069-4d16-8780-9c6f434e45e8 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:04.702949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec7a75-3069-4d16-8780-9c6f434e45e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:04.703223 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec7a75-3069-4d16-8780-9c6f434e45e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:04.703977 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec7a75-3069-4d16-8780-9c6f434e45e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:04.704282 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec7a75-3069-4d16-8780-9c6f434e45e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:04.705694 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec7a75-3069-4d16-8780-9c6f434e45e8 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:04.725149 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 401/791] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:20:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 487 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:04.732724 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec7a75-3069-4d16-8780-9c6f434e45e8 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:04.780941 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127d22b-ee32-4f2f-9c3f-bc653faa6dd8 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:04.818474 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:04.837985 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec7a75-3069-4d16-8780-9c6f434e45e8 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:04.860971 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd3996-3a47-467d-8ccf-2c67779b6467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:04.861671 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd3996-3a47-467d-8ccf-2c67779b6467 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:04.861949 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd3996-3a47-467d-8ccf-2c67779b6467 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:04.862223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd3996-3a47-467d-8ccf-2c67779b6467 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:04.863064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd3996-3a47-467d-8ccf-2c67779b6467 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:04.863368 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd3996-3a47-467d-8ccf-2c67779b6467 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:04.864857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd3996-3a47-467d-8ccf-2c67779b6467 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:04.874500 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d255c-76af-49c2-ba7b-2c9f687f5f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:04.875304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d255c-76af-49c2-ba7b-2c9f687f5f5d None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:04.875585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d255c-76af-49c2-ba7b-2c9f687f5f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:04.875862 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d255c-76af-49c2-ba7b-2c9f687f5f5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:04.887131 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d255c-76af-49c2-ba7b-2c9f687f5f5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:04.888703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d255c-76af-49c2-ba7b-2c9f687f5f5d None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:04.905172 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 391/792] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Jul 21 08:20:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:04.910590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd3996-3a47-467d-8ccf-2c67779b6467 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:04.911140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-7c6d255c-76af-49c2-ba7b-2c9f687f5f5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:04.911140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:04.911140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:04.911140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:04.911140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:04.911140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:04.911140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:04.911140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:04.911140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:04.911140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:04.911140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:04.911140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:04.911140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:04.911140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:04.911140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:04.913181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:04.913181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:04.913181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:04.913181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:04.913181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:04.913181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:04.913181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:04.913181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:04.913181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:04.913181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:04.913181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:04.913181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:04.913181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:04.913181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:04.913181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:04.913181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:04.913181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:04.915382 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:04.915382 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:04.915382 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:04.915382 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:04.915382 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 402/793] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:04.922659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d255c-76af-49c2-ba7b-2c9f687f5f5d None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:05.058499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:05.066972 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd3996-3a47-467d-8ccf-2c67779b6467 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:05.068007 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d255c-76af-49c2-ba7b-2c9f687f5f5d None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:05.106979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:05.113019 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448694e1-d710-49e8-9c11-49e8a8173260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:05.113903 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee8030-a192-42c1-a296-ab8e4f85eda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:05.114023 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448694e1-d710-49e8-9c11-49e8a8173260 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:05.114276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448694e1-d710-49e8-9c11-49e8a8173260 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:05.114621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448694e1-d710-49e8-9c11-49e8a8173260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:05.115242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee8030-a192-42c1-a296-ab8e4f85eda7 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:05.115708 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee8030-a192-42c1-a296-ab8e4f85eda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:05.116164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee8030-a192-42c1-a296-ab8e4f85eda7 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:05.117330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee8030-a192-42c1-a296-ab8e4f85eda7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:05.118342 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee8030-a192-42c1-a296-ab8e4f85eda7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:05.119999 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee8030-a192-42c1-a296-ab8e4f85eda7 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:05.126538 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448694e1-d710-49e8-9c11-49e8a8173260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:05.130237 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448694e1-d710-49e8-9c11-49e8a8173260 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:05.135914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 403/794] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:05.138043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f61df-b133-44b0-b474-b3e9509799b7 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:05.138483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f61df-b133-44b0-b474-b3e9509799b7 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:05.138907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f61df-b133-44b0-b474-b3e9509799b7 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:05.145181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 404/795] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:05.146119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f61df-b133-44b0-b474-b3e9509799b7 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:05.152084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-448694e1-d710-49e8-9c11-49e8a8173260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:05.152084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:05.152084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:05.152084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:05.152084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:05.152084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:05.152084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:05.152084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:05.152084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:05.152084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:05.152084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:05.152084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:05.152084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:05.152084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:05.152084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:05.153156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:05.153156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:05.153156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:05.153156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:05.153156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:05.153156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:05.153156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:05.153156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:05.153156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:05.153156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:05.153156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:05.153156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:05.153156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:05.153156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:05.153156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:05.153156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:05.153156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:05.154358 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:05.154358 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:05.154358 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:05.154358 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:05.155023 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 392/796] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:05.156350 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a0c76-7733-41f2-890b-f573e8a82b69 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:05.156703 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a0c76-7733-41f2-890b-f573e8a82b69 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:05.157051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a0c76-7733-41f2-890b-f573e8a82b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:05.178271 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-6d2a0c76-7733-41f2-890b-f573e8a82b69 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:05.180194 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-6d2a0c76-7733-41f2-890b-f573e8a82b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:05.263405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 393/797] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:05.264607 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a0c76-7733-41f2-890b-f573e8a82b69 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:05.281568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f61df-b133-44b0-b474-b3e9509799b7 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:05.310112 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3f39c-d0db-4fc0-bea2-9b637eac68c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:05.310823 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3f39c-d0db-4fc0-bea2-9b637eac68c4 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:05.311104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3f39c-d0db-4fc0-bea2-9b637eac68c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:05.311379 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3f39c-d0db-4fc0-bea2-9b637eac68c4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:05.318943 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3f39c-d0db-4fc0-bea2-9b637eac68c4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:05.320490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3f39c-d0db-4fc0-bea2-9b637eac68c4 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:05.336110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-d2e3f39c-d0db-4fc0-bea2-9b637eac68c4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:20:05.336110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:05.336110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:05.336110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:05.336110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:05.336110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:05.336110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:05.336110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:05.336110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:05.336110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:05.336110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:05.336110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:05.336110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:20:05.336110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:20:05.336110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:20:05.336110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:20:05.337121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:05.337121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:05.337121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:20:05.337121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:05.337121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:20:05.337121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:05.337121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:05.337121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:05.337121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:05.337121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:05.337121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:05.337121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:05.337121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:05.337121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:05.337121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:05.337121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:05.337121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:05.337121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:05.338718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:05.338718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:05.338718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:20:05.338718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:20:05.338718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:20:05.338718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:20:05.338718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:20:05.338718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:20:05.338718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:20:05.338718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:05.338718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 405/798] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:20:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:05.338718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3f39c-d0db-4fc0-bea2-9b637eac68c4 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:05.387499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:05.397173 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:05.421622 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a0c76-7733-41f2-890b-f573e8a82b69 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:05.452396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3f39c-d0db-4fc0-bea2-9b637eac68c4 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:05.459700 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7b4cd-5ff0-4f1d-b84d-1923e854f945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:05.460355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7b4cd-5ff0-4f1d-b84d-1923e854f945 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:05.460831 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7b4cd-5ff0-4f1d-b84d-1923e854f945 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:05.461106 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7b4cd-5ff0-4f1d-b84d-1923e854f945 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:05.461865 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7b4cd-5ff0-4f1d-b84d-1923e854f945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:05.462167 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7b4cd-5ff0-4f1d-b84d-1923e854f945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:05.464357 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7b4cd-5ff0-4f1d-b84d-1923e854f945 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:05.477550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 394/799] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:05.478432 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7b4cd-5ff0-4f1d-b84d-1923e854f945 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:05.491981 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca984e4-a0db-468b-bacd-580b77af21b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:05.493105 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca984e4-a0db-468b-bacd-580b77af21b0 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:05.493637 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca984e4-a0db-468b-bacd-580b77af21b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:05.494234 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca984e4-a0db-468b-bacd-580b77af21b0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:05.495626 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca984e4-a0db-468b-bacd-580b77af21b0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:05.497187 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca984e4-a0db-468b-bacd-580b77af21b0 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:05.510714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-cca984e4-a0db-468b-bacd-580b77af21b0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:20:05.510714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:05.510714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:05.510714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:05.510714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:05.510714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:05.510714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:05.510714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:05.510714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:20:05.510714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:05.510714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:05.510714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:05.510714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:05.510714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:05.510714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:05.510714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:05.511657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:05.511657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:05.511657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:05.511657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:05.511657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:05.511657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:05.511657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:05.511657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:05.511657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:05.511657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:05.511657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:05.511657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:05.511657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:05.511657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:05.511657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:05.511657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:05.512503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:05.512503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:05.512503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:05.512503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:05.512503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:05.512503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:05.512503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:05.512503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:05.512503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:05.512503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:05.512503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:05.512503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:05.512503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:05.512503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 08:20:05.512503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:05.520024 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 406/800] 10.222.0.57 () {56 vars in 1129 bytes} [Thu Jul 21 08:20:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:05.521118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca984e4-a0db-468b-bacd-580b77af21b0 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:05.586646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7b4cd-5ff0-4f1d-b84d-1923e854f945 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:05.624021 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2749b3f-2ab5-4f10-af19-a092f957af3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:05.624693 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2749b3f-2ab5-4f10-af19-a092f957af3d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:05.624973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2749b3f-2ab5-4f10-af19-a092f957af3d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:05.625233 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2749b3f-2ab5-4f10-af19-a092f957af3d None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:05.626099 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2749b3f-2ab5-4f10-af19-a092f957af3d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:05.626404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2749b3f-2ab5-4f10-af19-a092f957af3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:05.627827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2749b3f-2ab5-4f10-af19-a092f957af3d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:05.628113 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca984e4-a0db-468b-bacd-580b77af21b0 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:05.630534 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:05.644355 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:05.648487 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 395/801] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Jul 21 08:20:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:05.649377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2749b3f-2ab5-4f10-af19-a092f957af3d None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:05.666440 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b7226-d9e9-42dd-85e8-3dab56110a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:05.667560 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b7226-d9e9-42dd-85e8-3dab56110a72 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:05.668068 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b7226-d9e9-42dd-85e8-3dab56110a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:05.668539 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b7226-d9e9-42dd-85e8-3dab56110a72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:05.676322 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b7226-d9e9-42dd-85e8-3dab56110a72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:05.678334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b7226-d9e9-42dd-85e8-3dab56110a72 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:05.693994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-4d7b7226-d9e9-42dd-85e8-3dab56110a72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:05.693994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:05.693994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:05.693994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:05.693994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:05.693994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:05.693994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:05.693994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:05.693994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:05.693994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:05.693994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:05.693994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:05.693994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:05.693994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:05.693994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:05.697006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:05.697006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:05.697006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:05.697006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:05.697006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:05.697006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:05.697006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:05.697006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:05.697006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:05.697006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:05.697006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:05.697006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:05.697006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:05.697006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:05.697006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:05.697006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:05.697006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:05.698657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:05.698657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:05.698657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:05.698657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:05.698657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:05.698657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:05.698657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:05.698657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:05.698657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 407/802] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:05.700285 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b7226-d9e9-42dd-85e8-3dab56110a72 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:05.757195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2749b3f-2ab5-4f10-af19-a092f957af3d None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:05.795417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ee97f-aa5d-49f2-bcff-8634eeafe735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:05.796090 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ee97f-aa5d-49f2-bcff-8634eeafe735 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:05.796387 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ee97f-aa5d-49f2-bcff-8634eeafe735 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:05.796627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ee97f-aa5d-49f2-bcff-8634eeafe735 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:05.797337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ee97f-aa5d-49f2-bcff-8634eeafe735 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:05.797686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ee97f-aa5d-49f2-bcff-8634eeafe735 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:05.799159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ee97f-aa5d-49f2-bcff-8634eeafe735 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:05.809294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 396/803] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Jul 21 08:20:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:05.809294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ee97f-aa5d-49f2-bcff-8634eeafe735 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:05.817408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b7226-d9e9-42dd-85e8-3dab56110a72 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:05.853565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be9a6a-e8e4-4ddc-bf1f-a6356b70bc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:05.854822 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be9a6a-e8e4-4ddc-bf1f-a6356b70bc59 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:05.855103 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be9a6a-e8e4-4ddc-bf1f-a6356b70bc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:05.855376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be9a6a-e8e4-4ddc-bf1f-a6356b70bc59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:05.866006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be9a6a-e8e4-4ddc-bf1f-a6356b70bc59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:05.867468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be9a6a-e8e4-4ddc-bf1f-a6356b70bc59 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:05.886104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-07be9a6a-e8e4-4ddc-bf1f-a6356b70bc59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:05.886104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:05.886104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:05.886104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:05.886104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:05.886104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:05.886104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:05.886104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:05.886104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:05.886104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:05.886104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:05.886104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:05.886104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:05.886104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:05.886104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:05.887046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:05.887046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:05.887046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:05.887046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:05.887046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:05.887046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:05.887046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:05.887046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:05.887046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:05.887046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:05.887046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:05.887046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:05.887046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:05.887046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:05.887046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:05.887046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:05.887046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:05.887943 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:05.887943 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:05.887943 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:05.887943 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:05.888995 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:05.892156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 408/804] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:05.893052 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be9a6a-e8e4-4ddc-bf1f-a6356b70bc59 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:05.920840 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:05.922764 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ee97f-aa5d-49f2-bcff-8634eeafe735 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:05.960241 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80482590-3ecb-46ba-a9f3-0f1e88e7b4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:05.960903 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80482590-3ecb-46ba-a9f3-0f1e88e7b4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:05.961188 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80482590-3ecb-46ba-a9f3-0f1e88e7b4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:05.961466 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80482590-3ecb-46ba-a9f3-0f1e88e7b4c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:05.962520 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80482590-3ecb-46ba-a9f3-0f1e88e7b4c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:05.962627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80482590-3ecb-46ba-a9f3-0f1e88e7b4c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:05.964069 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80482590-3ecb-46ba-a9f3-0f1e88e7b4c8 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:05.977516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 397/805] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:20:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:05.978367 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80482590-3ecb-46ba-a9f3-0f1e88e7b4c8 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:06.000000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be9a6a-e8e4-4ddc-bf1f-a6356b70bc59 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:06.041874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a641f95-f2b9-4408-8667-dbe1dc530e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:06.042542 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a641f95-f2b9-4408-8667-dbe1dc530e36 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:06.042824 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a641f95-f2b9-4408-8667-dbe1dc530e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:06.043100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a641f95-f2b9-4408-8667-dbe1dc530e36 None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:06.043802 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a641f95-f2b9-4408-8667-dbe1dc530e36 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:06.044105 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a641f95-f2b9-4408-8667-dbe1dc530e36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:06.045487 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a641f95-f2b9-4408-8667-dbe1dc530e36 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:06.050705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 409/806] 10.222.0.57 () {56 vars in 1124 bytes} [Thu Jul 21 08:20:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:06.051913 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c6b34-102a-44f0-aa33-ba1e88987fed None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:06.052200 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c6b34-102a-44f0-aa33-ba1e88987fed None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:06.052477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c6b34-102a-44f0-aa33-ba1e88987fed None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:06.053888 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 410/807] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:06.058275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c6b34-102a-44f0-aa33-ba1e88987fed None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:06.092643 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80482590-3ecb-46ba-a9f3-0f1e88e7b4c8 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:06.114321 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:06.132148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecaca7f-3733-4761-89fe-1dcaf6617dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:06.132813 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecaca7f-3733-4761-89fe-1dcaf6617dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:06.133096 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecaca7f-3733-4761-89fe-1dcaf6617dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:06.133373 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecaca7f-3733-4761-89fe-1dcaf6617dc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:06.134143 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecaca7f-3733-4761-89fe-1dcaf6617dc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:06.134457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecaca7f-3733-4761-89fe-1dcaf6617dc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:06.135978 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecaca7f-3733-4761-89fe-1dcaf6617dc5 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:06.149321 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 398/808] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:06.150166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecaca7f-3733-4761-89fe-1dcaf6617dc5 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:06.156849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:06.168933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c6b34-102a-44f0-aa33-ba1e88987fed None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:06.205234 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37bcbeb-6d0d-4228-be45-e2028a988c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:06.206188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bcbeb-6d0d-4228-be45-e2028a988c60 None admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:06.206471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bcbeb-6d0d-4228-be45-e2028a988c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:06.206745 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37bcbeb-6d0d-4228-be45-e2028a988c60 None admin] PATH_INFO: `/v3/projects/83100b3a5d584e39886c234391fdb204/users/22750d44d710439da1d18a78419b1adf/roles/9bbdc03bd7dc4b7fb84bb74bf49e49d4` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:06.224167 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bcbeb-6d0d-4228-be45-e2028a988c60 None admin] RBAC: Authorizing `identity:create_grant(project_id=83100b3a5d584e39886c234391fdb204, user_id=22750d44d710439da1d18a78419b1adf, role_id=9bbdc03bd7dc4b7fb84bb74bf49e49d4)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:06.225663 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37bcbeb-6d0d-4228-be45-e2028a988c60 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:06.312971 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 411/809] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:20:06 2022] PUT /identity/v3/projects/83100b3a5d584e39886c234391fdb204/users/22750d44d710439da1d18a78419b1adf/roles/9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:20:06.314343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026648b6-5288-4272-8c00-b75340910eb9 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:06.314639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026648b6-5288-4272-8c00-b75340910eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:06.314920 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026648b6-5288-4272-8c00-b75340910eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:06.332724 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-026648b6-5288-4272-8c00-b75340910eb9 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:06.334001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-026648b6-5288-4272-8c00-b75340910eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:06.371382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecaca7f-3733-4761-89fe-1dcaf6617dc5 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:06.407649 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4d2fc-7f1c-4e05-a1a3-d1156e1824cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:06.408320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4d2fc-7f1c-4e05-a1a3-d1156e1824cf None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:06.413874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4d2fc-7f1c-4e05-a1a3-d1156e1824cf None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:06.414046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 412/810] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:06.414126 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4d2fc-7f1c-4e05-a1a3-d1156e1824cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:06.414198 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026648b6-5288-4272-8c00-b75340910eb9 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:06.414371 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4d2fc-7f1c-4e05-a1a3-d1156e1824cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:06.414371 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4d2fc-7f1c-4e05-a1a3-d1156e1824cf None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:06.492373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:06.519395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 399/811] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Jul 21 08:20:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:20:06.520897 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9037a-e7c7-45ae-a95b-2c43b3058530 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:06.521256 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9037a-e7c7-45ae-a95b-2c43b3058530 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:06.521627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9037a-e7c7-45ae-a95b-2c43b3058530 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:06.523033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 400/812] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:06.526150 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9037a-e7c7-45ae-a95b-2c43b3058530 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:06.529502 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026648b6-5288-4272-8c00-b75340910eb9 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:06.570316 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:06.578389 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdeea86-25f9-4d87-831e-3bfd783d0373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:06.579529 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdeea86-25f9-4d87-831e-3bfd783d0373 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:06.580001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdeea86-25f9-4d87-831e-3bfd783d0373 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:06.580451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdeea86-25f9-4d87-831e-3bfd783d0373 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:06.589554 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdeea86-25f9-4d87-831e-3bfd783d0373 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:06.591372 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdeea86-25f9-4d87-831e-3bfd783d0373 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:06.608368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-4fdeea86-25f9-4d87-831e-3bfd783d0373 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:06.608368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:06.608368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:06.608368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:06.608368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:06.608368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:06.608368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:06.608368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:06.608368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:06.608368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:06.608368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:06.608368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:06.608368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:06.608368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:06.608368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:06.609350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:06.609350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:06.609350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:06.609350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:06.609350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:06.609350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:06.609350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:06.609350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:06.609350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:06.609350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:06.609350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:06.609350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:06.609350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:06.609350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:06.609350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:06.609350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:06.609350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:06.610358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:06.610358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:06.610358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:06.610358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:06.610358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:06.610358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:06.610358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:06.610358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:06.612585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 413/813] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:06.614264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d65ac-e702-4f0f-8b14-f396dbb807d0 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:06.614752 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d65ac-e702-4f0f-8b14-f396dbb807d0 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:06.615197 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d65ac-e702-4f0f-8b14-f396dbb807d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:06.639471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-575d65ac-e702-4f0f-8b14-f396dbb807d0 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:06.640789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-575d65ac-e702-4f0f-8b14-f396dbb807d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:06.660546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9037a-e7c7-45ae-a95b-2c43b3058530 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:06.706181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d7da5-38ad-40ef-a0d3-25e53022acc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:06.707376 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d7da5-38ad-40ef-a0d3-25e53022acc4 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:06.707720 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d7da5-38ad-40ef-a0d3-25e53022acc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:06.708747 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d7da5-38ad-40ef-a0d3-25e53022acc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:06.723081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d7da5-38ad-40ef-a0d3-25e53022acc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:20:06.727214 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 414/814] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:06.728272 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d65ac-e702-4f0f-8b14-f396dbb807d0 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:06.731954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-192d7da5-38ad-40ef-a0d3-25e53022acc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:20:06.731954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:06.731954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:06.731954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:06.731954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:06.731954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:06.731954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:06.731954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:06.731954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:06.731954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:06.731954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:06.731954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:06.731954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:20:06.731954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:20:06.731954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:20:06.731954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:20:06.732883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:20:06.732883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:20:06.732883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:20:06.732883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:20:06.732883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:06.732883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:06.732883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:06.732883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:06.732883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:06.732883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:06.732883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:06.732883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:06.732883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:06.732883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:06.732883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:06.732883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:06.733803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:06.733803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:06.733803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:06.733803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:06.733803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:20:06.733803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:20:06.733803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:20:06.733803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:20:06.733803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:20:06.733803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:20:06.733803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:20:06.733803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:06.733803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 401/815] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:20:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:06.739075 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d7da5-38ad-40ef-a0d3-25e53022acc4 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:06.802869 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:06.848423 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d65ac-e702-4f0f-8b14-f396dbb807d0 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:06.860379 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:06.868247 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d7da5-38ad-40ef-a0d3-25e53022acc4 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:06.884523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630281f-4de7-49fb-8ba7-8966fea4c091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:06.885799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630281f-4de7-49fb-8ba7-8966fea4c091 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:06.886084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630281f-4de7-49fb-8ba7-8966fea4c091 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:06.886360 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630281f-4de7-49fb-8ba7-8966fea4c091 None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:06.887145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630281f-4de7-49fb-8ba7-8966fea4c091 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:06.887454 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630281f-4de7-49fb-8ba7-8966fea4c091 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:06.888888 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7630281f-4de7-49fb-8ba7-8966fea4c091 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:06.901369 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 415/816] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:20:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:06.906875 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630281f-4de7-49fb-8ba7-8966fea4c091 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:06.908883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487c165-6134-43f3-b38c-d0c5b722e24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:06.909843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487c165-6134-43f3-b38c-d0c5b722e24f None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:06.910406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487c165-6134-43f3-b38c-d0c5b722e24f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:06.910848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c487c165-6134-43f3-b38c-d0c5b722e24f None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:06.911806 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487c165-6134-43f3-b38c-d0c5b722e24f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:06.912255 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487c165-6134-43f3-b38c-d0c5b722e24f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:06.913798 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c487c165-6134-43f3-b38c-d0c5b722e24f None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:06.924467 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 402/817] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:20:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:06.926249 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487c165-6134-43f3-b38c-d0c5b722e24f None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:07.023821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630281f-4de7-49fb-8ba7-8966fea4c091 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:07.042322 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:07.059575 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c487c165-6134-43f3-b38c-d0c5b722e24f None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:07.060969 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6e4a2-fa8c-4c7b-b867-a6c7f39d2d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:07.061806 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6e4a2-fa8c-4c7b-b867-a6c7f39d2d3c None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:07.062086 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6e4a2-fa8c-4c7b-b867-a6c7f39d2d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:07.062359 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6e4a2-fa8c-4c7b-b867-a6c7f39d2d3c None admin] PATH_INFO: `/v3/services/network` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:07.063699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6e4a2-fa8c-4c7b-b867-a6c7f39d2d3c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:07.064943 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6e4a2-fa8c-4c7b-b867-a6c7f39d2d3c None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:07.077761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-37b6e4a2-fa8c-4c7b-b867-a6c7f39d2d3c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:20:07.077761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:07.077761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:07.077761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:07.077761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:07.077761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:07.077761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:07.077761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:07.077761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:20:07.077761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:07.077761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:07.077761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:07.077761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:07.077761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:07.077761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:07.077761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:07.077761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:07.078990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:07.078990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:07.078990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:07.078990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:07.078990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:07.078990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:07.078990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:07.078990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:07.078990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:07.078990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:07.078990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:07.078990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:07.078990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:07.078990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:07.078990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:07.078990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:07.080019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:07.080019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:07.080019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:07.080019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:07.080019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:07.080019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:07.080019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:07.080019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:07.080019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:07.080019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:07.080019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:07.080019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:07.080019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 08:20:07.080019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:07.088024 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 416/818] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:06 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:07.088980 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6e4a2-fa8c-4c7b-b867-a6c7f39d2d3c None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:07.107296 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16167fd-0db6-48ec-9a00-b1292776b35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:07.108460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16167fd-0db6-48ec-9a00-b1292776b35d None admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:07.109085 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16167fd-0db6-48ec-9a00-b1292776b35d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:07.109500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16167fd-0db6-48ec-9a00-b1292776b35d None admin] PATH_INFO: `/v3/projects/83100b3a5d584e39886c234391fdb204/users/e349e5dfcd74406b922d3d1ce0fa5ef4/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:07.112104 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16167fd-0db6-48ec-9a00-b1292776b35d None admin] RBAC: Authorizing `identity:create_grant(project_id=83100b3a5d584e39886c234391fdb204, user_id=e349e5dfcd74406b922d3d1ce0fa5ef4, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:07.114355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16167fd-0db6-48ec-9a00-b1292776b35d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:07.198451 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 403/819] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:20:06 2022] PUT /identity/v3/projects/83100b3a5d584e39886c234391fdb204/users/e349e5dfcd74406b922d3d1ce0fa5ef4/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:20:07.198451 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16167fd-0db6-48ec-9a00-b1292776b35d None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:07.204934 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6e4a2-fa8c-4c7b-b867-a6c7f39d2d3c None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:07.237595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:07.282678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521c3b2-fd38-4b8b-a6d6-c660954fb1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:07.283542 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521c3b2-fd38-4b8b-a6d6-c660954fb1be None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:07.284765 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521c3b2-fd38-4b8b-a6d6-c660954fb1be None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:07.284765 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521c3b2-fd38-4b8b-a6d6-c660954fb1be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:07.305361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521c3b2-fd38-4b8b-a6d6-c660954fb1be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:07.307451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521c3b2-fd38-4b8b-a6d6-c660954fb1be None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:07.339550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-5521c3b2-fd38-4b8b-a6d6-c660954fb1be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:07.339550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:07.339550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:07.339550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:07.339550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:07.339550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:07.339550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:07.339550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:07.339550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:07.339550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:07.339550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:07.339550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:07.339550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:07.339550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:07.339550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:07.340516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:07.340516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:07.340516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:07.340516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:07.340516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:07.340516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:07.340516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:07.340516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:07.340516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:07.340516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:07.340516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:07.340516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:07.340516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:07.340516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:07.340516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:07.340516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:07.340516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:07.341470 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:07.341470 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:07.341470 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:07.341470 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:07.342522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 417/820] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:07.347622 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521c3b2-fd38-4b8b-a6d6-c660954fb1be None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:07.400012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:07.405464 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16167fd-0db6-48ec-9a00-b1292776b35d None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:07.454755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a77f54-2d3d-4158-8fc8-ae2a536c94b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:07.455762 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a77f54-2d3d-4158-8fc8-ae2a536c94b0 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:07.456248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a77f54-2d3d-4158-8fc8-ae2a536c94b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:07.456818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a77f54-2d3d-4158-8fc8-ae2a536c94b0 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:07.457753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a77f54-2d3d-4158-8fc8-ae2a536c94b0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:07.458290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a77f54-2d3d-4158-8fc8-ae2a536c94b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:07.459983 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a77f54-2d3d-4158-8fc8-ae2a536c94b0 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:07.465359 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 404/821] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 08:20:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:07.474625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a77f54-2d3d-4158-8fc8-ae2a536c94b0 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:07.488887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521c3b2-fd38-4b8b-a6d6-c660954fb1be None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:07.539282 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a04203-8329-47a0-be74-b0556d26aabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:07.539950 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a04203-8329-47a0-be74-b0556d26aabd None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:07.540231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a04203-8329-47a0-be74-b0556d26aabd None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:07.540503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a04203-8329-47a0-be74-b0556d26aabd None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:07.541261 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a04203-8329-47a0-be74-b0556d26aabd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:07.541584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a04203-8329-47a0-be74-b0556d26aabd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:07.544534 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a04203-8329-47a0-be74-b0556d26aabd None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:07.579781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 418/822] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:07.586489 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a04203-8329-47a0-be74-b0556d26aabd None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:07.591938 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:07.612219 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a77f54-2d3d-4158-8fc8-ae2a536c94b0 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:07.670234 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf95db-4b13-4f7d-ab29-0fc875a9c198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:07.670898 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf95db-4b13-4f7d-ab29-0fc875a9c198 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:07.671174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf95db-4b13-4f7d-ab29-0fc875a9c198 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:07.671439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf95db-4b13-4f7d-ab29-0fc875a9c198 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:07.672147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf95db-4b13-4f7d-ab29-0fc875a9c198 None admin] RBAC: Adding query filter params (type=network) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:07.672446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf95db-4b13-4f7d-ab29-0fc875a9c198 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:07.674310 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf95db-4b13-4f7d-ab29-0fc875a9c198 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:07.687992 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 405/823] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 08:20:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:07.694121 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf95db-4b13-4f7d-ab29-0fc875a9c198 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:07.742734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:07.766662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a04203-8329-47a0-be74-b0556d26aabd None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:07.829708 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1cc02-689c-4430-b7c3-e7b39573383b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:07.830505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1cc02-689c-4430-b7c3-e7b39573383b None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:07.830837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1cc02-689c-4430-b7c3-e7b39573383b None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:07.831114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1cc02-689c-4430-b7c3-e7b39573383b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:07.842432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1cc02-689c-4430-b7c3-e7b39573383b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:07.846240 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1cc02-689c-4430-b7c3-e7b39573383b None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:07.870821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-86b1cc02-689c-4430-b7c3-e7b39573383b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:20:07.870821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:07.870821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:07.870821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:07.870821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:07.870821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:07.870821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:07.870821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:07.870821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:07.870821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:07.870821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:07.870821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:07.870821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:20:07.870821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:20:07.870821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:20:07.870821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:20:07.872016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:07.872016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:07.872016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:20:07.872016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:07.872016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:20:07.872016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:07.872016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:07.872016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:07.872016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:07.872016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:07.872016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:07.872016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:07.872016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:07.872016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:07.872016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:07.872016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:07.872016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:07.872016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:07.873159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:07.873159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:07.873159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:20:07.873159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:20:07.873159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:20:07.873159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:20:07.873159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:20:07.873159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:20:07.873159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:20:07.873159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:07.875189 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 419/824] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Jul 21 08:20:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:07.880829 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1cc02-689c-4430-b7c3-e7b39573383b None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:07.895628 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf95db-4b13-4f7d-ab29-0fc875a9c198 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:07.965610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2bc2f-1d16-439a-849c-6525ba54c91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:07.966511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2bc2f-1d16-439a-849c-6525ba54c91c None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:07.967622 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2bc2f-1d16-439a-849c-6525ba54c91c None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:07.968609 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2bc2f-1d16-439a-849c-6525ba54c91c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:07.969498 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2bc2f-1d16-439a-849c-6525ba54c91c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:07.971216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2bc2f-1d16-439a-849c-6525ba54c91c None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:08.019149 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1cc02-689c-4430-b7c3-e7b39573383b None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:08.053742 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef44cc8-8794-49ea-9373-cbe1894882b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:08.054477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef44cc8-8794-49ea-9373-cbe1894882b8 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:08.054761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef44cc8-8794-49ea-9373-cbe1894882b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:08.055035 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef44cc8-8794-49ea-9373-cbe1894882b8 None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:08.055860 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef44cc8-8794-49ea-9373-cbe1894882b8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:08.056167 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef44cc8-8794-49ea-9373-cbe1894882b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:08.058162 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef44cc8-8794-49ea-9373-cbe1894882b8 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:08.076016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 420/825] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Jul 21 08:20:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:08.081095 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:08.086577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef44cc8-8794-49ea-9373-cbe1894882b8 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:08.095119 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 406/826] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Jul 21 08:20:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:20:08.100348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:08.212592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef44cc8-8794-49ea-9373-cbe1894882b8 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:08.269957 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876c892-e3ba-413c-af39-d61c22516de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:08.270536 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876c892-e3ba-413c-af39-d61c22516de6 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:08.270814 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876c892-e3ba-413c-af39-d61c22516de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:08.271086 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876c892-e3ba-413c-af39-d61c22516de6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:08.347986 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876c892-e3ba-413c-af39-d61c22516de6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:08.349441 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876c892-e3ba-413c-af39-d61c22516de6 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:08.357488 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:08.456053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 421/827] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:20:08 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:20:08.461516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2bc2f-1d16-439a-849c-6525ba54c91c None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:08.570987 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6901e0f-4643-49d4-9f4b-03bcf0b9ba7d None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:08.571612 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6901e0f-4643-49d4-9f4b-03bcf0b9ba7d None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:08.572088 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6901e0f-4643-49d4-9f4b-03bcf0b9ba7d None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:08.574593 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 422/828] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:20:08.581548 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2bc2f-1d16-439a-849c-6525ba54c91c None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:08.581723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e09bbd-0b54-4023-8159-38a5c2b324cd None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:08.581723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e09bbd-0b54-4023-8159-38a5c2b324cd None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:08.581723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e09bbd-0b54-4023-8159-38a5c2b324cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:08.600028 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-99e09bbd-0b54-4023-8159-38a5c2b324cd None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:08.601218 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-99e09bbd-0b54-4023-8159-38a5c2b324cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:08.620040 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bdf87-ff9d-4d51-9d1c-c39cddf68024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:08.621087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bdf87-ff9d-4d51-9d1c-c39cddf68024 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:08.621364 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bdf87-ff9d-4d51-9d1c-c39cddf68024 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:08.622133 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192bdf87-ff9d-4d51-9d1c-c39cddf68024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:08.636769 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bdf87-ff9d-4d51-9d1c-c39cddf68024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:08.639096 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192bdf87-ff9d-4d51-9d1c-c39cddf68024 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:08.662895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-192bdf87-ff9d-4d51-9d1c-c39cddf68024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:08.662895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:08.662895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:08.662895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:08.662895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:08.662895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:08.662895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:08.662895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:08.662895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:08.662895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:08.662895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:08.662895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:08.662895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:08.662895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:08.662895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:08.663849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:08.663849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:08.663849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:08.663849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:08.663849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:08.663849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:08.663849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:08.663849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:08.663849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:08.663849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:08.663849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:08.663849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:08.663849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:08.663849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:08.663849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:08.663849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:08.663849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:08.664747 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:08.664747 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:08.664747 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:08.664747 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:08.664967 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 407/829] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:08.670659 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bdf87-ff9d-4d51-9d1c-c39cddf68024 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:08.689551 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 423/830] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:20:08.709163 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e09bbd-0b54-4023-8159-38a5c2b324cd None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:08.732885 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:08.754784 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:08.784652 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192bdf87-ff9d-4d51-9d1c-c39cddf68024 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:08.822032 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e09bbd-0b54-4023-8159-38a5c2b324cd None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:08.822629 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423ba28-6b7c-43e5-a30e-5409030b7af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:08.823594 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423ba28-6b7c-43e5-a30e-5409030b7af5 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:08.824061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423ba28-6b7c-43e5-a30e-5409030b7af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:08.824619 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423ba28-6b7c-43e5-a30e-5409030b7af5 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:08.825602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423ba28-6b7c-43e5-a30e-5409030b7af5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:08.826130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423ba28-6b7c-43e5-a30e-5409030b7af5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:08.827688 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423ba28-6b7c-43e5-a30e-5409030b7af5 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:08.841076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 408/831] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:08.847750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423ba28-6b7c-43e5-a30e-5409030b7af5 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:08.866538 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b3632-0d94-4e67-8877-c6c13867043a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:08.867338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b3632-0d94-4e67-8877-c6c13867043a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:08.867617 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b3632-0d94-4e67-8877-c6c13867043a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:08.867890 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b3632-0d94-4e67-8877-c6c13867043a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:08.881348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b3632-0d94-4e67-8877-c6c13867043a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:20:08.890116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-fe1b3632-0d94-4e67-8877-c6c13867043a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:20:08.890116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:08.890116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:08.890116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:08.890116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:08.890116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:08.890116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:08.890116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:08.890116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:08.890116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:08.890116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:08.890116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:08.890116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:20:08.890116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:20:08.890116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:20:08.890116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:20:08.891123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:20:08.891123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:20:08.891123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:20:08.891123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:20:08.891123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:08.891123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:08.891123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:08.891123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:08.891123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:08.891123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:08.891123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:08.891123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:08.891123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:08.891123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:08.891123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:08.891123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:08.891970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:08.891970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:08.891970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:08.891970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:08.891970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:20:08.891970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:20:08.891970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:20:08.891970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:20:08.891970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:20:08.891970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:20:08.891970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:20:08.891970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:08.896344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 424/832] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:20:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:08.897650 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b3632-0d94-4e67-8877-c6c13867043a None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:08.983764 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423ba28-6b7c-43e5-a30e-5409030b7af5 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:08.997968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:09.013673 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:09.019349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d96c4-2f6d-4f20-95b7-4bcfe0c9d2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:09.019485 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b3632-0d94-4e67-8877-c6c13867043a None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:09.020134 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d96c4-2f6d-4f20-95b7-4bcfe0c9d2cd None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.020474 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d96c4-2f6d-4f20-95b7-4bcfe0c9d2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.020744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d96c4-2f6d-4f20-95b7-4bcfe0c9d2cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.030317 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d96c4-2f6d-4f20-95b7-4bcfe0c9d2cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:09.031837 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d96c4-2f6d-4f20-95b7-4bcfe0c9d2cd None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:09.046430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-990d96c4-2f6d-4f20-95b7-4bcfe0c9d2cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:09.046430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:09.046430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:09.046430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:09.046430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:09.046430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:09.046430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:09.046430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:09.046430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:09.046430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:09.046430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:09.046430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:09.046430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:09.046430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:09.046430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:09.047339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:09.047339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:09.047339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:09.047339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:09.047339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:09.047339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:09.047339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:09.047339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:09.047339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:09.047339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:09.047339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:09.047339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:09.047339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:09.047339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:09.047339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:09.047339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:09.047339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:09.048283 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:09.048283 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:09.048283 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:09.048283 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:09.048283 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:09.048283 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:09.048283 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:09.048283 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:09.048283 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 409/833] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:09.049222 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe7638-12aa-41a5-8449-1e959851ee46 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.049222 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe7638-12aa-41a5-8449-1e959851ee46 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.049473 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe7638-12aa-41a5-8449-1e959851ee46 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.050994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 410/834] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:09.054910 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe7638-12aa-41a5-8449-1e959851ee46 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:09.059341 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb0055-ef36-499a-ac36-35059b50fc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:09.060052 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb0055-ef36-499a-ac36-35059b50fc31 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.060338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb0055-ef36-499a-ac36-35059b50fc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.060611 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb0055-ef36-499a-ac36-35059b50fc31 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.061352 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb0055-ef36-499a-ac36-35059b50fc31 None admin] RBAC: Adding query filter params (name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:09.061686 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb0055-ef36-499a-ac36-35059b50fc31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:09.063100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb0055-ef36-499a-ac36-35059b50fc31 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:09.076222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 425/835] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:20:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:09.076222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac651e62-16d4-4816-b420-c73f0b5281f4 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.076222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac651e62-16d4-4816-b420-c73f0b5281f4 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.076222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac651e62-16d4-4816-b420-c73f0b5281f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.089992 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-ac651e62-16d4-4816-b420-c73f0b5281f4 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:09.091159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ac651e62-16d4-4816-b420-c73f0b5281f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:09.173575 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 426/836] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:09.173575 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac651e62-16d4-4816-b420-c73f0b5281f4 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:09.195576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe7638-12aa-41a5-8449-1e959851ee46 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:09.229555 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2374a9-5f2d-453c-b99e-3fcf77986552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:09.230231 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2374a9-5f2d-453c-b99e-3fcf77986552 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.230511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2374a9-5f2d-453c-b99e-3fcf77986552 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.230782 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2374a9-5f2d-453c-b99e-3fcf77986552 None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.231600 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2374a9-5f2d-453c-b99e-3fcf77986552 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:09.231912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2374a9-5f2d-453c-b99e-3fcf77986552 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:09.233372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2374a9-5f2d-453c-b99e-3fcf77986552 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:09.252070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 411/837] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:20:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:09.252070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2374a9-5f2d-453c-b99e-3fcf77986552 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:09.285832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:09.359183 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2374a9-5f2d-453c-b99e-3fcf77986552 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:09.392963 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:09.396964 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc44d9-aca8-47f2-b1f5-cbcf1d4de3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:09.397803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc44d9-aca8-47f2-b1f5-cbcf1d4de3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.398087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc44d9-aca8-47f2-b1f5-cbcf1d4de3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.403022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc44d9-aca8-47f2-b1f5-cbcf1d4de3f7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.403022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc44d9-aca8-47f2-b1f5-cbcf1d4de3f7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:09.403022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc44d9-aca8-47f2-b1f5-cbcf1d4de3f7 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:09.406427 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac651e62-16d4-4816-b420-c73f0b5281f4 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:09.414105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-bbcc44d9-aca8-47f2-b1f5-cbcf1d4de3f7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:20:09.414105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:09.414105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:09.414105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:09.414105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:09.414105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:09.414105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:09.414105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:09.414105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:20:09.414105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:09.414105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:09.414105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:09.414105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:09.414105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:09.414105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:09.414105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:09.414105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:09.415098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:09.415098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:09.415098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:09.415098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:09.415098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:09.415098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:09.415098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:09.415098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:09.415098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:09.415098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:09.415098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:09.415098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:09.415098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:09.415098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:09.415098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:09.415098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:09.416130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:09.416130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:09.416130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:09.416130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:09.416130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:09.416130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:09.416130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:09.416130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:09.416130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:09.416130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:09.416130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:09.416130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:09.416130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:20:09.416130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:09.419990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 412/838] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:20:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:09.421130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc44d9-aca8-47f2-b1f5-cbcf1d4de3f7 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:09.444702 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d07c0f-e78a-4706-a03a-59cde5775618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:09.445493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d07c0f-e78a-4706-a03a-59cde5775618 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.445799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d07c0f-e78a-4706-a03a-59cde5775618 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.446070 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d07c0f-e78a-4706-a03a-59cde5775618 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.457140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d07c0f-e78a-4706-a03a-59cde5775618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:09.458622 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d07c0f-e78a-4706-a03a-59cde5775618 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:09.475638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-c5d07c0f-e78a-4706-a03a-59cde5775618 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:09.475638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:09.475638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:09.475638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:09.475638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:09.475638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:09.475638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:09.475638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:09.475638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:09.475638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:09.475638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:09.475638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:09.475638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:09.475638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:09.475638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:09.476949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:09.476949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:09.476949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:09.476949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:09.476949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:09.476949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:09.476949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:09.476949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:09.476949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:09.476949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:09.476949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:09.476949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:09.476949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:09.476949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:09.476949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:09.476949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:09.476949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:09.477912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:09.477912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:09.477912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:09.477912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:09.477912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 427/839] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:09.478186 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d07c0f-e78a-4706-a03a-59cde5775618 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:09.530949 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:09.538328 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc44d9-aca8-47f2-b1f5-cbcf1d4de3f7 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:09.575236 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ab246-ed86-422b-8253-af0b828d31ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:09.575887 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ab246-ed86-422b-8253-af0b828d31ba None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.576171 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ab246-ed86-422b-8253-af0b828d31ba None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.576453 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ab246-ed86-422b-8253-af0b828d31ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.577283 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ab246-ed86-422b-8253-af0b828d31ba None admin] RBAC: Adding query filter params (role.id=beed8caad097496292e544146859df5c, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=b6670a010c034f7999c9445452c02473) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:09.577624 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ab246-ed86-422b-8253-af0b828d31ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:09.579052 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ab246-ed86-422b-8253-af0b828d31ba None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:09.582647 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d07c0f-e78a-4706-a03a-59cde5775618 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:09.584854 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 413/840] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:20:09 2022] GET /identity/v3/role_assignments?user.id=b6670a010c034f7999c9445452c02473&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=beed8caad097496292e544146859df5c => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:09.585738 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ab246-ed86-422b-8253-af0b828d31ba None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:09.630879 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb46733-2e50-4301-af83-39cf4d045570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:09.631617 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb46733-2e50-4301-af83-39cf4d045570 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.631834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb46733-2e50-4301-af83-39cf4d045570 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.632104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb46733-2e50-4301-af83-39cf4d045570 None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.632820 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb46733-2e50-4301-af83-39cf4d045570 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:09.633120 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb46733-2e50-4301-af83-39cf4d045570 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:09.634554 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb46733-2e50-4301-af83-39cf4d045570 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:09.641280 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 428/841] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:20:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:09.645735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4657b3-b008-45fc-bfc1-ed8e63462451 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.645735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4657b3-b008-45fc-bfc1-ed8e63462451 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.645735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4657b3-b008-45fc-bfc1-ed8e63462451 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.645982 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 429/842] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:09.651867 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102c15d-405a-4211-9e1f-8dc3ba4e029d None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.652187 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102c15d-405a-4211-9e1f-8dc3ba4e029d None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.652423 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102c15d-405a-4211-9e1f-8dc3ba4e029d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.659278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:09.671141 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-9102c15d-405a-4211-9e1f-8dc3ba4e029d None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:09.672386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-9102c15d-405a-4211-9e1f-8dc3ba4e029d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:09.708663 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ab246-ed86-422b-8253-af0b828d31ba None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:09.749685 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07cd05-a0a5-47ee-a2c2-cbed87fee000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:09.750356 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07cd05-a0a5-47ee-a2c2-cbed87fee000 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.750635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07cd05-a0a5-47ee-a2c2-cbed87fee000 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.750908 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07cd05-a0a5-47ee-a2c2-cbed87fee000 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.751663 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07cd05-a0a5-47ee-a2c2-cbed87fee000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:09.751942 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07cd05-a0a5-47ee-a2c2-cbed87fee000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:09.754068 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07cd05-a0a5-47ee-a2c2-cbed87fee000 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:09.760797 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 430/843] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:20:09.763439 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102c15d-405a-4211-9e1f-8dc3ba4e029d None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:09.772249 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 414/844] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:09.778023 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07cd05-a0a5-47ee-a2c2-cbed87fee000 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:09.803635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:09.879698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102c15d-405a-4211-9e1f-8dc3ba4e029d None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:09.888778 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07cd05-a0a5-47ee-a2c2-cbed87fee000 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:09.917464 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea21ba-62e3-4d8c-8963-03a7724fa203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:09.918475 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea21ba-62e3-4d8c-8963-03a7724fa203 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.918947 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea21ba-62e3-4d8c-8963-03a7724fa203 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.919214 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea21ba-62e3-4d8c-8963-03a7724fa203 None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.919922 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea21ba-62e3-4d8c-8963-03a7724fa203 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:09.920228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea21ba-62e3-4d8c-8963-03a7724fa203 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:09.921618 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cea21ba-62e3-4d8c-8963-03a7724fa203 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:09.922951 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:09.925008 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fe8fa-fffd-4b3d-9af9-39e3db420841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:09.925844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fe8fa-fffd-4b3d-9af9-39e3db420841 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:09.926127 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fe8fa-fffd-4b3d-9af9-39e3db420841 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:09.933745 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fe8fa-fffd-4b3d-9af9-39e3db420841 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:09.933935 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 431/845] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:20:09 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:09.933935 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea21ba-62e3-4d8c-8963-03a7724fa203 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:09.942791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fe8fa-fffd-4b3d-9af9-39e3db420841 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:09.944288 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fe8fa-fffd-4b3d-9af9-39e3db420841 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:09.962223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-8c1fe8fa-fffd-4b3d-9af9-39e3db420841 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:20:09.962223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:09.962223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:09.962223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:09.962223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:09.962223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:09.962223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:09.962223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:09.962223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:09.962223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:09.962223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:09.962223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:09.962223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:20:09.962223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:20:09.962223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:20:09.962223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:20:09.963315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:09.963315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:09.963315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:20:09.963315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:09.963315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:20:09.963315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:09.963315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:09.963315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:09.963315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:09.963315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:09.963315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:09.963315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:09.963315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:09.963315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:09.963315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:09.963315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:09.963315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:09.963315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:09.964274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:09.964274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:09.964274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:20:09.964274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:20:09.964274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:20:09.964274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:20:09.964274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:20:09.964274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:20:09.964274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:20:09.964274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:09.964274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 415/846] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Jul 21 08:20:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:09.969143 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fe8fa-fffd-4b3d-9af9-39e3db420841 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:10.060633 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea21ba-62e3-4d8c-8963-03a7724fa203 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:10.065417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:10.087913 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fe8fa-fffd-4b3d-9af9-39e3db420841 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:10.099230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079434bd-d403-4b94-a3b5-5a0dac608c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:10.100047 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079434bd-d403-4b94-a3b5-5a0dac608c02 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:10.100324 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079434bd-d403-4b94-a3b5-5a0dac608c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:10.100592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079434bd-d403-4b94-a3b5-5a0dac608c02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:10.118522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079434bd-d403-4b94-a3b5-5a0dac608c02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:20:10.126799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-079434bd-d403-4b94-a3b5-5a0dac608c02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:20:10.126799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:10.126799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:10.126799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:10.126799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:10.126799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:10.126799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:10.126799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:10.126799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:10.126799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:10.126799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:10.126799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:10.126799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:20:10.126799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:20:10.126799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:20:10.126799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:20:10.127771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:20:10.127771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:20:10.127771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:20:10.127771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:20:10.127771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:10.127771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:10.127771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:10.127771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:10.127771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:10.127771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:10.127771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:10.127771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:10.127771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:10.127771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:10.127771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:10.127771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:10.128595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:10.128595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:10.128595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:10.128595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:10.128595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:20:10.128595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:20:10.128595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:20:10.128595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:20:10.128595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:20:10.128595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:20:10.128595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:20:10.128595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:10.132927 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 432/847] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:20:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:10.134294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079434bd-d403-4b94-a3b5-5a0dac608c02 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:10.137732 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b2cd3-3276-46d5-95f1-efc6d592b605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:10.138413 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b2cd3-3276-46d5-95f1-efc6d592b605 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:10.138954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b2cd3-3276-46d5-95f1-efc6d592b605 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:10.139179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b2cd3-3276-46d5-95f1-efc6d592b605 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:10.140924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b2cd3-3276-46d5-95f1-efc6d592b605 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:10.141244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b2cd3-3276-46d5-95f1-efc6d592b605 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:10.142731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b2cd3-3276-46d5-95f1-efc6d592b605 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:10.165565 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 416/848] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Jul 21 08:20:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:10.173223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b2cd3-3276-46d5-95f1-efc6d592b605 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:10.210004 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:10.265877 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079434bd-d403-4b94-a3b5-5a0dac608c02 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:10.294372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b2cd3-3276-46d5-95f1-efc6d592b605 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:10.316068 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497aced-97fd-49c9-bb86-2109165e650f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:10.317433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497aced-97fd-49c9-bb86-2109165e650f None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:10.317850 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497aced-97fd-49c9-bb86-2109165e650f None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:10.318228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497aced-97fd-49c9-bb86-2109165e650f None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:10.319380 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497aced-97fd-49c9-bb86-2109165e650f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:10.319788 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497aced-97fd-49c9-bb86-2109165e650f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:10.322197 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497aced-97fd-49c9-bb86-2109165e650f None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:10.332203 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990d218-43ac-46e2-aa2f-9b49d800cbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:10.333195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990d218-43ac-46e2-aa2f-9b49d800cbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:10.333704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990d218-43ac-46e2-aa2f-9b49d800cbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:10.334130 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 433/849] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:20:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:10.334409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4990d218-43ac-46e2-aa2f-9b49d800cbb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:10.339580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497aced-97fd-49c9-bb86-2109165e650f None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:10.347282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:10.433942 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990d218-43ac-46e2-aa2f-9b49d800cbb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:10.435666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4990d218-43ac-46e2-aa2f-9b49d800cbb2 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:10.463895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497aced-97fd-49c9-bb86-2109165e650f None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:10.495939 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:10.512526 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0352f81-01a5-4550-a18e-2f1d95758fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:10.520382 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0352f81-01a5-4550-a18e-2f1d95758fdd None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:10.520382 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0352f81-01a5-4550-a18e-2f1d95758fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:10.520382 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0352f81-01a5-4550-a18e-2f1d95758fdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:10.528636 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0352f81-01a5-4550-a18e-2f1d95758fdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:10.530216 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0352f81-01a5-4550-a18e-2f1d95758fdd None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:10.552089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-e0352f81-01a5-4550-a18e-2f1d95758fdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:10.552089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:10.552089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:10.552089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:10.552089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:10.552089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:10.552089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:10.552089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:10.552089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:10.552089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:10.552089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:10.552089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:10.552089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:10.552089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:10.552089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:10.553248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:10.553248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:10.553248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:10.553248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:10.553248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:10.553248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:10.553248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:10.553248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:10.553248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:10.553248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:10.553248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:10.553248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:10.553248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:10.553248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:10.553248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:10.553248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:10.553248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:10.554407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:10.554407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:10.554407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:10.554407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:10.559182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 434/850] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:10.559324 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 417/851] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:20:10 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:20:10.562356 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0352f81-01a5-4550-a18e-2f1d95758fdd None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:10.566591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990d218-43ac-46e2-aa2f-9b49d800cbb2 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:10.617696 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:10.679973 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0352f81-01a5-4550-a18e-2f1d95758fdd None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:10.698239 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4990d218-43ac-46e2-aa2f-9b49d800cbb2 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:10.722157 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f171a2e-1d1c-45d8-acb2-d1c335ebffda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:10.722818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f171a2e-1d1c-45d8-acb2-d1c335ebffda None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:10.723100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f171a2e-1d1c-45d8-acb2-d1c335ebffda None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:10.723376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f171a2e-1d1c-45d8-acb2-d1c335ebffda None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:10.724099 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f171a2e-1d1c-45d8-acb2-d1c335ebffda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:10.724409 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f171a2e-1d1c-45d8-acb2-d1c335ebffda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:10.725795 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f171a2e-1d1c-45d8-acb2-d1c335ebffda None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:10.740556 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 435/852] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:10.749065 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f171a2e-1d1c-45d8-acb2-d1c335ebffda None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:10.759189 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13f70e-084d-46db-abdf-7f6cc54ed468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:10.760344 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13f70e-084d-46db-abdf-7f6cc54ed468 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:10.760843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13f70e-084d-46db-abdf-7f6cc54ed468 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:10.761351 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13f70e-084d-46db-abdf-7f6cc54ed468 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:10.772526 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13f70e-084d-46db-abdf-7f6cc54ed468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:10.774459 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13f70e-084d-46db-abdf-7f6cc54ed468 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:10.786637 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:10.795878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-9f13f70e-084d-46db-abdf-7f6cc54ed468 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:10.795878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:10.795878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:10.795878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:10.795878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:10.795878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:10.795878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:10.795878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:10.795878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:10.795878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:10.795878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:10.795878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:10.795878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:10.795878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:10.795878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:10.796777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:10.796777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:10.796777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:10.796777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:10.796777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:10.796777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:10.796777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:10.796777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:10.796777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:10.796777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:10.796777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:10.796777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:10.796777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:10.796777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:10.796777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:10.796777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:10.796777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:10.798114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:10.798114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:10.798114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:10.798114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:10.800863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 418/853] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:10.806222 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13f70e-084d-46db-abdf-7f6cc54ed468 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:10.862266 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f171a2e-1d1c-45d8-acb2-d1c335ebffda None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:10.905402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d6d88-0260-41a5-87e4-5e38af84b3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:10.906902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d6d88-0260-41a5-87e4-5e38af84b3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:10.907257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d6d88-0260-41a5-87e4-5e38af84b3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:10.907537 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d6d88-0260-41a5-87e4-5e38af84b3d6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:10.916648 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:10.917019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d6d88-0260-41a5-87e4-5e38af84b3d6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:10.919501 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d6d88-0260-41a5-87e4-5e38af84b3d6 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:10.926347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13f70e-084d-46db-abdf-7f6cc54ed468 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:10.940055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-525d6d88-0260-41a5-87e4-5e38af84b3d6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:20:10.940055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:10.940055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:10.940055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:10.940055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:10.940055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:10.940055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:10.940055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:10.940055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:10.940055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:10.940055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:10.940055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:10.940055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:20:10.940055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:20:10.940055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:20:10.940055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:20:10.940959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:10.940959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:10.940959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:20:10.940959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:10.940959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:20:10.940959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:10.940959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:10.940959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:10.940959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:10.940959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:10.940959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:10.940959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:10.940959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:10.940959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:10.940959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:10.940959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:10.940959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:10.940959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:10.941944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:10.941944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:10.941944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:20:10.941944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:20:10.941944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:20:10.941944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:20:10.941944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:20:10.941944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:20:10.941944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 08:20:10.941944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:10.941944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 436/854] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:20:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:10.942721 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d6d88-0260-41a5-87e4-5e38af84b3d6 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:10.966608 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585750a-63b9-46b2-9720-7ce85c6b2561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:10.967346 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585750a-63b9-46b2-9720-7ce85c6b2561 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:10.967735 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585750a-63b9-46b2-9720-7ce85c6b2561 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:10.968113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585750a-63b9-46b2-9720-7ce85c6b2561 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:10.968946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585750a-63b9-46b2-9720-7ce85c6b2561 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:10.969356 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585750a-63b9-46b2-9720-7ce85c6b2561 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:10.970871 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585750a-63b9-46b2-9720-7ce85c6b2561 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:10.987558 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 419/855] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:10.988912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585750a-63b9-46b2-9720-7ce85c6b2561 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:11.054173 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:11.063775 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d6d88-0260-41a5-87e4-5e38af84b3d6 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:11.094575 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585750a-63b9-46b2-9720-7ce85c6b2561 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:11.106160 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d18c1-8660-42fd-be4d-afe52e61eb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:11.107424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d18c1-8660-42fd-be4d-afe52e61eb18 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:11.107783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d18c1-8660-42fd-be4d-afe52e61eb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:11.108294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d18c1-8660-42fd-be4d-afe52e61eb18 None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:11.109397 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d18c1-8660-42fd-be4d-afe52e61eb18 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:11.109845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d18c1-8660-42fd-be4d-afe52e61eb18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:11.112315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d18c1-8660-42fd-be4d-afe52e61eb18 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:11.137847 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ee2b5-947e-40b1-950c-eec8027e16e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:11.138968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ee2b5-947e-40b1-950c-eec8027e16e7 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:11.140130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ee2b5-947e-40b1-950c-eec8027e16e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:11.140130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ee2b5-947e-40b1-950c-eec8027e16e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:11.141740 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 437/856] 10.222.0.57 () {56 vars in 1135 bytes} [Thu Jul 21 08:20:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:11.143708 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d18c1-8660-42fd-be4d-afe52e61eb18 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:11.149146 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ee2b5-947e-40b1-950c-eec8027e16e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:11.151499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ee2b5-947e-40b1-950c-eec8027e16e7 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:11.170409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-ff9ee2b5-947e-40b1-950c-eec8027e16e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:11.170409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:11.170409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:11.170409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:11.170409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:11.170409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:11.170409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:11.170409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:11.170409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:11.170409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:11.170409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:11.170409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:11.170409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:11.170409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:11.170409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:11.171338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:11.171338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:11.171338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:11.171338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:11.171338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:11.171338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:11.171338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:11.171338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:11.171338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:11.171338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:11.171338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:11.171338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:11.171338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:11.171338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:11.171338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:11.171338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:11.171338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:11.172236 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:11.172236 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:11.172236 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:11.172236 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:11.172236 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:11.172236 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:11.172236 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:11.172236 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:11.174683 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 420/857] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:11.180487 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ee2b5-947e-40b1-950c-eec8027e16e7 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:11.201115 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:11.261435 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d18c1-8660-42fd-be4d-afe52e61eb18 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:11.295405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ee2b5-947e-40b1-950c-eec8027e16e7 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:11.297460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd836c61-96c9-46bb-877c-e3313fa42493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:11.298289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd836c61-96c9-46bb-877c-e3313fa42493 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:11.298774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd836c61-96c9-46bb-877c-e3313fa42493 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:11.299268 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd836c61-96c9-46bb-877c-e3313fa42493 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:11.319044 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:11.332317 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d5524-cfd0-4c6a-a94a-340271d5e701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:11.332917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d5524-cfd0-4c6a-a94a-340271d5e701 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:11.337705 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d5524-cfd0-4c6a-a94a-340271d5e701 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:11.337705 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d5524-cfd0-4c6a-a94a-340271d5e701 None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:11.337705 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d5524-cfd0-4c6a-a94a-340271d5e701 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:11.337705 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d5524-cfd0-4c6a-a94a-340271d5e701 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:11.337705 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56d5524-cfd0-4c6a-a94a-340271d5e701 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:11.353595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 421/858] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:20:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:11.354894 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d5524-cfd0-4c6a-a94a-340271d5e701 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:11.373246 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd836c61-96c9-46bb-877c-e3313fa42493 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:11.374725 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd836c61-96c9-46bb-877c-e3313fa42493 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:11.427736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:11.460680 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56d5524-cfd0-4c6a-a94a-340271d5e701 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:11.483570 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 438/859] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:20:11 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 08:20:11.485682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd836c61-96c9-46bb-877c-e3313fa42493 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:11.503564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797fd2f-0acd-4691-94f4-4349e814e771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:11.504485 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797fd2f-0acd-4691-94f4-4349e814e771 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:11.504959 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797fd2f-0acd-4691-94f4-4349e814e771 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:11.505412 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797fd2f-0acd-4691-94f4-4349e814e771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:11.506458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797fd2f-0acd-4691-94f4-4349e814e771 None admin] RBAC: Adding query filter params (role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=22750d44d710439da1d18a78419b1adf) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:11.506970 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797fd2f-0acd-4691-94f4-4349e814e771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:11.508578 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797fd2f-0acd-4691-94f4-4349e814e771 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:11.521744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 422/860] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:20:11 2022] GET /identity/v3/role_assignments?user.id=22750d44d710439da1d18a78419b1adf&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:11.539914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:11.597698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd836c61-96c9-46bb-877c-e3313fa42493 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:11.638154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc7e34-70f8-400a-8c4d-85074500f51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:11.639161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc7e34-70f8-400a-8c4d-85074500f51a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:11.639443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc7e34-70f8-400a-8c4d-85074500f51a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:11.639713 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc7e34-70f8-400a-8c4d-85074500f51a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:11.652193 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc7e34-70f8-400a-8c4d-85074500f51a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:11.653740 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc7e34-70f8-400a-8c4d-85074500f51a None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:11.673332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-13dc7e34-70f8-400a-8c4d-85074500f51a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:11.673332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:11.673332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:11.673332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:11.673332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:11.673332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:11.673332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:11.673332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:11.673332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:11.673332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:11.673332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:11.673332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:11.673332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:11.673332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:11.673332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:11.674330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:11.674330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:11.674330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:11.674330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:11.674330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:11.674330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:11.674330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:11.674330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:11.674330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:11.674330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:11.674330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:11.674330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:11.674330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:11.674330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:11.674330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:11.674330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:11.674330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:11.675577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:11.675577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:11.675577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:11.675577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:11.675577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 439/861] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:11.682969 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797fd2f-0acd-4691-94f4-4349e814e771 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:11.747018 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510635-addc-438c-99c1-fd6030f2116a None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:11.747306 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510635-addc-438c-99c1-fd6030f2116a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:11.747621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510635-addc-438c-99c1-fd6030f2116a None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:11.749116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 440/862] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:11.754046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e637c28-12e1-434a-b6e4-6d468e1edec5 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:11.754525 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e637c28-12e1-434a-b6e4-6d468e1edec5 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:11.754634 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e637c28-12e1-434a-b6e4-6d468e1edec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:11.777481 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-9e637c28-12e1-434a-b6e4-6d468e1edec5 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:11.778635 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-9e637c28-12e1-434a-b6e4-6d468e1edec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:11.810008 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797fd2f-0acd-4691-94f4-4349e814e771 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:11.856659 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340e4dc-b9fc-4c67-a4a1-680e3f9a2ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:11.857322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340e4dc-b9fc-4c67-a4a1-680e3f9a2ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:11.857677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340e4dc-b9fc-4c67-a4a1-680e3f9a2ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:11.858338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340e4dc-b9fc-4c67-a4a1-680e3f9a2ed1 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:11.859232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340e4dc-b9fc-4c67-a4a1-680e3f9a2ed1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:11.859659 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340e4dc-b9fc-4c67-a4a1-680e3f9a2ed1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:11.861150 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340e4dc-b9fc-4c67-a4a1-680e3f9a2ed1 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:11.863456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 441/863] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:20:11.864362 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:11.879307 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 423/864] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:11.885102 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e637c28-12e1-434a-b6e4-6d468e1edec5 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:11.889735 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340e4dc-b9fc-4c67-a4a1-680e3f9a2ed1 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:11.930135 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:12.011725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340e4dc-b9fc-4c67-a4a1-680e3f9a2ed1 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:12.013739 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e637c28-12e1-434a-b6e4-6d468e1edec5 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:12.051005 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41da4d-b498-48be-9499-7192d5e0cee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:12.052032 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41da4d-b498-48be-9499-7192d5e0cee4 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:12.052313 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41da4d-b498-48be-9499-7192d5e0cee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:12.052588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41da4d-b498-48be-9499-7192d5e0cee4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:12.053237 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41da4d-b498-48be-9499-7192d5e0cee4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:12.054630 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c41da4d-b498-48be-9499-7192d5e0cee4 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:12.057010 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa34596-7f6c-4c35-985a-aac32cb776f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:12.058421 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa34596-7f6c-4c35-985a-aac32cb776f1 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:12.059120 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa34596-7f6c-4c35-985a-aac32cb776f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:12.059546 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa34596-7f6c-4c35-985a-aac32cb776f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:12.066854 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa34596-7f6c-4c35-985a-aac32cb776f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:12.067294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-4c41da4d-b498-48be-9499-7192d5e0cee4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:20:12.067294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:12.067294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:12.067294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:12.067294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:12.067294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:12.067294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:12.067294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:12.067294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:20:12.067294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:12.067294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:12.067294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:12.067294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:12.067294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:12.067294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:12.067294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:12.068400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:12.068400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:12.068400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:12.068400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:12.068400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:12.068400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:12.068400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:12.068400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:12.068400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:12.068400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:12.068400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:12.068400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:12.068400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:12.068400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:12.068400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:12.068400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:12.069511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:12.069511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:12.069511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:12.069511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:12.069511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:12.069511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:12.069511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:12.069511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:12.069511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:12.069511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:12.069511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:12.069511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:12.069511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:12.069511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:20:12.069511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:12.071786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa34596-7f6c-4c35-985a-aac32cb776f1 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:12.073743 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 424/865] 10.222.0.57 () {56 vars in 1132 bytes} [Thu Jul 21 08:20:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:12.075024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09c26e-0cb3-431c-9b8a-54f2ec929a03 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:12.075310 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09c26e-0cb3-431c-9b8a-54f2ec929a03 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:12.075579 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09c26e-0cb3-431c-9b8a-54f2ec929a03 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:12.076838 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 425/866] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:12.077538 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09c26e-0cb3-431c-9b8a-54f2ec929a03 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:12.090142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-8fa34596-7f6c-4c35-985a-aac32cb776f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:12.090142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:12.090142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:12.090142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:12.090142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:12.090142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:12.090142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:12.090142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:12.090142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:12.090142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:12.090142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:12.090142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:12.090142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:12.090142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:12.090142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:12.091273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:12.091273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:12.091273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:12.091273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:12.091273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:12.091273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:12.091273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:12.091273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:12.091273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:12.091273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:12.091273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:12.091273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:12.091273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:12.091273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:12.091273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:12.091273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:12.091273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:12.092404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:12.092404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:12.092404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:12.092404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:12.092404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:12.092404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:12.092404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:12.092404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:12.099522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 442/867] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:12.099522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb1bbf-5e0f-4006-852b-f60cbd2e226d None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:12.099522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb1bbf-5e0f-4006-852b-f60cbd2e226d None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:12.099522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb1bbf-5e0f-4006-852b-f60cbd2e226d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:12.118159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-66cb1bbf-5e0f-4006-852b-f60cbd2e226d None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:12.120018 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-66cb1bbf-5e0f-4006-852b-f60cbd2e226d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:12.147163 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:12.191223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09c26e-0cb3-431c-9b8a-54f2ec929a03 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:12.193482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 443/868] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:12.202416 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb1bbf-5e0f-4006-852b-f60cbd2e226d None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:12.234341 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:12.239599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76641596-3686-4bc6-aa78-c1e7a3a9d433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:12.240518 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76641596-3686-4bc6-aa78-c1e7a3a9d433 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:12.240802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76641596-3686-4bc6-aa78-c1e7a3a9d433 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:12.241084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76641596-3686-4bc6-aa78-c1e7a3a9d433 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:12.241824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76641596-3686-4bc6-aa78-c1e7a3a9d433 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:12.242142 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76641596-3686-4bc6-aa78-c1e7a3a9d433 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:12.243508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76641596-3686-4bc6-aa78-c1e7a3a9d433 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:12.254159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 426/869] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 08:20:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:12.254159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76641596-3686-4bc6-aa78-c1e7a3a9d433 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:12.314465 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb1bbf-5e0f-4006-852b-f60cbd2e226d None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:12.352006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c29da-dbaa-40b9-b614-b6406e7df7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:12.352652 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c29da-dbaa-40b9-b614-b6406e7df7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:12.352928 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c29da-dbaa-40b9-b614-b6406e7df7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:12.353197 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c29da-dbaa-40b9-b614-b6406e7df7c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:12.354040 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c29da-dbaa-40b9-b614-b6406e7df7c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:12.354378 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c29da-dbaa-40b9-b614-b6406e7df7c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:12.355822 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c29da-dbaa-40b9-b614-b6406e7df7c3 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:12.360942 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76641596-3686-4bc6-aa78-c1e7a3a9d433 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:12.374393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 444/870] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:20:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:12.374393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c29da-dbaa-40b9-b614-b6406e7df7c3 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:12.384051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:12.396539 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d49cb-3fa0-47ab-96df-dd5ed2ae189f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:12.396925 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d49cb-3fa0-47ab-96df-dd5ed2ae189f None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:12.397202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d49cb-3fa0-47ab-96df-dd5ed2ae189f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:12.397471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d49cb-3fa0-47ab-96df-dd5ed2ae189f None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:12.398272 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d49cb-3fa0-47ab-96df-dd5ed2ae189f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:12.399691 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d49cb-3fa0-47ab-96df-dd5ed2ae189f None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:12.455467 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:12.481561 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 427/871] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 08:20:12 2022] POST /identity/v3/services => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:20:12.481812 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c29da-dbaa-40b9-b614-b6406e7df7c3 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:12.481912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d49cb-3fa0-47ab-96df-dd5ed2ae189f None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:12.538176 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f5e17-01f6-4c73-b581-087a68394019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:12.539111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f5e17-01f6-4c73-b581-087a68394019 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:12.539470 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f5e17-01f6-4c73-b581-087a68394019 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:12.539835 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f5e17-01f6-4c73-b581-087a68394019 None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:12.540669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f5e17-01f6-4c73-b581-087a68394019 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:12.541597 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f5e17-01f6-4c73-b581-087a68394019 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:12.543143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f5e17-01f6-4c73-b581-087a68394019 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:12.556137 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 445/872] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 08:20:12 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:12.629165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d49cb-3fa0-47ab-96df-dd5ed2ae189f None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:12.671956 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5fa2f-0f69-4cda-acac-94cf35778f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:12.672637 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5fa2f-0f69-4cda-acac-94cf35778f5e None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:12.672927 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5fa2f-0f69-4cda-acac-94cf35778f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:12.673206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5fa2f-0f69-4cda-acac-94cf35778f5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:12.674097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5fa2f-0f69-4cda-acac-94cf35778f5e None admin] RBAC: Adding query filter params (role.id=beed8caad097496292e544146859df5c, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=e349e5dfcd74406b922d3d1ce0fa5ef4) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:12.674413 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5fa2f-0f69-4cda-acac-94cf35778f5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:12.675878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5fa2f-0f69-4cda-acac-94cf35778f5e None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:12.684568 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 428/873] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:20:12 2022] GET /identity/v3/role_assignments?user.id=e349e5dfcd74406b922d3d1ce0fa5ef4&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=beed8caad097496292e544146859df5c => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:13.727979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683eeff-f890-4c70-9657-48c794dcfd70 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:13.728568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683eeff-f890-4c70-9657-48c794dcfd70 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:13.728568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683eeff-f890-4c70-9657-48c794dcfd70 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:13.730175 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 446/874] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:13.735512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58d160-bb67-47c3-b4a4-cc7f0083cf9e None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:13.736011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58d160-bb67-47c3-b4a4-cc7f0083cf9e None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:13.736100 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58d160-bb67-47c3-b4a4-cc7f0083cf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:13.763114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-5c58d160-bb67-47c3-b4a4-cc7f0083cf9e None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:13.764730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-5c58d160-bb67-47c3-b4a4-cc7f0083cf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:13.810222 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:13.839122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 429/875] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:13 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:13.862857 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683eeff-f890-4c70-9657-48c794dcfd70 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:13.968640 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683eeff-f890-4c70-9657-48c794dcfd70 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:14.007267 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e2ed3-f116-4f39-a7c0-9ca6161cf30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:14.008369 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e2ed3-f116-4f39-a7c0-9ca6161cf30a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:14.008878 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e2ed3-f116-4f39-a7c0-9ca6161cf30a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:14.009357 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e2ed3-f116-4f39-a7c0-9ca6161cf30a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:14.020440 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8e2ed3-f116-4f39-a7c0-9ca6161cf30a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:20:14.029020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-7d8e2ed3-f116-4f39-a7c0-9ca6161cf30a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:20:14.029020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:14.029020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:14.029020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:14.029020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:14.029020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:14.029020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:14.029020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:14.029020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:14.029020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:14.029020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:14.029020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:14.029020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:20:14.029020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:20:14.029020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:20:14.029020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:20:14.030017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:20:14.030017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:20:14.030017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:20:14.030017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:20:14.030017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:14.030017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:14.030017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:14.030017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:14.030017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:14.030017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:14.030017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:14.030017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:14.030017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:14.030017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:14.030017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:14.030017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:14.030874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:14.030874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:14.030874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:14.030874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:14.030874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:20:14.030874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:20:14.030874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:20:14.030874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:20:14.030874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:20:14.030874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:20:14.030874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:20:14.030874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:14.033586 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 447/876] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Jul 21 08:20:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:14.039155 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58d160-bb67-47c3-b4a4-cc7f0083cf9e None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:14.141434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c58d160-bb67-47c3-b4a4-cc7f0083cf9e None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:14.176765 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f8037-07c2-4859-a377-bab67405a49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:14.177438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f8037-07c2-4859-a377-bab67405a49e None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:14.177757 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f8037-07c2-4859-a377-bab67405a49e None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:14.178036 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f8037-07c2-4859-a377-bab67405a49e None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:14.178798 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f8037-07c2-4859-a377-bab67405a49e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:14.179107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f8037-07c2-4859-a377-bab67405a49e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:14.180478 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f8037-07c2-4859-a377-bab67405a49e None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:14.189974 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 430/877] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Jul 21 08:20:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:14.198636 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e2ed3-f116-4f39-a7c0-9ca6161cf30a None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:14.207538 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:14.302481 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e2ed3-f116-4f39-a7c0-9ca6161cf30a None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:14.338583 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d224b4-2dae-4f40-b3a8-82597a959572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:14.339384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d224b4-2dae-4f40-b3a8-82597a959572 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:14.339667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d224b4-2dae-4f40-b3a8-82597a959572 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:14.339942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d224b4-2dae-4f40-b3a8-82597a959572 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:14.350933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d224b4-2dae-4f40-b3a8-82597a959572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:14.352647 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d224b4-2dae-4f40-b3a8-82597a959572 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:14.371443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-a6d224b4-2dae-4f40-b3a8-82597a959572 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:14.371443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:14.371443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:14.371443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:14.371443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:14.371443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:14.371443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:14.371443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:14.371443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:14.371443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:14.371443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:14.371443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:14.371443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:14.371443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:14.371443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:14.372363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:14.372363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:14.372363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:14.372363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:14.372363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:14.372363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:14.372363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:14.372363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:14.372363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:14.372363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:14.372363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:14.372363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:14.372363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:14.372363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:14.372363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:14.372363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:14.372363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:14.373257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:14.373257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:14.373257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:14.373257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:14.373257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 448/878] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:14.379570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f8037-07c2-4859-a377-bab67405a49e None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:14.425733 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:14.490599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f8037-07c2-4859-a377-bab67405a49e None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:14.529214 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cda22d-fd26-4a6e-9245-9c29e10d1448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:14.529912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cda22d-fd26-4a6e-9245-9c29e10d1448 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:14.530196 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cda22d-fd26-4a6e-9245-9c29e10d1448 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:14.530505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cda22d-fd26-4a6e-9245-9c29e10d1448 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:14.531244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cda22d-fd26-4a6e-9245-9c29e10d1448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:14.531562 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cda22d-fd26-4a6e-9245-9c29e10d1448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:14.533015 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cda22d-fd26-4a6e-9245-9c29e10d1448 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:14.546103 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 431/879] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:14.551820 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d224b4-2dae-4f40-b3a8-82597a959572 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:14.584396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25d233-bc32-4ca2-ba44-2219aa137c88 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:14.584685 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25d233-bc32-4ca2-ba44-2219aa137c88 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:14.584867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25d233-bc32-4ca2-ba44-2219aa137c88 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:14.586561 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 432/880] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:20:14.592064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5bbbe-98c3-4649-95c7-16eda1ded38c None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:14.592351 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5bbbe-98c3-4649-95c7-16eda1ded38c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:14.592626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5bbbe-98c3-4649-95c7-16eda1ded38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:14.609382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-21f5bbbe-98c3-4649-95c7-16eda1ded38c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:14.610585 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-21f5bbbe-98c3-4649-95c7-16eda1ded38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:14.621967 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:14.674510 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d224b4-2dae-4f40-b3a8-82597a959572 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:14.689877 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 433/881] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:14 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:20:14.706910 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5bbbe-98c3-4649-95c7-16eda1ded38c None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:14.713503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78d24f-2793-4c55-86b1-8731135b658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:14.714345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78d24f-2793-4c55-86b1-8731135b658b None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:14.714628 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78d24f-2793-4c55-86b1-8731135b658b None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:14.714907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78d24f-2793-4c55-86b1-8731135b658b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:14.724641 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78d24f-2793-4c55-86b1-8731135b658b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:14.726861 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae78d24f-2793-4c55-86b1-8731135b658b None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:14.735994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:14.748490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-ae78d24f-2793-4c55-86b1-8731135b658b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:20:14.748490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:14.748490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:14.748490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:14.748490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:14.748490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:14.748490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:14.748490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:14.748490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:14.748490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:14.748490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:14.748490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:14.748490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:20:14.748490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:20:14.748490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:20:14.748490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:20:14.757698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:14.757698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:14.757698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:20:14.757698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:14.757698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:20:14.757698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:14.757698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:14.757698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:14.757698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:14.757698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:14.757698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:14.757698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:14.757698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:14.757698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:14.757698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:14.757698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:14.757698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:14.757698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:14.759242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:14.759242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:14.759242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:20:14.759242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:20:14.759242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:20:14.759242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:20:14.759242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:20:14.759242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:20:14.759242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:20:14.759242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:14.759242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 449/882] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Jul 21 08:20:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:14.759242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78d24f-2793-4c55-86b1-8731135b658b None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:14.825743 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5bbbe-98c3-4649-95c7-16eda1ded38c None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:14.858651 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78d24f-2793-4c55-86b1-8731135b658b None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:14.859851 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbbc69-7748-4700-939a-57f4c8ec5131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:14.860660 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbbc69-7748-4700-939a-57f4c8ec5131 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:14.860942 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbbc69-7748-4700-939a-57f4c8ec5131 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:14.861201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbbc69-7748-4700-939a-57f4c8ec5131 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:14.861873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dbbc69-7748-4700-939a-57f4c8ec5131 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:14.863215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dbbc69-7748-4700-939a-57f4c8ec5131 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:14.872301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:14.875010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-f3dbbc69-7748-4700-939a-57f4c8ec5131 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:20:14.875010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:14.875010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:14.875010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:14.875010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:14.875010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:14.875010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:14.875010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:14.875010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:20:14.875010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:14.875010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:14.875010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:14.875010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:14.875010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:14.875010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:14.875010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:14.875010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:14.876088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:14.876088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:14.876088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:14.876088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:14.876088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:14.876088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:14.876088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:14.876088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:14.876088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:14.876088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:14.876088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:14.876088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:14.876088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:14.876088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:14.876088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:14.876088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:14.876924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:14.876924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:14.876924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:14.876924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:14.876924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:14.876924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:14.876924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:14.876924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:14.876924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:14.876924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:14.876924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:14.876924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:14.876924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:20:14.876924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:14.876924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 434/883] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:20:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:14.877875 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b8c5c-7113-412c-9c5e-9f49d1d8a203 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:14.877875 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b8c5c-7113-412c-9c5e-9f49d1d8a203 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:14.878005 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b8c5c-7113-412c-9c5e-9f49d1d8a203 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:14.879199 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 435/884] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:14.880243 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a6098-da55-4d62-8fec-3cabaad7c577 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:14.880529 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a6098-da55-4d62-8fec-3cabaad7c577 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:14.880803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2a6098-da55-4d62-8fec-3cabaad7c577 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:14.882038 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 436/885] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:14.882729 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a6098-da55-4d62-8fec-3cabaad7c577 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:14.897883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526042cd-e09e-459f-a787-32953db8ac2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:14.898560 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526042cd-e09e-459f-a787-32953db8ac2a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:14.898841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526042cd-e09e-459f-a787-32953db8ac2a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:14.899119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526042cd-e09e-459f-a787-32953db8ac2a None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:14.901142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526042cd-e09e-459f-a787-32953db8ac2a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:14.901460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526042cd-e09e-459f-a787-32953db8ac2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:14.902914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526042cd-e09e-459f-a787-32953db8ac2a None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:14.920221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 450/886] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Jul 21 08:20:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:14.921317 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c176be1-0afe-4758-86e8-736b6e00d434 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:14.921635 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c176be1-0afe-4758-86e8-736b6e00d434 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:14.921917 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c176be1-0afe-4758-86e8-736b6e00d434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:14.937393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-3c176be1-0afe-4758-86e8-736b6e00d434 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:14.938612 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-3c176be1-0afe-4758-86e8-736b6e00d434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:14.983196 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:14.992932 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2a6098-da55-4d62-8fec-3cabaad7c577 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:15.004921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 451/887] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:14 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:15.006337 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf23c6-1187-4be3-b02a-3879113dca8c None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:15.006632 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf23c6-1187-4be3-b02a-3879113dca8c None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:15.006909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf23c6-1187-4be3-b02a-3879113dca8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:15.022837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-b2cf23c6-1187-4be3-b02a-3879113dca8c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:15.024033 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b2cf23c6-1187-4be3-b02a-3879113dca8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:15.028932 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408aa34-544a-4e3c-bc6f-d9ab693bb954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:15.029614 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408aa34-544a-4e3c-bc6f-d9ab693bb954 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:15.029899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408aa34-544a-4e3c-bc6f-d9ab693bb954 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:15.030172 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408aa34-544a-4e3c-bc6f-d9ab693bb954 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:15.030884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408aa34-544a-4e3c-bc6f-d9ab693bb954 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:15.031192 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408aa34-544a-4e3c-bc6f-d9ab693bb954 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:15.032551 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408aa34-544a-4e3c-bc6f-d9ab693bb954 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:15.037209 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 437/888] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:20:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:15.038014 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408aa34-544a-4e3c-bc6f-d9ab693bb954 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:15.095559 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 452/889] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:15.096602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf23c6-1187-4be3-b02a-3879113dca8c None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:15.127685 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:15.147313 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408aa34-544a-4e3c-bc6f-d9ab693bb954 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:15.181215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0a8d4-cba6-425d-8d51-3eef5c8cb922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:15.182740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0a8d4-cba6-425d-8d51-3eef5c8cb922 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:15.183026 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0a8d4-cba6-425d-8d51-3eef5c8cb922 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:15.183336 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0a8d4-cba6-425d-8d51-3eef5c8cb922 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:15.194838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf23c6-1187-4be3-b02a-3879113dca8c None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:15.208630 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:15.228593 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e046ae4-84a9-443a-9d32-bfdccd8a04f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:15.229574 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e046ae4-84a9-443a-9d32-bfdccd8a04f6 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:15.229574 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e046ae4-84a9-443a-9d32-bfdccd8a04f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:15.229900 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e046ae4-84a9-443a-9d32-bfdccd8a04f6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:15.230542 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e046ae4-84a9-443a-9d32-bfdccd8a04f6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:15.231908 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e046ae4-84a9-443a-9d32-bfdccd8a04f6 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:15.243773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-0e046ae4-84a9-443a-9d32-bfdccd8a04f6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:20:15.243773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:15.243773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:15.243773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:15.243773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:15.243773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:15.243773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:15.243773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:15.243773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:20:15.243773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:15.243773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:15.243773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:15.243773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:15.243773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:15.243773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:15.243773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:15.243773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:15.245256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:15.245256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:15.245256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:15.245256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:15.245256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:15.245256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:15.245256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:15.245256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:15.245256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:15.245256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:15.245256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:15.245256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:15.245256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:15.245256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:15.245256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:15.245256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:15.246480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:15.246480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:15.246480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:15.246480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:15.246480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:15.246480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:15.246480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:15.246480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:15.246480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:15.246480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:15.246480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:15.246480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:15.246480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:20:15.246480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:15.246480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 453/890] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 08:20:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:15.247422 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e046ae4-84a9-443a-9d32-bfdccd8a04f6 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:15.254823 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0a8d4-cba6-425d-8d51-3eef5c8cb922 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:15.256280 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0a8d4-cba6-425d-8d51-3eef5c8cb922 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:15.338046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:15.343620 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e046ae4-84a9-443a-9d32-bfdccd8a04f6 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:15.354199 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 438/891] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:20:15 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:20:15.355010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0a8d4-cba6-425d-8d51-3eef5c8cb922 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:15.381878 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0318e-43a0-4bde-b5b3-9d3d65be4860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:15.382462 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0318e-43a0-4bde-b5b3-9d3d65be4860 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:15.382742 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0318e-43a0-4bde-b5b3-9d3d65be4860 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:15.383015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0318e-43a0-4bde-b5b3-9d3d65be4860 None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:15.383714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0318e-43a0-4bde-b5b3-9d3d65be4860 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:15.384023 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0318e-43a0-4bde-b5b3-9d3d65be4860 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:15.385966 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0318e-43a0-4bde-b5b3-9d3d65be4860 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:15.390676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 454/892] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:20:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:15.391435 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0318e-43a0-4bde-b5b3-9d3d65be4860 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:15.409545 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:15.451979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0a8d4-cba6-425d-8d51-3eef5c8cb922 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:15.486665 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04df49e-40ba-4731-a2d9-f024d1d56cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:15.487318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04df49e-40ba-4731-a2d9-f024d1d56cff None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:15.487604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04df49e-40ba-4731-a2d9-f024d1d56cff None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:15.487880 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04df49e-40ba-4731-a2d9-f024d1d56cff None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:15.488651 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04df49e-40ba-4731-a2d9-f024d1d56cff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:15.490143 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04df49e-40ba-4731-a2d9-f024d1d56cff None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:15.491235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0318e-43a0-4bde-b5b3-9d3d65be4860 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:15.524966 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a46785-db8b-4d8a-b9cf-553bd1544d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:15.526177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a46785-db8b-4d8a-b9cf-553bd1544d1c None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:15.526484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a46785-db8b-4d8a-b9cf-553bd1544d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:15.526763 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a46785-db8b-4d8a-b9cf-553bd1544d1c None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:15.527454 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a46785-db8b-4d8a-b9cf-553bd1544d1c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:15.527816 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a46785-db8b-4d8a-b9cf-553bd1544d1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:15.529164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a46785-db8b-4d8a-b9cf-553bd1544d1c None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:15.533693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 455/893] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Jul 21 08:20:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:15.534452 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a46785-db8b-4d8a-b9cf-553bd1544d1c None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:15.558209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:15.587114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 439/894] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 08:20:15 2022] POST /identity/v3/services => generated 269 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:20:15.588565 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04df49e-40ba-4731-a2d9-f024d1d56cff None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:15.644825 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a46785-db8b-4d8a-b9cf-553bd1544d1c None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:15.690215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e34a06-7dab-4b89-adf7-c669a9f7ae6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:15.691027 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e34a06-7dab-4b89-adf7-c669a9f7ae6f None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:15.691290 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e34a06-7dab-4b89-adf7-c669a9f7ae6f None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:15.691561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e34a06-7dab-4b89-adf7-c669a9f7ae6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:15.703452 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04df49e-40ba-4731-a2d9-f024d1d56cff None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:15.703861 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e34a06-7dab-4b89-adf7-c669a9f7ae6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:15.705336 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e34a06-7dab-4b89-adf7-c669a9f7ae6f None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:15.722127 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:15.724034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-98e34a06-7dab-4b89-adf7-c669a9f7ae6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:15.724034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:15.724034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:15.724034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:15.724034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:15.724034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:15.724034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:15.724034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:15.724034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:15.724034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:15.724034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:15.724034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:15.724034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:15.724034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:15.724034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:15.724924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:15.724924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:15.724924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:15.724924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:15.724924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:15.724924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:15.724924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:15.724924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:15.724924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:15.724924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:15.724924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:15.724924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:15.724924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:15.724924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:15.724924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:15.724924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:15.724924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:15.726232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:15.726232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:15.726232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:15.726232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:15.730897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 456/895] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:15.731774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e34a06-7dab-4b89-adf7-c669a9f7ae6f None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:15.748118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89d579-3d9e-420d-a4a8-4eb5afbd2366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:15.748903 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89d579-3d9e-420d-a4a8-4eb5afbd2366 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:15.749064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89d579-3d9e-420d-a4a8-4eb5afbd2366 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:15.749340 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89d579-3d9e-420d-a4a8-4eb5afbd2366 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:15.752965 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89d579-3d9e-420d-a4a8-4eb5afbd2366 None admin] RBAC: Adding query filter params (interface=public, service_id=3a850e379f3848359e8e21bb316ad631, region_id=RegionOne) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:15.752965 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89d579-3d9e-420d-a4a8-4eb5afbd2366 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:15.752965 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f89d579-3d9e-420d-a4a8-4eb5afbd2366 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:15.759105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 440/896] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Jul 21 08:20:15 2022] GET /identity/v3/endpoints?service_id=3a850e379f3848359e8e21bb316ad631&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:15.760170 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89d579-3d9e-420d-a4a8-4eb5afbd2366 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:15.818460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:15.849098 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e34a06-7dab-4b89-adf7-c669a9f7ae6f None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:15.873440 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f89d579-3d9e-420d-a4a8-4eb5afbd2366 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:15.884611 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14397568-0e52-40c7-bfe1-d8a3a5694adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:15.885266 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14397568-0e52-40c7-bfe1-d8a3a5694adf None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:15.885563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14397568-0e52-40c7-bfe1-d8a3a5694adf None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:15.885842 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14397568-0e52-40c7-bfe1-d8a3a5694adf None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:15.886543 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14397568-0e52-40c7-bfe1-d8a3a5694adf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:15.886848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14397568-0e52-40c7-bfe1-d8a3a5694adf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:15.888201 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14397568-0e52-40c7-bfe1-d8a3a5694adf None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:15.892652 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 457/897] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Jul 21 08:20:15 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:15.893418 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14397568-0e52-40c7-bfe1-d8a3a5694adf None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:15.928890 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee066f-032b-4718-85ec-ee57b91d86d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:15.930577 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee066f-032b-4718-85ec-ee57b91d86d3 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:15.931031 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee066f-032b-4718-85ec-ee57b91d86d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:15.931902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee066f-032b-4718-85ec-ee57b91d86d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:15.932855 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee066f-032b-4718-85ec-ee57b91d86d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:15.933322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee066f-032b-4718-85ec-ee57b91d86d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:15.936296 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee066f-032b-4718-85ec-ee57b91d86d3 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:15.959843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 441/898] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:15.960997 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee066f-032b-4718-85ec-ee57b91d86d3 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:16.010247 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:16.026944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14397568-0e52-40c7-bfe1-d8a3a5694adf None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:16.066288 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8353250-4a56-450e-a7a1-6cb9c4c91b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:16.069463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8353250-4a56-450e-a7a1-6cb9c4c91b98 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:16.069463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8353250-4a56-450e-a7a1-6cb9c4c91b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:16.069463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8353250-4a56-450e-a7a1-6cb9c4c91b98 None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:16.069463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8353250-4a56-450e-a7a1-6cb9c4c91b98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:16.069839 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8353250-4a56-450e-a7a1-6cb9c4c91b98 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:16.072761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:16.074427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee066f-032b-4718-85ec-ee57b91d86d3 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:16.078475 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 458/899] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Jul 21 08:20:15 2022] GET /identity/v3/services => generated 1268 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:20:16.114717 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83326e18-d837-49e8-9699-885b5edf7097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:16.115533 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83326e18-d837-49e8-9699-885b5edf7097 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:16.118937 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83326e18-d837-49e8-9699-885b5edf7097 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:16.118937 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83326e18-d837-49e8-9699-885b5edf7097 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:16.124236 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83326e18-d837-49e8-9699-885b5edf7097 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:16.125748 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83326e18-d837-49e8-9699-885b5edf7097 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:16.142114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-83326e18-d837-49e8-9699-885b5edf7097 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:16.142114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:16.142114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:16.142114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:16.142114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:16.142114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:16.142114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:16.142114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:16.142114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:16.142114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:16.142114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:16.142114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:16.142114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:16.142114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:16.142114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:16.143215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:16.143215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:16.143215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:16.143215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:16.143215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:16.143215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:16.143215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:16.143215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:16.143215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:16.143215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:16.143215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:16.143215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:16.143215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:16.143215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:16.143215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:16.143215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:16.143215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:16.144341 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:16.144341 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:16.144341 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:16.144341 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:16.144341 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:16.144341 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:16.144341 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:16.144341 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:16.144341 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 442/900] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:16.149724 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8353250-4a56-450e-a7a1-6cb9c4c91b98 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:16.270976 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8353250-4a56-450e-a7a1-6cb9c4c91b98 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:16.307859 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bbfb1-6a51-4baa-924a-bd506929ae54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:16.308787 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bbfb1-6a51-4baa-924a-bd506929ae54 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:16.309232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bbfb1-6a51-4baa-924a-bd506929ae54 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:16.309693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bbfb1-6a51-4baa-924a-bd506929ae54 None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:16.310624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bbfb1-6a51-4baa-924a-bd506929ae54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:16.311115 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bbfb1-6a51-4baa-924a-bd506929ae54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:16.312753 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bbfb1-6a51-4baa-924a-bd506929ae54 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:16.326406 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 459/901] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:20:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:16.336678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83326e18-d837-49e8-9699-885b5edf7097 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:16.435667 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:16.438895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83326e18-d837-49e8-9699-885b5edf7097 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:16.472968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa4bd1-f3f4-4cb6-9140-174f4d1c60c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:16.473723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa4bd1-f3f4-4cb6-9140-174f4d1c60c5 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:16.474011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa4bd1-f3f4-4cb6-9140-174f4d1c60c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:16.474287 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa4bd1-f3f4-4cb6-9140-174f4d1c60c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:16.475122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa4bd1-f3f4-4cb6-9140-174f4d1c60c5 None admin] RBAC: Adding query filter params (role.id=fca61019937a482aa7bea9176fe21f2a, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=22750d44d710439da1d18a78419b1adf) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:16.475434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa4bd1-f3f4-4cb6-9140-174f4d1c60c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:16.477118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa4bd1-f3f4-4cb6-9140-174f4d1c60c5 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:16.483701 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 443/902] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:20:16 2022] GET /identity/v3/role_assignments?user.id=22750d44d710439da1d18a78419b1adf&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=fca61019937a482aa7bea9176fe21f2a => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:17.673983 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53849e-3063-4ef5-91fa-2859bdbcfd5a None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:17.674536 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53849e-3063-4ef5-91fa-2859bdbcfd5a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:17.674536 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53849e-3063-4ef5-91fa-2859bdbcfd5a None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:17.676167 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 460/903] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:17.681937 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b6528-f46c-4bf6-b62f-e6577ee2ced9 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:17.682355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b6528-f46c-4bf6-b62f-e6577ee2ced9 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:17.682526 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b6528-f46c-4bf6-b62f-e6577ee2ced9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:17.704973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-7b0b6528-f46c-4bf6-b62f-e6577ee2ced9 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:17.706190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7b0b6528-f46c-4bf6-b62f-e6577ee2ced9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:17.780071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 444/904] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:17.802758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53849e-3063-4ef5-91fa-2859bdbcfd5a None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:17.866524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:17.908657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53849e-3063-4ef5-91fa-2859bdbcfd5a None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:17.944728 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa0502-c52d-4131-ae6f-26c6ca0ce222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:17.945887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa0502-c52d-4131-ae6f-26c6ca0ce222 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:17.946387 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa0502-c52d-4131-ae6f-26c6ca0ce222 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:17.946925 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa0502-c52d-4131-ae6f-26c6ca0ce222 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:17.947795 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa0502-c52d-4131-ae6f-26c6ca0ce222 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:17.949339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaa0502-c52d-4131-ae6f-26c6ca0ce222 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:17.961776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-9eaa0502-c52d-4131-ae6f-26c6ca0ce222 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:20:17.961776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:17.961776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:17.961776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:17.961776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:17.961776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:17.961776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:17.961776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:17.961776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:20:17.961776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:17.961776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:17.961776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:17.961776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:17.961776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:17.961776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:17.961776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:17.962789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:17.962789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:17.962789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:17.962789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:17.962789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:17.962789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:17.962789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:17.962789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:17.962789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:17.962789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:17.962789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:17.962789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:17.962789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:17.962789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:17.962789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:17.962789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:17.963616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:17.963616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:17.963616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:17.963616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:17.963616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:17.963616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:17.963616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:17.963616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:17.963616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:17.963616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:17.963616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:17.963616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:17.963616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:17.963616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:20:17.963616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:17.966510 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 461/905] 10.222.0.57 () {56 vars in 1132 bytes} [Thu Jul 21 08:20:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:17.974841 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b6528-f46c-4bf6-b62f-e6577ee2ced9 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:18.027806 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ebc50-960b-46ca-a4d3-73f008e09f5a None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.028154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ebc50-960b-46ca-a4d3-73f008e09f5a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.028359 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ebc50-960b-46ca-a4d3-73f008e09f5a None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:18.029737 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 462/906] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:18.034593 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b41a1e-4346-494a-8bf5-9839d9d9d8e2 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.034879 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b41a1e-4346-494a-8bf5-9839d9d9d8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.035156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b41a1e-4346-494a-8bf5-9839d9d9d8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:18.052171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-86b41a1e-4346-494a-8bf5-9839d9d9d8e2 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:18.053346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-86b41a1e-4346-494a-8bf5-9839d9d9d8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:18.076862 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:18.083729 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b6528-f46c-4bf6-b62f-e6577ee2ced9 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:18.121300 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668a254-2888-4b4b-b090-b76d418db238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:18.122202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668a254-2888-4b4b-b090-b76d418db238 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.122551 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668a254-2888-4b4b-b090-b76d418db238 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.122892 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668a254-2888-4b4b-b090-b76d418db238 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:18.123673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668a254-2888-4b4b-b090-b76d418db238 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:18.124140 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668a254-2888-4b4b-b090-b76d418db238 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:18.125735 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668a254-2888-4b4b-b090-b76d418db238 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:18.129942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 463/907] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:20:18.134316 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 445/908] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 08:20:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:18.139835 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b41a1e-4346-494a-8bf5-9839d9d9d8e2 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:18.153589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668a254-2888-4b4b-b090-b76d418db238 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:18.201557 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:18.253424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b41a1e-4346-494a-8bf5-9839d9d9d8e2 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:18.271875 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668a254-2888-4b4b-b090-b76d418db238 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:18.289463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcc2e7-223d-47d1-8b6c-458803551f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:18.290163 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcc2e7-223d-47d1-8b6c-458803551f9a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.290449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcc2e7-223d-47d1-8b6c-458803551f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.290767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcc2e7-223d-47d1-8b6c-458803551f9a None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:18.291466 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcc2e7-223d-47d1-8b6c-458803551f9a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:18.291771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcc2e7-223d-47d1-8b6c-458803551f9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:18.293138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcc2e7-223d-47d1-8b6c-458803551f9a None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:18.302456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 464/909] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 08:20:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:18.302456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10432f64-689d-40d0-827b-bc66df8cf4ea None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.302456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10432f64-689d-40d0-827b-bc66df8cf4ea None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.302456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10432f64-689d-40d0-827b-bc66df8cf4ea None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:18.304843 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 465/910] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:18.305644 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10432f64-689d-40d0-827b-bc66df8cf4ea None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:18.312552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f46a6b-c2d0-41f0-8de2-9c10bf4b10de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:18.313203 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f46a6b-c2d0-41f0-8de2-9c10bf4b10de None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.313480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f46a6b-c2d0-41f0-8de2-9c10bf4b10de None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.313781 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f46a6b-c2d0-41f0-8de2-9c10bf4b10de None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:18.314508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f46a6b-c2d0-41f0-8de2-9c10bf4b10de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:18.315867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f46a6b-c2d0-41f0-8de2-9c10bf4b10de None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:18.403408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 446/911] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 08:20:18 2022] POST /identity/v3/services => generated 241 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:20:18.404659 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3314fa9-8d10-4400-9635-604eec4c00ab None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.404944 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3314fa9-8d10-4400-9635-604eec4c00ab None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.405217 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3314fa9-8d10-4400-9635-604eec4c00ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:18.423432 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-f3314fa9-8d10-4400-9635-604eec4c00ab None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:18.424644 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f3314fa9-8d10-4400-9635-604eec4c00ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:18.428907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10432f64-689d-40d0-827b-bc66df8cf4ea None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:18.440114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:18.449748 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:18.474961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf3cb6-8fee-43b0-9cc6-5cf3e4dd59c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:18.475678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf3cb6-8fee-43b0-9cc6-5cf3e4dd59c5 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.475958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf3cb6-8fee-43b0-9cc6-5cf3e4dd59c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.476235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf3cb6-8fee-43b0-9cc6-5cf3e4dd59c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:18.477356 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf3cb6-8fee-43b0-9cc6-5cf3e4dd59c5 None admin] RBAC: Adding query filter params (interface=public, service_id=effafc1401ac494cbeda30d3d6005345, region_id=RegionOne) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:18.477718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf3cb6-8fee-43b0-9cc6-5cf3e4dd59c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:18.480497 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf3cb6-8fee-43b0-9cc6-5cf3e4dd59c5 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:18.491407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 466/912] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Jul 21 08:20:18 2022] GET /identity/v3/endpoints?service_id=effafc1401ac494cbeda30d3d6005345&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:18.492493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf3cb6-8fee-43b0-9cc6-5cf3e4dd59c5 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:18.522607 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 447/913] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:18.547184 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3314fa9-8d10-4400-9635-604eec4c00ab None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:18.623706 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf3cb6-8fee-43b0-9cc6-5cf3e4dd59c5 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:18.662801 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea33797-bb2a-4f00-a310-16fb1bc7e238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:18.663810 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea33797-bb2a-4f00-a310-16fb1bc7e238 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.664316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea33797-bb2a-4f00-a310-16fb1bc7e238 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.664791 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea33797-bb2a-4f00-a310-16fb1bc7e238 None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:18.665382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3314fa9-8d10-4400-9635-604eec4c00ab None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:18.665960 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea33797-bb2a-4f00-a310-16fb1bc7e238 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:18.667738 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea33797-bb2a-4f00-a310-16fb1bc7e238 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:18.674287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 467/914] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Jul 21 08:20:18 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:20:18.675730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013656e-77ce-4fbc-bcb8-f4119408e600 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.676081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013656e-77ce-4fbc-bcb8-f4119408e600 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.676427 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013656e-77ce-4fbc-bcb8-f4119408e600 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:18.681585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 468/915] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:18.683941 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be8f5b-6a11-439a-aa6c-1b1751088a99 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.684231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be8f5b-6a11-439a-aa6c-1b1751088a99 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.684512 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be8f5b-6a11-439a-aa6c-1b1751088a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:18.703548 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-91be8f5b-6a11-439a-aa6c-1b1751088a99 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:18.704778 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-91be8f5b-6a11-439a-aa6c-1b1751088a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:18.712306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb7154-f67f-421d-b9e5-3b60ec940f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:18.714737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb7154-f67f-421d-b9e5-3b60ec940f11 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.715431 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb7154-f67f-421d-b9e5-3b60ec940f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.716013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb7154-f67f-421d-b9e5-3b60ec940f11 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:18.716903 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb7154-f67f-421d-b9e5-3b60ec940f11 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:18.718738 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb7154-f67f-421d-b9e5-3b60ec940f11 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:18.734921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-35cb7154-f67f-421d-b9e5-3b60ec940f11 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:20:18.734921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:18.734921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:18.734921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:18.734921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:18.734921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:18.734921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:18.734921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:18.734921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:20:18.734921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:18.734921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:18.734921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:18.734921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:18.734921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:18.734921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:18.734921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:18.734921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:18.736290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:18.736290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:18.736290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:18.736290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:18.736290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:18.736290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:18.736290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:18.736290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:18.736290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:18.736290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:18.736290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:18.736290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:18.736290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:18.736290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:18.736290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:18.736290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:18.737226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:18.737226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:18.737226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:18.737226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:18.737226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:18.737226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:18.737226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:18.737226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:18.737226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:18.737226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:18.737226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:18.737226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:18.737226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 08:20:18.737226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:18.739109 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 448/916] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:20:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:18.745602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb7154-f67f-421d-b9e5-3b60ec940f11 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:18.767384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:18.770130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:18.813664 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 469/917] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:18.829692 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be8f5b-6a11-439a-aa6c-1b1751088a99 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:18.866198 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb7154-f67f-421d-b9e5-3b60ec940f11 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:18.913771 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af824f8a-3000-44c7-8877-c743b8f8332b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:18.914452 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af824f8a-3000-44c7-8877-c743b8f8332b None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.914737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af824f8a-3000-44c7-8877-c743b8f8332b None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.915013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af824f8a-3000-44c7-8877-c743b8f8332b None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:18.915767 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af824f8a-3000-44c7-8877-c743b8f8332b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:18.916077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af824f8a-3000-44c7-8877-c743b8f8332b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:18.917997 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af824f8a-3000-44c7-8877-c743b8f8332b None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:18.925105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 449/918] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:20:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:18.930802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af824f8a-3000-44c7-8877-c743b8f8332b None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:18.950006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be8f5b-6a11-439a-aa6c-1b1751088a99 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:18.987233 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798807f8-208c-4f48-b5ba-bc0f98da21cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:18.988409 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798807f8-208c-4f48-b5ba-bc0f98da21cd None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:18.988898 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798807f8-208c-4f48-b5ba-bc0f98da21cd None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:18.989394 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798807f8-208c-4f48-b5ba-bc0f98da21cd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:19.001441 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798807f8-208c-4f48-b5ba-bc0f98da21cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:20:19.011014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-798807f8-208c-4f48-b5ba-bc0f98da21cd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:20:19.011014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:19.011014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:19.011014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:19.011014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:19.011014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:19.011014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:19.011014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:19.011014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:19.011014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:19.011014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:19.011014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:19.011014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:20:19.011014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:20:19.011014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:20:19.011014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:20:19.012221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:20:19.012221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:20:19.012221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:20:19.012221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:20:19.012221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:19.012221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:19.012221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:19.012221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:19.012221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:19.012221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:19.012221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:19.012221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:19.012221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:19.012221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:19.012221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:19.012221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:19.013287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:19.013287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:19.013287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:19.013287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:19.013287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:20:19.013287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:20:19.013287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:20:19.013287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:20:19.013287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:20:19.013287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:20:19.013287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:20:19.013287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:19.019887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 470/919] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Jul 21 08:20:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:19.021224 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798807f8-208c-4f48-b5ba-bc0f98da21cd None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:19.032069 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:19.058069 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:19.064304 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af824f8a-3000-44c7-8877-c743b8f8332b None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:19.110646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c4144-47db-480a-ba24-8cea7c646fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:19.111317 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c4144-47db-480a-ba24-8cea7c646fbe None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:19.111600 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c4144-47db-480a-ba24-8cea7c646fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:19.111877 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c4144-47db-480a-ba24-8cea7c646fbe None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:19.112593 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c4144-47db-480a-ba24-8cea7c646fbe None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:19.112901 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c4144-47db-480a-ba24-8cea7c646fbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:19.114707 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c4144-47db-480a-ba24-8cea7c646fbe None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:19.121624 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 450/920] 10.222.0.57 () {56 vars in 1114 bytes} [Thu Jul 21 08:20:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:19.127800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c4144-47db-480a-ba24-8cea7c646fbe None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:19.151240 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798807f8-208c-4f48-b5ba-bc0f98da21cd None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:19.194135 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c9d97-1da6-4879-ad59-1e77f1637d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:19.194970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c9d97-1da6-4879-ad59-1e77f1637d65 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:19.195253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c9d97-1da6-4879-ad59-1e77f1637d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:19.195578 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c9d97-1da6-4879-ad59-1e77f1637d65 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:19.196687 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c9d97-1da6-4879-ad59-1e77f1637d65 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:19.197571 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c9d97-1da6-4879-ad59-1e77f1637d65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:19.198951 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1c9d97-1da6-4879-ad59-1e77f1637d65 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:19.210394 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 471/921] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Jul 21 08:20:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:19.215349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c9d97-1da6-4879-ad59-1e77f1637d65 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:19.259125 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c4144-47db-480a-ba24-8cea7c646fbe None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:19.295031 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0adab-9aea-440c-8c0b-13331dac55e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:19.296064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0adab-9aea-440c-8c0b-13331dac55e0 None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:19.296551 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0adab-9aea-440c-8c0b-13331dac55e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:19.297151 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0adab-9aea-440c-8c0b-13331dac55e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:19.298240 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0adab-9aea-440c-8c0b-13331dac55e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:19.299828 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0adab-9aea-440c-8c0b-13331dac55e0 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:19.313126 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:19.336670 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:19.343353 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c9d97-1da6-4879-ad59-1e77f1637d65 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:19.376847 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6628df-1b4f-489c-90a9-598d216dc950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:19.377663 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6628df-1b4f-489c-90a9-598d216dc950 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:19.377946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6628df-1b4f-489c-90a9-598d216dc950 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:19.378219 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6628df-1b4f-489c-90a9-598d216dc950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:19.388968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6628df-1b4f-489c-90a9-598d216dc950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:19.390438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6628df-1b4f-489c-90a9-598d216dc950 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:19.407316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-ef6628df-1b4f-489c-90a9-598d216dc950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:19.407316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:19.407316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:19.407316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:19.407316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:19.407316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:19.407316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:19.407316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:19.407316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:19.407316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:19.407316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:19.407316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:19.407316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:19.407316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:19.407316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:19.408236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:19.408236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:19.408236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:19.408236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:19.408236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:19.408236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:19.408236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:19.408236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:19.408236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:19.408236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:19.408236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:19.408236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:19.408236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:19.408236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:19.408236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:19.408236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:19.408236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:19.414241 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:19.414241 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:19.414241 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:19.414241 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:19.414241 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 472/922] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:19.418143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6628df-1b4f-489c-90a9-598d216dc950 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:19.423257 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 451/923] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Jul 21 08:20:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:20:19.541035 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6628df-1b4f-489c-90a9-598d216dc950 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:19.588225 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4265b-4ec8-4898-8203-e61cd822b4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:19.588609 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4265b-4ec8-4898-8203-e61cd822b4db None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:19.588893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4265b-4ec8-4898-8203-e61cd822b4db None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:19.589171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4265b-4ec8-4898-8203-e61cd822b4db None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:19.589916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4265b-4ec8-4898-8203-e61cd822b4db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:19.590222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4265b-4ec8-4898-8203-e61cd822b4db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:19.591657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4265b-4ec8-4898-8203-e61cd822b4db None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:19.606421 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 473/924] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:19.611049 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0adab-9aea-440c-8c0b-13331dac55e0 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:19.717840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0adab-9aea-440c-8c0b-13331dac55e0 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:19.764604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc6135-7e85-4e44-a0f5-8988aa5f4a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:19.765416 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc6135-7e85-4e44-a0f5-8988aa5f4a2a None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:19.765723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc6135-7e85-4e44-a0f5-8988aa5f4a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:19.766003 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc6135-7e85-4e44-a0f5-8988aa5f4a2a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:19.774339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc6135-7e85-4e44-a0f5-8988aa5f4a2a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:19.776300 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bc6135-7e85-4e44-a0f5-8988aa5f4a2a None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:19.797124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-41bc6135-7e85-4e44-a0f5-8988aa5f4a2a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:20:19.797124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:19.797124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:19.797124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:19.797124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:19.797124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:19.797124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:19.797124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:19.797124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:19.797124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:19.797124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:19.797124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:19.797124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:20:19.797124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:20:19.797124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:20:19.797124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:20:19.798113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:19.798113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:19.798113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:20:19.798113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:19.798113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:20:19.798113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:19.798113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:19.798113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:19.798113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:19.798113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:19.798113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:19.798113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:19.798113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:19.798113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:19.798113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:19.798113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:19.798113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:19.798113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:19.799061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:19.799061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:19.799061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:20:19.799061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:20:19.799061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:20:19.799061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:20:19.799061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:20:19.799061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:20:19.799061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:20:19.799061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:19.803052 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 452/925] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Jul 21 08:20:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:19.804393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4265b-4ec8-4898-8203-e61cd822b4db None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:19.807404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:19.911016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4265b-4ec8-4898-8203-e61cd822b4db None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:19.953400 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808f3de-fea3-4deb-b96c-cf83c538f5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:19.954111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808f3de-fea3-4deb-b96c-cf83c538f5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:19.954394 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808f3de-fea3-4deb-b96c-cf83c538f5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:19.954675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808f3de-fea3-4deb-b96c-cf83c538f5b3 None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:19.955520 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808f3de-fea3-4deb-b96c-cf83c538f5b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:19.955830 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808f3de-fea3-4deb-b96c-cf83c538f5b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:19.957263 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808f3de-fea3-4deb-b96c-cf83c538f5b3 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:19.977611 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 474/926] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Jul 21 08:20:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:19.982190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc6135-7e85-4e44-a0f5-8988aa5f4a2a None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:20.042456 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:20.087327 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc6135-7e85-4e44-a0f5-8988aa5f4a2a None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:20.130506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fcf8b-409c-4d8b-ae9a-0eccb4fcc5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:20.131337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fcf8b-409c-4d8b-ae9a-0eccb4fcc5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:20.131627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fcf8b-409c-4d8b-ae9a-0eccb4fcc5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:20.131902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fcf8b-409c-4d8b-ae9a-0eccb4fcc5a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:20.143600 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fcf8b-409c-4d8b-ae9a-0eccb4fcc5a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:20.145047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fcf8b-409c-4d8b-ae9a-0eccb4fcc5a1 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:20.163230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-8f2fcf8b-409c-4d8b-ae9a-0eccb4fcc5a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:20.163230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:20.163230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:20.163230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:20.163230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:20.163230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:20.163230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:20.163230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:20.163230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:20.163230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:20.163230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:20.163230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:20.163230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:20.163230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:20.163230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:20.165277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:20.165277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:20.165277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:20.165277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:20.165277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:20.165277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:20.165277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:20.165277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:20.165277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:20.165277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:20.165277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:20.165277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:20.165277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:20.165277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:20.165277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:20.165277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:20.165277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:20.167345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:20.167345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:20.167345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:20.167345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:20.167345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 453/927] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:20.170682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808f3de-fea3-4deb-b96c-cf83c538f5b3 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:20.234301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:20.279050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808f3de-fea3-4deb-b96c-cf83c538f5b3 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:20.318263 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223f915-94a3-4434-9111-47d8d58e0f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:20.318927 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f915-94a3-4434-9111-47d8d58e0f98 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:20.319213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f915-94a3-4434-9111-47d8d58e0f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:20.319493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f915-94a3-4434-9111-47d8d58e0f98 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:20.320271 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223f915-94a3-4434-9111-47d8d58e0f98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:20.320591 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223f915-94a3-4434-9111-47d8d58e0f98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:20.322566 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223f915-94a3-4434-9111-47d8d58e0f98 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:20.339311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 475/928] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:20.340307 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fcf8b-409c-4d8b-ae9a-0eccb4fcc5a1 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:20.443640 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fcf8b-409c-4d8b-ae9a-0eccb4fcc5a1 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:20.453332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:20.482597 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe2f07-d60b-45ad-adb2-1004a859986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:20.483443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe2f07-d60b-45ad-adb2-1004a859986f None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:20.483786 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe2f07-d60b-45ad-adb2-1004a859986f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:20.484061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe2f07-d60b-45ad-adb2-1004a859986f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:20.486331 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0712f7-6b0b-4009-87fd-3b6b7ab841c7 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:20.486624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0712f7-6b0b-4009-87fd-3b6b7ab841c7 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:20.486902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0712f7-6b0b-4009-87fd-3b6b7ab841c7 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:20.488472 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 476/929] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:20.492444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe2f07-d60b-45ad-adb2-1004a859986f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:20.493448 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c6669-c075-4cbd-8e48-0985478351ee None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:20.494278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c6669-c075-4cbd-8e48-0985478351ee None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:20.494520 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe2f07-d60b-45ad-adb2-1004a859986f None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:20.494684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c6669-c075-4cbd-8e48-0985478351ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:20.512161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-00fe2f07-d60b-45ad-adb2-1004a859986f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:20.512161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:20.512161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:20.512161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:20.512161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:20.512161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:20.512161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:20.512161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:20.512161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:20.512161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:20.512161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:20.512161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:20.512161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:20.512161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:20.512161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:20.514055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:20.514055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:20.514055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:20.514055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:20.514055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:20.514055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:20.514055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:20.514055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:20.514055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:20.514055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:20.514055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:20.514055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:20.514055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:20.514055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:20.514055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:20.514055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:20.514055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:20.515276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:20.515276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:20.515276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:20.515276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:20.515276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:20.515276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:20.515276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:20.515276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:20.515904 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-a60c6669-c075-4cbd-8e48-0985478351ee None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:20.515904 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-a60c6669-c075-4cbd-8e48-0985478351ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:20.516058 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 454/930] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:20.521251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe2f07-d60b-45ad-adb2-1004a859986f None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:20.588168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 477/931] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:20:20.610440 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c6669-c075-4cbd-8e48-0985478351ee None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:20.625552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe2f07-d60b-45ad-adb2-1004a859986f None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:20.661798 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be43b41-4f10-44ab-bd7b-4fbe0302f20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:20.662479 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be43b41-4f10-44ab-bd7b-4fbe0302f20a None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:20.662764 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be43b41-4f10-44ab-bd7b-4fbe0302f20a None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:20.663081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be43b41-4f10-44ab-bd7b-4fbe0302f20a None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:20.663907 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be43b41-4f10-44ab-bd7b-4fbe0302f20a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:20.664253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be43b41-4f10-44ab-bd7b-4fbe0302f20a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:20.664421 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:20.665827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be43b41-4f10-44ab-bd7b-4fbe0302f20a None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:20.678324 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 455/932] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:20:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:20.684607 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be43b41-4f10-44ab-bd7b-4fbe0302f20a None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:20.718744 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c6669-c075-4cbd-8e48-0985478351ee None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:20.729944 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:20.756522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e7eb9-5109-45c7-8197-139f020253d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:20.757339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e7eb9-5109-45c7-8197-139f020253d6 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:20.757668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e7eb9-5109-45c7-8197-139f020253d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:20.757949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e7eb9-5109-45c7-8197-139f020253d6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:20.758604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e7eb9-5109-45c7-8197-139f020253d6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:20.760012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e7eb9-5109-45c7-8197-139f020253d6 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:20.773323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-096e7eb9-5109-45c7-8197-139f020253d6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:20:20.773323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:20.773323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:20.773323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:20.773323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:20.773323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:20.773323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:20.773323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:20.773323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:20:20.773323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:20.773323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:20.773323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:20.773323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:20.773323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:20.773323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:20.773323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:20.773323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:20.775638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:20.775638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:20.775638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:20.775638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:20.775638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:20.775638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:20.775638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:20.775638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:20.775638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:20.775638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:20.775638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:20.775638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:20.775638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:20.775638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:20.775638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:20.775638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:20.776893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:20.776893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:20.776893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:20.776893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:20.776893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:20.776893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:20.776893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:20.776893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:20.776893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:20.776893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:20.776893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:20.776893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:20.776893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:20:20.776893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:20.776893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 478/933] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 08:20:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:20.785568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e7eb9-5109-45c7-8197-139f020253d6 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:20.800376 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be43b41-4f10-44ab-bd7b-4fbe0302f20a None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:20.838429 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0feea-9c2f-4cc2-83f7-a655d1e9b373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:20.839566 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0feea-9c2f-4cc2-83f7-a655d1e9b373 None admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:20.839873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0feea-9c2f-4cc2-83f7-a655d1e9b373 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:20.840178 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0feea-9c2f-4cc2-83f7-a655d1e9b373 None admin] PATH_INFO: `/v3/projects/83100b3a5d584e39886c234391fdb204/users/22750d44d710439da1d18a78419b1adf/roles/fca61019937a482aa7bea9176fe21f2a` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:20.842516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0feea-9c2f-4cc2-83f7-a655d1e9b373 None admin] RBAC: Authorizing `identity:create_grant(project_id=83100b3a5d584e39886c234391fdb204, user_id=22750d44d710439da1d18a78419b1adf, role_id=fca61019937a482aa7bea9176fe21f2a)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:20.843959 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0feea-9c2f-4cc2-83f7-a655d1e9b373 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:20.900661 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e7eb9-5109-45c7-8197-139f020253d6 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:20.916027 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 456/934] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:20:20 2022] PUT /identity/v3/projects/83100b3a5d584e39886c234391fdb204/users/22750d44d710439da1d18a78419b1adf/roles/fca61019937a482aa7bea9176fe21f2a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:20:20.917090 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:20.919297 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ac6b4-b59a-4bfa-a3a0-60ddcb00004d None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:20.919830 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ac6b4-b59a-4bfa-a3a0-60ddcb00004d None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:20.920422 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ac6b4-b59a-4bfa-a3a0-60ddcb00004d None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:20.923137 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 457/935] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:20.929224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2922f-aa2d-43a9-9e68-1f4f650b24e6 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:20.929827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2922f-aa2d-43a9-9e68-1f4f650b24e6 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:20.930483 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2922f-aa2d-43a9-9e68-1f4f650b24e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:20.940618 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05c4e5-9fe7-4d8e-9afa-51896430a1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:20.941395 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05c4e5-9fe7-4d8e-9afa-51896430a1cf None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:20.941779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05c4e5-9fe7-4d8e-9afa-51896430a1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:20.942129 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05c4e5-9fe7-4d8e-9afa-51896430a1cf None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:20.942928 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05c4e5-9fe7-4d8e-9afa-51896430a1cf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:20.943307 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05c4e5-9fe7-4d8e-9afa-51896430a1cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:20.944847 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05c4e5-9fe7-4d8e-9afa-51896430a1cf None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:20.951403 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 479/936] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Jul 21 08:20:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:20.955041 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-e3a2922f-aa2d-43a9-9e68-1f4f650b24e6 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:20.956541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e3a2922f-aa2d-43a9-9e68-1f4f650b24e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:20.956764 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05c4e5-9fe7-4d8e-9afa-51896430a1cf None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:21.054635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 458/937] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:21.078056 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2922f-aa2d-43a9-9e68-1f4f650b24e6 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:21.082982 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05c4e5-9fe7-4d8e-9afa-51896430a1cf None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:21.102116 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:21.124943 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac35111-2b1b-4ca1-b179-13742a3c0b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:21.125688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac35111-2b1b-4ca1-b179-13742a3c0b01 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:21.125973 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac35111-2b1b-4ca1-b179-13742a3c0b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:21.126248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac35111-2b1b-4ca1-b179-13742a3c0b01 None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:21.126955 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac35111-2b1b-4ca1-b179-13742a3c0b01 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:21.127261 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac35111-2b1b-4ca1-b179-13742a3c0b01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:21.131008 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac35111-2b1b-4ca1-b179-13742a3c0b01 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:21.141297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 480/938] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Jul 21 08:20:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:21.142362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac35111-2b1b-4ca1-b179-13742a3c0b01 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:21.194002 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:21.198371 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2922f-aa2d-43a9-9e68-1f4f650b24e6 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:21.247935 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31054dc5-de35-47ec-b761-9120f0104e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:21.248931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31054dc5-de35-47ec-b761-9120f0104e2a None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:21.249309 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31054dc5-de35-47ec-b761-9120f0104e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:21.249728 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31054dc5-de35-47ec-b761-9120f0104e2a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:21.250517 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31054dc5-de35-47ec-b761-9120f0104e2a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:21.252046 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31054dc5-de35-47ec-b761-9120f0104e2a None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:21.260453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac35111-2b1b-4ca1-b179-13742a3c0b01 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:21.269766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-31054dc5-de35-47ec-b761-9120f0104e2a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:20:21.269766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:21.269766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:21.269766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:21.269766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:21.269766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:21.269766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:21.269766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:21.269766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:20:21.269766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:21.269766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:21.269766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:21.269766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:21.269766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:21.269766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:21.269766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:21.270921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:21.270921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:21.270921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:21.270921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:21.270921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:21.270921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:21.270921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:21.270921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:21.270921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:21.270921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:21.270921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:21.270921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:21.270921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:21.270921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:21.270921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:21.270921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:21.271846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:21.271846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:21.271846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:21.271846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:21.271846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:21.271846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:21.271846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:21.271846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:21.271846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:21.271846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:21.271846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:21.271846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:21.271846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:21.271846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 08:20:21.271846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:21.272766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 459/939] 10.222.0.57 () {56 vars in 1132 bytes} [Thu Jul 21 08:20:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:21.278843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31054dc5-de35-47ec-b761-9120f0104e2a None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:21.304653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432d37e-33c3-48d0-9288-ca80dc5d35cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:21.305513 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432d37e-33c3-48d0-9288-ca80dc5d35cc None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:21.305946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432d37e-33c3-48d0-9288-ca80dc5d35cc None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:21.306858 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432d37e-33c3-48d0-9288-ca80dc5d35cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:21.307734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432d37e-33c3-48d0-9288-ca80dc5d35cc None admin] RBAC: Adding query filter params (interface=public, service_id=f5ed7cce3b6d4d5799680d39950ec4c6, region_id=RegionOne) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:21.308112 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432d37e-33c3-48d0-9288-ca80dc5d35cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:21.309595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432d37e-33c3-48d0-9288-ca80dc5d35cc None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:21.320993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 481/940] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Jul 21 08:20:21 2022] GET /identity/v3/endpoints?service_id=f5ed7cce3b6d4d5799680d39950ec4c6&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:21.322739 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432d37e-33c3-48d0-9288-ca80dc5d35cc None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:21.379936 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:21.401061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31054dc5-de35-47ec-b761-9120f0104e2a None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:21.436695 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24925b92-62aa-4693-a30a-3eb62e7cd208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:21.438027 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24925b92-62aa-4693-a30a-3eb62e7cd208 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:21.438532 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24925b92-62aa-4693-a30a-3eb62e7cd208 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:21.439072 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24925b92-62aa-4693-a30a-3eb62e7cd208 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:21.440035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24925b92-62aa-4693-a30a-3eb62e7cd208 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:21.440603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24925b92-62aa-4693-a30a-3eb62e7cd208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:21.441456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432d37e-33c3-48d0-9288-ca80dc5d35cc None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:21.442248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24925b92-62aa-4693-a30a-3eb62e7cd208 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:21.452114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:21.454613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 460/941] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 08:20:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:21.460408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24925b92-62aa-4693-a30a-3eb62e7cd208 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:21.483067 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2913ed-6714-4e46-9561-fb99c666c17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:21.483737 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2913ed-6714-4e46-9561-fb99c666c17e None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:21.484022 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2913ed-6714-4e46-9561-fb99c666c17e None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:21.484297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2913ed-6714-4e46-9561-fb99c666c17e None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:21.484994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2913ed-6714-4e46-9561-fb99c666c17e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:21.486445 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2913ed-6714-4e46-9561-fb99c666c17e None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:21.495838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 482/942] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Jul 21 08:20:21 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:20:21.581399 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24925b92-62aa-4693-a30a-3eb62e7cd208 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:21.620080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa54c1-6bc9-445f-ba8c-0f19851a4c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:21.621155 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa54c1-6bc9-445f-ba8c-0f19851a4c3d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:21.621709 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa54c1-6bc9-445f-ba8c-0f19851a4c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:21.622219 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa54c1-6bc9-445f-ba8c-0f19851a4c3d None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:21.623151 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa54c1-6bc9-445f-ba8c-0f19851a4c3d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:21.623687 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa54c1-6bc9-445f-ba8c-0f19851a4c3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:21.625369 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa54c1-6bc9-445f-ba8c-0f19851a4c3d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:21.631725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 461/943] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 08:20:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:21.637964 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2913ed-6714-4e46-9561-fb99c666c17e None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:21.681635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee4c92-89fe-48ba-a0e9-232048bca2eb None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:21.681932 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee4c92-89fe-48ba-a0e9-232048bca2eb None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:21.682205 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee4c92-89fe-48ba-a0e9-232048bca2eb None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:21.683841 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 462/944] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:21.689515 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1c9e3-ae90-4703-b8a7-dd3d73fe1b92 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:21.689868 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1c9e3-ae90-4703-b8a7-dd3d73fe1b92 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:21.690525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1c9e3-ae90-4703-b8a7-dd3d73fe1b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:21.710194 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-5aa1c9e3-ae90-4703-b8a7-dd3d73fe1b92 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:21.711313 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-5aa1c9e3-ae90-4703-b8a7-dd3d73fe1b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:21.715345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:21.774031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2913ed-6714-4e46-9561-fb99c666c17e None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:21.821535 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 463/945] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:20:21.823122 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd6ba1-ad44-46a9-a34d-fb79bb13eefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:21.823777 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd6ba1-ad44-46a9-a34d-fb79bb13eefa None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:21.824061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd6ba1-ad44-46a9-a34d-fb79bb13eefa None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:21.824336 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd6ba1-ad44-46a9-a34d-fb79bb13eefa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:21.825078 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd6ba1-ad44-46a9-a34d-fb79bb13eefa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:21.826482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd6ba1-ad44-46a9-a34d-fb79bb13eefa None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:21.843104 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1c9e3-ae90-4703-b8a7-dd3d73fe1b92 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:21.933704 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 483/946] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Jul 21 08:20:21 2022] POST /identity/v3/endpoints => generated 347 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:20:21.961259 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1c9e3-ae90-4703-b8a7-dd3d73fe1b92 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:22.011228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2df60-a6ec-4ab7-b2a7-b0d4a8c7b55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:22.012311 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2df60-a6ec-4ab7-b2a7-b0d4a8c7b55d None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:22.012854 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2df60-a6ec-4ab7-b2a7-b0d4a8c7b55d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:22.013389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2df60-a6ec-4ab7-b2a7-b0d4a8c7b55d None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:22.014354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2df60-a6ec-4ab7-b2a7-b0d4a8c7b55d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:22.016089 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2df60-a6ec-4ab7-b2a7-b0d4a8c7b55d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:22.017889 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: WARNING keystone.server.flask.common [None req-1af2df60-a6ec-4ab7-b2a7-b0d4a8c7b55d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 08:20:22.023014 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:22.078364 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.sql.core [None req-1af2df60-a6ec-4ab7-b2a7-b0d4a8c7b55d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 08:20:22.078364 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 08:20:22.078364 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [parameters: {'id': '0f2bbfb8a33d405eadf1ecf3b1b61389', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 08:20:22.078364 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80261) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 08:20:22.097086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-1af2df60-a6ec-4ab7-b2a7-b0d4a8c7b55d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0f2bbfb8a33d405eadf1ecf3b1b61389.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0f2bbfb8a33d405eadf1ecf3b1b61389. Jul 21 08:20:22.097086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:22.097086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 08:20:22.097086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 08:20:22.097086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 08:20:22.097086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 08:20:22.097086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 08:20:22.097086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 08:20:22.097086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 08:20:22.097086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application conn.query(q) Jul 21 08:20:22.097086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 08:20:22.097086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 08:20:22.097086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 08:20:22.098051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application result.read() Jul 21 08:20:22.098051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 08:20:22.098051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 08:20:22.098051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 08:20:22.098051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 08:20:22.098051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 08:20:22.098051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 08:20:22.098051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 08:20:22.098051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 08:20:22.098051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 08:20:22.098051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:22.098051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 08:20:22.098051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:22.098051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:22.098051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 08:20:22.098051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 08:20:22.098051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 21 08:20:22.098051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 21 08:20:22.099010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 08:20:22.099010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application next(self.gen) Jul 21 08:20:22.099010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 08:20:22.099010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application yield resource Jul 21 08:20:22.099010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 08:20:22.099010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application next(self.gen) Jul 21 08:20:22.099010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 08:20:22.099010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 08:20:22.099010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 08:20:22.099010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 08:20:22.099010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 08:20:22.099010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise self.value Jul 21 08:20:22.099010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 08:20:22.099010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 08:20:22.099010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 08:20:22.099010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application session.commit() Jul 21 08:20:22.099010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 08:20:22.099909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 08:20:22.099909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 08:20:22.099909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 08:20:22.099909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 08:20:22.099909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self.session.flush() Jul 21 08:20:22.099909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 08:20:22.099909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 08:20:22.099909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 08:20:22.099909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 08:20:22.099909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 08:20:22.099909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application compat.raise_( Jul 21 08:20:22.099909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 08:20:22.099909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception Jul 21 08:20:22.099909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 08:20:22.099909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 08:20:22.099909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 08:20:22.099909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 08:20:22.100808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 08:20:22.100808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 08:20:22.100808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 08:20:22.100808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 08:20:22.100808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 08:20:22.100808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 08:20:22.100808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 08:20:22.100808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 08:20:22.100808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 08:20:22.100808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 08:20:22.100808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 08:20:22.100808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 08:20:22.100808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 08:20:22.100808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 08:20:22.100808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 08:20:22.101917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 08:20:22.101917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 08:20:22.101917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception Jul 21 08:20:22.101917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 08:20:22.101917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 08:20:22.101917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 08:20:22.101917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 08:20:22.101917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 08:20:22.101917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 08:20:22.101917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 08:20:22.101917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application conn.query(q) Jul 21 08:20:22.101917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 08:20:22.101917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 08:20:22.101917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 08:20:22.101917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application result.read() Jul 21 08:20:22.101917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 08:20:22.101917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 08:20:22.102802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 08:20:22.102802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 08:20:22.102802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 08:20:22.102802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 08:20:22.102802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 08:20:22.102802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 08:20:22.102802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 08:20:22.102802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 08:20:22.102802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [parameters: {'id': '0f2bbfb8a33d405eadf1ecf3b1b61389', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 08:20:22.102802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 08:20:22.102802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:22.102802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:22.102802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:22.102802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:22.102802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 21 08:20:22.105501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 21 08:20:22.105501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 08:20:22.105501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 08:20:22.105501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 21 08:20:22.105501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:22.105501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:22.105501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:22.105501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:22.105501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:22.105501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:22.105501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:22.105501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:22.105501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:22.105501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:22.105501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:22.105501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:22.105501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:22.112352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:22.112352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 21 08:20:22.112352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 21 08:20:22.112352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:22.112352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:22.112352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 21 08:20:22.112352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 21 08:20:22.112352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0f2bbfb8a33d405eadf1ecf3b1b61389. Jul 21 08:20:22.112352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:22.112352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 464/947] 10.222.0.57 () {60 vars in 1140 bytes} [Thu Jul 21 08:20:21 2022] POST /identity/v3/projects => generated 262 bytes in 264 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:22.113751 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd6ba1-ad44-46a9-a34d-fb79bb13eefa None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:22.143765 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:22.222357 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd6ba1-ad44-46a9-a34d-fb79bb13eefa None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:22.259272 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec577c8-a7f1-4463-a770-d304af57b40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:22.260446 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec577c8-a7f1-4463-a770-d304af57b40b None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:22.260968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec577c8-a7f1-4463-a770-d304af57b40b None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:22.261455 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec577c8-a7f1-4463-a770-d304af57b40b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:22.268759 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec577c8-a7f1-4463-a770-d304af57b40b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:22.270462 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec577c8-a7f1-4463-a770-d304af57b40b None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:22.285653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-2ec577c8-a7f1-4463-a770-d304af57b40b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:22.285653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:22.285653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:22.285653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:22.285653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:22.285653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:22.285653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:22.285653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:22.285653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:22.285653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:22.285653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:22.285653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:22.285653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:22.285653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:22.285653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:22.286615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:22.286615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:22.286615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:22.286615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:22.286615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:22.286615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:22.286615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:22.286615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:22.286615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:22.286615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:22.286615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:22.286615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:22.286615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:22.286615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:22.286615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:22.286615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:22.286615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:22.287522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:22.287522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:22.287522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:22.287522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:22.287522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:22.287522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:22.287522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:22.287522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:22.290064 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 484/948] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:22.298133 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2df60-a6ec-4ab7-b2a7-b0d4a8c7b55d None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:22.402211 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2df60-a6ec-4ab7-b2a7-b0d4a8c7b55d None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:22.441202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea7093-5aff-4994-b4ce-e453b69a8496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:22.442044 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea7093-5aff-4994-b4ce-e453b69a8496 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:22.442437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea7093-5aff-4994-b4ce-e453b69a8496 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:22.442833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea7093-5aff-4994-b4ce-e453b69a8496 None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:22.443700 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea7093-5aff-4994-b4ce-e453b69a8496 None admin] RBAC: Adding query filter params (name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:22.444110 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea7093-5aff-4994-b4ce-e453b69a8496 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:22.445878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea7093-5aff-4994-b4ce-e453b69a8496 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:22.466857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 465/949] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 08:20:22 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:23.027390 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dcf67-cce6-4542-a3d2-8f19575db661 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:23.027897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dcf67-cce6-4542-a3d2-8f19575db661 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:23.028171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677dcf67-cce6-4542-a3d2-8f19575db661 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:23.030800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 485/950] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:23.037040 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bc291-2339-4a87-bc9e-ecd66c65fdb7 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:23.037504 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bc291-2339-4a87-bc9e-ecd66c65fdb7 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:23.037621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254bc291-2339-4a87-bc9e-ecd66c65fdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:23.055228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-254bc291-2339-4a87-bc9e-ecd66c65fdb7 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:23.057274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-254bc291-2339-4a87-bc9e-ecd66c65fdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:23.104314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:23.124883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 466/951] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:23.148511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677dcf67-cce6-4542-a3d2-8f19575db661 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:23.241908 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:23.261769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677dcf67-cce6-4542-a3d2-8f19575db661 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:23.298413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7207b47-281a-4b33-a472-9ac203c4f61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:23.299467 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7207b47-281a-4b33-a472-9ac203c4f61a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:23.299906 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7207b47-281a-4b33-a472-9ac203c4f61a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:23.300335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7207b47-281a-4b33-a472-9ac203c4f61a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:23.311936 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7207b47-281a-4b33-a472-9ac203c4f61a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:20:23.320134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-f7207b47-281a-4b33-a472-9ac203c4f61a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:20:23.320134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:23.320134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:23.320134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:23.320134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:23.320134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:23.320134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:23.320134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:23.320134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:23.320134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:23.320134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:23.320134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:23.320134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:20:23.320134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:20:23.320134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:20:23.320134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:20:23.321479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:20:23.321479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:20:23.321479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:20:23.321479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:20:23.321479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:23.321479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:23.321479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:23.321479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:23.321479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:23.321479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:23.321479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:23.321479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:23.321479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:23.321479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:23.321479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:23.321479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:23.322730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:23.322730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:23.322730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:23.322730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:23.322730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:20:23.322730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:20:23.322730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:20:23.322730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:20:23.322730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:20:23.322730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:20:23.322730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:20:23.322730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:23.325162 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 486/952] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Jul 21 08:20:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:23.330761 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bc291-2339-4a87-bc9e-ecd66c65fdb7 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:23.429431 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254bc291-2339-4a87-bc9e-ecd66c65fdb7 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:23.463218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a11ff7-c844-42f9-8baf-7b65ca1daf92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:23.463895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a11ff7-c844-42f9-8baf-7b65ca1daf92 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:23.464255 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a11ff7-c844-42f9-8baf-7b65ca1daf92 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:23.464532 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a11ff7-c844-42f9-8baf-7b65ca1daf92 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:23.465284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a11ff7-c844-42f9-8baf-7b65ca1daf92 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:23.465616 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a11ff7-c844-42f9-8baf-7b65ca1daf92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:23.467028 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a11ff7-c844-42f9-8baf-7b65ca1daf92 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:23.475669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 467/953] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Jul 21 08:20:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:23.481808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7207b47-281a-4b33-a472-9ac203c4f61a None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:23.590510 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7207b47-281a-4b33-a472-9ac203c4f61a None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:23.596238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028bd12-671c-418b-9b24-5267cbf2cb73 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:23.596535 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028bd12-671c-418b-9b24-5267cbf2cb73 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:23.596819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028bd12-671c-418b-9b24-5267cbf2cb73 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:23.598230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 468/954] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:23.604333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4291edc-c657-4436-a0f9-8b2744956201 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:23.604625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4291edc-c657-4436-a0f9-8b2744956201 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:23.604907 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4291edc-c657-4436-a0f9-8b2744956201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:23.621435 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-b4291edc-c657-4436-a0f9-8b2744956201 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:23.622688 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b4291edc-c657-4436-a0f9-8b2744956201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:23.627998 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52c0ac-b7bf-48c6-8935-8cd62c4702d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:23.628788 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52c0ac-b7bf-48c6-8935-8cd62c4702d0 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:23.629074 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52c0ac-b7bf-48c6-8935-8cd62c4702d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:23.629351 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52c0ac-b7bf-48c6-8935-8cd62c4702d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:23.641231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52c0ac-b7bf-48c6-8935-8cd62c4702d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:23.642816 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c52c0ac-b7bf-48c6-8935-8cd62c4702d0 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:23.650326 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:23.662624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-1c52c0ac-b7bf-48c6-8935-8cd62c4702d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:23.662624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:23.662624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:23.662624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:23.662624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:23.662624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:23.662624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:23.662624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:23.662624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:23.662624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:23.662624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:23.662624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:23.662624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:23.662624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:23.662624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:23.668320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:23.668320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:23.668320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:23.668320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:23.668320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:23.668320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:23.668320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:23.668320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:23.668320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:23.668320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:23.668320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:23.668320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:23.668320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:23.668320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:23.668320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:23.668320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:23.668320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:23.669347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:23.669347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:23.669347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:23.669347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:23.669347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 487/955] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:23.669695 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:23.670756 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52c0ac-b7bf-48c6-8935-8cd62c4702d0 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:23.707292 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 469/956] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:20:23.726898 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4291edc-c657-4436-a0f9-8b2744956201 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:23.793607 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52c0ac-b7bf-48c6-8935-8cd62c4702d0 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:23.840272 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0d523-a203-4a03-94a7-812ce4868908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:23.840997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0d523-a203-4a03-94a7-812ce4868908 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:23.841222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0d523-a203-4a03-94a7-812ce4868908 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:23.841500 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0d523-a203-4a03-94a7-812ce4868908 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:23.842530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0d523-a203-4a03-94a7-812ce4868908 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:23.842840 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0d523-a203-4a03-94a7-812ce4868908 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:23.844966 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0d523-a203-4a03-94a7-812ce4868908 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:23.853118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4291edc-c657-4436-a0f9-8b2744956201 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:23.861461 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 488/957] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:23.866268 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0d523-a203-4a03-94a7-812ce4868908 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:23.890535 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8494e3-b634-4c54-bff4-13c09dfbacfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:23.891563 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8494e3-b634-4c54-bff4-13c09dfbacfc None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:23.892019 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8494e3-b634-4c54-bff4-13c09dfbacfc None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:23.892443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8494e3-b634-4c54-bff4-13c09dfbacfc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:23.893245 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8494e3-b634-4c54-bff4-13c09dfbacfc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:23.894789 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8494e3-b634-4c54-bff4-13c09dfbacfc None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:23.907678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-fc8494e3-b634-4c54-bff4-13c09dfbacfc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:20:23.907678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:23.907678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:23.907678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:23.907678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:23.907678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:23.907678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:23.907678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:23.907678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:20:23.907678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:23.907678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:23.907678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:23.907678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:23.907678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:23.907678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:23.907678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:23.907678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:23.908957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:23.908957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:23.908957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:23.908957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:23.908957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:23.908957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:23.908957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:23.908957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:23.908957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:23.908957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:23.908957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:23.908957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:23.908957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:23.908957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:23.908957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:23.908957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:23.910066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:23.910066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:23.910066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:23.910066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:23.910066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:23.910066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:23.910066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:23.910066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:23.910066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:23.910066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:23.910066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:23.910066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:23.910066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:20:23.910066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:23.912532 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 470/958] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 08:20:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:23.921254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8494e3-b634-4c54-bff4-13c09dfbacfc None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:23.939823 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:23.973757 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:23.987196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0d523-a203-4a03-94a7-812ce4868908 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:24.024298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92349ac8-48a2-401a-b681-eb9b5388b26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:24.026088 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92349ac8-48a2-401a-b681-eb9b5388b26e None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:24.026550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92349ac8-48a2-401a-b681-eb9b5388b26e None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:24.027146 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92349ac8-48a2-401a-b681-eb9b5388b26e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:24.035251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92349ac8-48a2-401a-b681-eb9b5388b26e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:24.036687 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92349ac8-48a2-401a-b681-eb9b5388b26e None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:24.052105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8494e3-b634-4c54-bff4-13c09dfbacfc None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:24.052563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-92349ac8-48a2-401a-b681-eb9b5388b26e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:20:24.052563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:24.052563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:24.052563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:24.052563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:24.052563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:24.052563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:24.052563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:24.052563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:24.052563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:24.052563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:24.052563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:24.052563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:20:24.052563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:20:24.052563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:20:24.052563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:20:24.053506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:24.053506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:24.053506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:20:24.053506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:24.053506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:20:24.053506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:24.053506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:24.053506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:24.053506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:24.053506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:24.053506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:24.053506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:24.053506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:24.053506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:24.053506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:24.053506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:24.053506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:24.053506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:24.055156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:24.055156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:24.055156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:20:24.055156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:20:24.055156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:20:24.055156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:20:24.055156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:20:24.055156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:20:24.055156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 08:20:24.055156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:24.055156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 489/959] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Jul 21 08:20:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:24.059707 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92349ac8-48a2-401a-b681-eb9b5388b26e None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:24.105626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df4093-1464-4027-b411-ca5b5f370e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:24.105626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df4093-1464-4027-b411-ca5b5f370e4e None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:24.105626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df4093-1464-4027-b411-ca5b5f370e4e None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:24.105626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0df4093-1464-4027-b411-ca5b5f370e4e None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:24.106037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df4093-1464-4027-b411-ca5b5f370e4e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:24.106037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df4093-1464-4027-b411-ca5b5f370e4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:24.106037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0df4093-1464-4027-b411-ca5b5f370e4e None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:24.110397 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 471/960] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Jul 21 08:20:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:24.116079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df4093-1464-4027-b411-ca5b5f370e4e None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:24.185953 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92349ac8-48a2-401a-b681-eb9b5388b26e None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:24.205265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:24.223310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0360b359-0aa7-4c7c-afbb-d60db4ea1aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:24.223984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360b359-0aa7-4c7c-afbb-d60db4ea1aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:24.224307 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360b359-0aa7-4c7c-afbb-d60db4ea1aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:24.224547 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360b359-0aa7-4c7c-afbb-d60db4ea1aa4 None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:24.224896 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0df4093-1464-4027-b411-ca5b5f370e4e None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:24.225438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360b359-0aa7-4c7c-afbb-d60db4ea1aa4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:24.225797 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360b359-0aa7-4c7c-afbb-d60db4ea1aa4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:24.227096 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:24.227512 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0360b359-0aa7-4c7c-afbb-d60db4ea1aa4 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:24.245356 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 490/961] 10.222.0.57 () {56 vars in 1149 bytes} [Thu Jul 21 08:20:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:24.246665 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf68fae-4c05-4799-b207-cb47263589af None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:24.246960 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf68fae-4c05-4799-b207-cb47263589af None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:24.247239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf68fae-4c05-4799-b207-cb47263589af None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:24.248702 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 491/962] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:24.251664 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf68fae-4c05-4799-b207-cb47263589af None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:24.262810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255745f-cd78-42f5-b166-ede3437303dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:24.264761 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255745f-cd78-42f5-b166-ede3437303dd None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:24.264761 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255745f-cd78-42f5-b166-ede3437303dd None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:24.264761 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255745f-cd78-42f5-b166-ede3437303dd None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:24.264761 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255745f-cd78-42f5-b166-ede3437303dd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:24.265115 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255745f-cd78-42f5-b166-ede3437303dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:24.266618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255745f-cd78-42f5-b166-ede3437303dd None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:24.271415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 472/963] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Jul 21 08:20:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:24.275234 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ced6b7-7c19-40c4-ae22-e73a220fa66a None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:24.275521 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ced6b7-7c19-40c4-ae22-e73a220fa66a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:24.275796 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ced6b7-7c19-40c4-ae22-e73a220fa66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:24.293744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-56ced6b7-7c19-40c4-ae22-e73a220fa66a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:24.294938 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-56ced6b7-7c19-40c4-ae22-e73a220fa66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:24.361985 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf68fae-4c05-4799-b207-cb47263589af None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:24.377546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 473/964] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:24.377546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ced6b7-7c19-40c4-ae22-e73a220fa66a None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:24.398368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b33d7-d546-4ea6-a0bd-2ec5123f68c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:24.399014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b33d7-d546-4ea6-a0bd-2ec5123f68c6 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:24.399294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b33d7-d546-4ea6-a0bd-2ec5123f68c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:24.399686 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b33d7-d546-4ea6-a0bd-2ec5123f68c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:24.448117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:24.472138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b33d7-d546-4ea6-a0bd-2ec5123f68c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:24.473631 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b33d7-d546-4ea6-a0bd-2ec5123f68c6 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:24.480062 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:24.485856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ced6b7-7c19-40c4-ae22-e73a220fa66a None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:24.521626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48466a-46cc-4663-b639-23375945864c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:24.522282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48466a-46cc-4663-b639-23375945864c None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:24.522561 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48466a-46cc-4663-b639-23375945864c None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:24.522832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa48466a-46cc-4663-b639-23375945864c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:24.523567 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48466a-46cc-4663-b639-23375945864c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:24.524983 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa48466a-46cc-4663-b639-23375945864c None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:24.583741 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 492/965] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:20:24 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 08:20:24.585721 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b33d7-d546-4ea6-a0bd-2ec5123f68c6 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:24.599413 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 474/966] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Jul 21 08:20:24 2022] POST /identity/v3/endpoints => generated 349 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:20:24.600501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48466a-46cc-4663-b639-23375945864c None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:24.699670 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:24.724567 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b33d7-d546-4ea6-a0bd-2ec5123f68c6 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:24.733154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa48466a-46cc-4663-b639-23375945864c None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:24.768662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1106b-e5b7-498d-a44a-542ad90b1547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:24.769459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1106b-e5b7-498d-a44a-542ad90b1547 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:24.770427 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1106b-e5b7-498d-a44a-542ad90b1547 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:24.770427 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1106b-e5b7-498d-a44a-542ad90b1547 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:24.770964 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1106b-e5b7-498d-a44a-542ad90b1547 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:24.772061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1106b-e5b7-498d-a44a-542ad90b1547 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:24.781624 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab9f4b-2315-44a7-a02b-16627c57ec30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:24.782451 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab9f4b-2315-44a7-a02b-16627c57ec30 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:24.782737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab9f4b-2315-44a7-a02b-16627c57ec30 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:24.783012 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab9f4b-2315-44a7-a02b-16627c57ec30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:24.785289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-00c1106b-e5b7-498d-a44a-542ad90b1547 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:20:24.785289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:24.785289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:24.785289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:24.785289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:24.785289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:24.785289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:24.785289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:24.785289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:20:24.785289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:24.785289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:24.785289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:24.785289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:24.785289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:24.785289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:24.785289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:24.785289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:24.786449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:24.786449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:24.786449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:24.786449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:24.786449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:24.786449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:24.786449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:24.786449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:24.786449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:24.786449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:24.786449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:24.786449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:24.786449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:24.786449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:24.786449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:24.786449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:24.787297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:24.787297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:24.787297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:24.787297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:24.787297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:24.787297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:24.787297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:24.787297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:24.787297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:24.787297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:24.787297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:24.787297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:24.787297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:20:24.787297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:24.788107 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 493/967] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:24.789209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856271a6-abfc-4ece-91e7-1c741baba56e None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:24.789209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856271a6-abfc-4ece-91e7-1c741baba56e None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:24.789460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856271a6-abfc-4ece-91e7-1c741baba56e None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:24.795321 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 494/968] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:24.795321 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856271a6-abfc-4ece-91e7-1c741baba56e None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:24.795564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab9f4b-2315-44a7-a02b-16627c57ec30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:24.795939 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab9f4b-2315-44a7-a02b-16627c57ec30 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:24.806976 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:24.816374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-b5ab9f4b-2315-44a7-a02b-16627c57ec30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:24.816374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:24.816374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:24.816374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:24.816374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:24.816374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:24.816374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:24.816374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:24.816374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:24.816374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:24.816374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:24.816374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:24.816374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:24.816374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:24.816374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:24.820848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:24.820848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:24.820848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:24.820848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:24.820848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:24.820848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:24.820848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:24.820848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:24.820848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:24.820848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:24.820848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:24.820848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:24.820848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:24.820848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:24.820848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:24.820848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:24.820848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:24.821827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:24.821827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:24.821827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:24.821827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:24.821827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 475/969] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:24.821827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425599f-941e-4831-856c-54c211e503be None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:24.821827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425599f-941e-4831-856c-54c211e503be None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:24.821827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425599f-941e-4831-856c-54c211e503be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:24.840421 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-0425599f-941e-4831-856c-54c211e503be None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:24.841653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-0425599f-941e-4831-856c-54c211e503be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:24.910113 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856271a6-abfc-4ece-91e7-1c741baba56e None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:24.916349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 476/970] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:24.917371 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425599f-941e-4831-856c-54c211e503be None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:24.951627 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93126b-7ceb-4a3b-af05-113bdb8d0040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:24.952656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93126b-7ceb-4a3b-af05-113bdb8d0040 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:24.952937 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93126b-7ceb-4a3b-af05-113bdb8d0040 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:24.953215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b93126b-7ceb-4a3b-af05-113bdb8d0040 None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:24.953955 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93126b-7ceb-4a3b-af05-113bdb8d0040 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:24.954262 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93126b-7ceb-4a3b-af05-113bdb8d0040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:24.955632 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b93126b-7ceb-4a3b-af05-113bdb8d0040 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:24.960974 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 495/971] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 08:20:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:24.963407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93126b-7ceb-4a3b-af05-113bdb8d0040 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:24.968761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:25.038620 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425599f-941e-4831-856c-54c211e503be None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:25.074607 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:25.079247 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b93126b-7ceb-4a3b-af05-113bdb8d0040 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:25.082384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8639f-8679-4262-940a-c382de060268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:25.082384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8639f-8679-4262-940a-c382de060268 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:25.082581 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8639f-8679-4262-940a-c382de060268 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:25.082839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8639f-8679-4262-940a-c382de060268 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:25.083562 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8639f-8679-4262-940a-c382de060268 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:25.083864 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8639f-8679-4262-940a-c382de060268 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:25.085226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b8639f-8679-4262-940a-c382de060268 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:25.104563 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 477/972] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:25.104563 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8639f-8679-4262-940a-c382de060268 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:25.128254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22663f11-a621-4cc7-a76b-6b0b5fbc19f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:25.129017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22663f11-a621-4cc7-a76b-6b0b5fbc19f3 None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:25.129368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22663f11-a621-4cc7-a76b-6b0b5fbc19f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:25.129765 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22663f11-a621-4cc7-a76b-6b0b5fbc19f3 None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:25.130546 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22663f11-a621-4cc7-a76b-6b0b5fbc19f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:25.132063 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22663f11-a621-4cc7-a76b-6b0b5fbc19f3 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:25.133569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: WARNING keystone.server.flask.common [None req-22663f11-a621-4cc7-a76b-6b0b5fbc19f3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 08:20:25.204096 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b8639f-8679-4262-940a-c382de060268 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:25.208438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.sql.core [None req-22663f11-a621-4cc7-a76b-6b0b5fbc19f3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 08:20:25.208438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 08:20:25.208438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [parameters: {'user_id': '96e5beaee37b4d0cb722d597c37c254b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 08:20:25.208438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80262) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 08:20:25.215836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-22663f11-a621-4cc7-a76b-6b0b5fbc19f3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 08:20:25.215836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:25.215836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 08:20:25.215836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 08:20:25.215836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 08:20:25.215836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 08:20:25.215836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 08:20:25.215836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 08:20:25.215836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 08:20:25.215836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application conn.query(q) Jul 21 08:20:25.215836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 08:20:25.215836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 08:20:25.215836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 08:20:25.215836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application result.read() Jul 21 08:20:25.215836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 08:20:25.216757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 08:20:25.216757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 08:20:25.216757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 08:20:25.216757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 08:20:25.216757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 08:20:25.216757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 08:20:25.216757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 08:20:25.216757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 08:20:25.216757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:25.216757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 08:20:25.216757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:25.216757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:25.216757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 08:20:25.216757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 08:20:25.216757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 21 08:20:25.216757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 21 08:20:25.216757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 08:20:25.216757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application next(self.gen) Jul 21 08:20:25.217762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 08:20:25.217762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application yield resource Jul 21 08:20:25.217762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 08:20:25.217762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application next(self.gen) Jul 21 08:20:25.217762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 08:20:25.217762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 08:20:25.217762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 08:20:25.217762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 08:20:25.217762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 08:20:25.217762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise self.value Jul 21 08:20:25.217762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 08:20:25.217762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 08:20:25.217762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 08:20:25.217762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application session.commit() Jul 21 08:20:25.217762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 08:20:25.217762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 08:20:25.217762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 08:20:25.218718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 08:20:25.218718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 08:20:25.218718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self.session.flush() Jul 21 08:20:25.218718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 08:20:25.218718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 08:20:25.218718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 08:20:25.218718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 08:20:25.218718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 08:20:25.218718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application compat.raise_( Jul 21 08:20:25.218718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 08:20:25.218718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception Jul 21 08:20:25.218718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 08:20:25.218718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 08:20:25.218718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 08:20:25.218718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 08:20:25.218718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 08:20:25.218718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 08:20:25.219684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 08:20:25.219684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 08:20:25.219684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 21 08:20:25.219684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 21 08:20:25.219684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 08:20:25.219684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 08:20:25.219684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 08:20:25.219684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 08:20:25.219684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 08:20:25.219684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 08:20:25.219684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 08:20:25.219684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 08:20:25.219684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 08:20:25.219684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 08:20:25.219684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 08:20:25.219684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception Jul 21 08:20:25.220722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 08:20:25.220722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 08:20:25.220722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 08:20:25.220722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 08:20:25.220722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 08:20:25.220722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 08:20:25.220722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 08:20:25.220722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application conn.query(q) Jul 21 08:20:25.220722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 08:20:25.220722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 08:20:25.220722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 08:20:25.220722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application result.read() Jul 21 08:20:25.220722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 08:20:25.220722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 08:20:25.220722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 08:20:25.220722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 08:20:25.222662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 08:20:25.222662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 08:20:25.222662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 08:20:25.222662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 08:20:25.222662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 08:20:25.222662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 08:20:25.222662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [parameters: {'user_id': '96e5beaee37b4d0cb722d597c37c254b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 08:20:25.222662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 08:20:25.222662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:25.222662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:25.222662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:25.222662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:25.222662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:25.222662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:25.222662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:25.223781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:25.223781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:25.223781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:25.223781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:25.223781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:25.223781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:25.223781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:25.223781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 21 08:20:25.223781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 21 08:20:25.223781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:25.223781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:25.223781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:20:25.223781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:25.223781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:20:25.223781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:25.223781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 21 08:20:25.223781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 21 08:20:25.224933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 21 08:20:25.224933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 21 08:20:25.224933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 08:20:25.224933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 08:20:25.224933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 08:20:25.224933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:25.224933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 496/973] 10.222.0.57 () {60 vars in 1131 bytes} [Thu Jul 21 08:20:24 2022] POST /identity/v3/users => generated 160 bytes in 255 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:25.224933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22663f11-a621-4cc7-a76b-6b0b5fbc19f3 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:25.251189 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8bba6-d0ff-46ff-8a1f-15a55d1481af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:25.251852 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8bba6-d0ff-46ff-8a1f-15a55d1481af None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:25.252143 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8bba6-d0ff-46ff-8a1f-15a55d1481af None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:25.252413 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8bba6-d0ff-46ff-8a1f-15a55d1481af None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:25.253123 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8bba6-d0ff-46ff-8a1f-15a55d1481af None admin] RBAC: Adding query filter params (type=compute) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:25.253430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8bba6-d0ff-46ff-8a1f-15a55d1481af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:25.254823 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8bba6-d0ff-46ff-8a1f-15a55d1481af None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:25.259652 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 478/974] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 08:20:25 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:25.260362 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8bba6-d0ff-46ff-8a1f-15a55d1481af None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:25.314165 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:25.337105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:25.366288 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22663f11-a621-4cc7-a76b-6b0b5fbc19f3 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:25.401273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8bba6-d0ff-46ff-8a1f-15a55d1481af None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:25.422575 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966a3de-9a13-4d66-93dc-1a847b19fdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:25.423757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966a3de-9a13-4d66-93dc-1a847b19fdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:25.424264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966a3de-9a13-4d66-93dc-1a847b19fdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:25.424739 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966a3de-9a13-4d66-93dc-1a847b19fdc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:25.436345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966a3de-9a13-4d66-93dc-1a847b19fdc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:25.439305 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966a3de-9a13-4d66-93dc-1a847b19fdc1 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:25.446525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753deabd-2404-422d-8f88-990998b34958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:25.447315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753deabd-2404-422d-8f88-990998b34958 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:25.447589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753deabd-2404-422d-8f88-990998b34958 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:25.447857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753deabd-2404-422d-8f88-990998b34958 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:25.457754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-8966a3de-9a13-4d66-93dc-1a847b19fdc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:25.457754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:25.457754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:25.457754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:25.457754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:25.457754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:25.457754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:25.457754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:25.457754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:25.457754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:25.457754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:25.457754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:25.457754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:25.457754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:25.457754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:25.458811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:25.458811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:25.458811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:25.458811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:25.458811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:25.458811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:25.458811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:25.458811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:25.458811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:25.458811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:25.458811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:25.458811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:25.458811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:25.458811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:25.458811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:25.458811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:25.458811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:25.459922 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:25.459922 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:25.459922 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:25.459922 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:25.459922 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:25.459922 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:25.459922 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:25.459922 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:25.460526 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753deabd-2404-422d-8f88-990998b34958 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:25.460526 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753deabd-2404-422d-8f88-990998b34958 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:25.461986 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 497/975] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:25.470576 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966a3de-9a13-4d66-93dc-1a847b19fdc1 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:25.482159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-753deabd-2404-422d-8f88-990998b34958 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:20:25.482159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:25.482159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:25.482159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:25.482159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:25.482159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:25.482159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:25.482159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:25.482159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:25.482159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:25.482159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:25.482159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:25.482159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:20:25.482159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:20:25.482159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:20:25.482159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:20:25.483138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:25.483138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:25.483138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:20:25.483138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:25.483138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:20:25.483138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:25.483138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:25.483138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:25.483138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:25.483138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:25.483138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:25.483138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:25.483138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:25.483138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:25.483138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:25.483138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:25.483138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:25.483138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:25.484097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:25.484097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:25.484097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:20:25.484097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:20:25.484097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:20:25.484097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:20:25.484097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:20:25.484097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:20:25.484097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 08:20:25.484097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:25.486610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 479/976] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:20:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:25.492157 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753deabd-2404-422d-8f88-990998b34958 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:25.592714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966a3de-9a13-4d66-93dc-1a847b19fdc1 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:25.613595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753deabd-2404-422d-8f88-990998b34958 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:25.624084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:25.628737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:25.634851 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea56a8f-0f48-4b53-b710-8cf515fd5124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:25.640512 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea56a8f-0f48-4b53-b710-8cf515fd5124 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:25.640512 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea56a8f-0f48-4b53-b710-8cf515fd5124 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:25.640512 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea56a8f-0f48-4b53-b710-8cf515fd5124 None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:25.640512 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea56a8f-0f48-4b53-b710-8cf515fd5124 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:25.640512 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea56a8f-0f48-4b53-b710-8cf515fd5124 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:25.640512 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea56a8f-0f48-4b53-b710-8cf515fd5124 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:25.653905 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5face2fa-835f-4cb2-b6c4-66109c408639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:25.654714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5face2fa-835f-4cb2-b6c4-66109c408639 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:25.655093 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5face2fa-835f-4cb2-b6c4-66109c408639 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:25.655492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5face2fa-835f-4cb2-b6c4-66109c408639 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:25.656402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5face2fa-835f-4cb2-b6c4-66109c408639 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:25.656805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5face2fa-835f-4cb2-b6c4-66109c408639 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:25.657469 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 498/977] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:20:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:25.662671 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5face2fa-835f-4cb2-b6c4-66109c408639 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:25.663657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea56a8f-0f48-4b53-b710-8cf515fd5124 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:25.705839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 480/978] 10.222.0.57 () {56 vars in 1101 bytes} [Thu Jul 21 08:20:25 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:25.785726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea56a8f-0f48-4b53-b710-8cf515fd5124 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:25.827719 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961cbb1-4be6-4ab4-a92a-e9c1162cf43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:25.828630 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961cbb1-4be6-4ab4-a92a-e9c1162cf43f None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:25.829055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961cbb1-4be6-4ab4-a92a-e9c1162cf43f None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:25.829472 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961cbb1-4be6-4ab4-a92a-e9c1162cf43f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:25.830505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961cbb1-4be6-4ab4-a92a-e9c1162cf43f None admin] RBAC: Adding query filter params (role.id=fca61019937a482aa7bea9176fe21f2a, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=22750d44d710439da1d18a78419b1adf) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:25.830972 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961cbb1-4be6-4ab4-a92a-e9c1162cf43f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:25.832592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961cbb1-4be6-4ab4-a92a-e9c1162cf43f None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:25.845666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 499/979] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:20:25 2022] GET /identity/v3/role_assignments?user.id=22750d44d710439da1d18a78419b1adf&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=fca61019937a482aa7bea9176fe21f2a => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:26.773803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f5cc8-eb55-4d3f-ac2e-612a3965c57b None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:26.774221 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f5cc8-eb55-4d3f-ac2e-612a3965c57b None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:26.774440 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f5cc8-eb55-4d3f-ac2e-612a3965c57b None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:26.775926 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 481/980] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:26.780936 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b14271-f771-4a44-89ef-88f575d79120 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:26.781332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b14271-f771-4a44-89ef-88f575d79120 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:26.781493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b14271-f771-4a44-89ef-88f575d79120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:26.799081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-13b14271-f771-4a44-89ef-88f575d79120 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:26.800588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-13b14271-f771-4a44-89ef-88f575d79120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:26.848016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:26.868936 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 500/981] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:26.891330 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f5cc8-eb55-4d3f-ac2e-612a3965c57b None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:26.992671 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f5cc8-eb55-4d3f-ac2e-612a3965c57b None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:27.027396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca099c9-1502-461c-a292-0bc31701a743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:27.028119 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca099c9-1502-461c-a292-0bc31701a743 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:27.028403 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca099c9-1502-461c-a292-0bc31701a743 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:27.028678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca099c9-1502-461c-a292-0bc31701a743 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:27.029329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca099c9-1502-461c-a292-0bc31701a743 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:27.030726 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca099c9-1502-461c-a292-0bc31701a743 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:27.042814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-dca099c9-1502-461c-a292-0bc31701a743 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:20:27.042814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:27.042814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:27.042814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:27.042814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:27.042814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:27.042814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:27.042814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:27.042814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:20:27.042814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:27.042814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:27.042814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:27.042814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:27.042814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:27.042814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:27.042814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:27.042814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:27.043840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:27.043840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:27.043840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:27.043840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:27.043840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:27.043840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:27.043840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:27.043840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:27.043840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:27.043840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:27.043840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:27.043840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:27.043840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:27.043840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:27.043840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:27.043840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:27.044931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:27.044931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:27.044931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:27.044931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:27.044931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:27.044931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:27.044931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:27.044931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:27.044931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:27.044931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:27.044931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:27.044931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:27.044931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:20:27.044931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:27.044931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 482/982] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 08:20:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:27.050236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b14271-f771-4a44-89ef-88f575d79120 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:27.157018 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b14271-f771-4a44-89ef-88f575d79120 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:27.193558 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a21f3-f5f2-4c4c-a222-f870d031c780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:27.193558 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a21f3-f5f2-4c4c-a222-f870d031c780 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:27.193558 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a21f3-f5f2-4c4c-a222-f870d031c780 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:27.193558 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a21f3-f5f2-4c4c-a222-f870d031c780 None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:27.193939 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a21f3-f5f2-4c4c-a222-f870d031c780 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:27.194040 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a21f3-f5f2-4c4c-a222-f870d031c780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:27.197263 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a21f3-f5f2-4c4c-a222-f870d031c780 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:27.202193 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 501/983] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Jul 21 08:20:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:27.207627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca099c9-1502-461c-a292-0bc31701a743 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:27.242481 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:27.307659 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca099c9-1502-461c-a292-0bc31701a743 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:27.340926 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde2777-1292-4c09-8bfe-10a6683910b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:27.341612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde2777-1292-4c09-8bfe-10a6683910b6 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:27.341900 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde2777-1292-4c09-8bfe-10a6683910b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:27.342176 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde2777-1292-4c09-8bfe-10a6683910b6 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:27.342877 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde2777-1292-4c09-8bfe-10a6683910b6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:27.343186 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde2777-1292-4c09-8bfe-10a6683910b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:27.344548 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde2777-1292-4c09-8bfe-10a6683910b6 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:27.349587 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 483/984] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Jul 21 08:20:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:27.355417 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a21f3-f5f2-4c4c-a222-f870d031c780 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:27.401799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:27.428854 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2392516-463b-40df-848f-db224846e446 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:27.429148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2392516-463b-40df-848f-db224846e446 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:27.429428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2392516-463b-40df-848f-db224846e446 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:27.431565 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 484/985] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:20:27.436396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4b63c-1fba-445e-8669-bea252c8f3e8 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:27.436687 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4b63c-1fba-445e-8669-bea252c8f3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:27.436974 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4b63c-1fba-445e-8669-bea252c8f3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:27.454941 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-e7d4b63c-1fba-445e-8669-bea252c8f3e8 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:27.456090 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a21f3-f5f2-4c4c-a222-f870d031c780 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:27.456201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e7d4b63c-1fba-445e-8669-bea252c8f3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:27.497122 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb8c79-c707-4b0a-b082-2b91426011ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:27.498669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb8c79-c707-4b0a-b082-2b91426011ac None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:27.498951 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb8c79-c707-4b0a-b082-2b91426011ac None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:27.499225 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb8c79-c707-4b0a-b082-2b91426011ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:27.500030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb8c79-c707-4b0a-b082-2b91426011ac None admin] RBAC: Adding query filter params (interface=admin, service_id=f5ed7cce3b6d4d5799680d39950ec4c6, region_id=RegionOne) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:27.500344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb8c79-c707-4b0a-b082-2b91426011ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:27.501732 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb8c79-c707-4b0a-b082-2b91426011ac None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:27.509143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 502/986] 10.222.0.57 () {56 vars in 1249 bytes} [Thu Jul 21 08:20:27 2022] GET /identity/v3/endpoints?service_id=f5ed7cce3b6d4d5799680d39950ec4c6&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:27.514110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb8c79-c707-4b0a-b082-2b91426011ac None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:27.533926 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 485/987] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:20:27.557614 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4b63c-1fba-445e-8669-bea252c8f3e8 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:27.588036 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:27.624019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb8c79-c707-4b0a-b082-2b91426011ac None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:27.637865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:27.663821 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4b63c-1fba-445e-8669-bea252c8f3e8 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:27.664880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72884d-f75f-4d70-96b4-1d96d63b771d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:27.666783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72884d-f75f-4d70-96b4-1d96d63b771d None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:27.666783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72884d-f75f-4d70-96b4-1d96d63b771d None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:27.666783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72884d-f75f-4d70-96b4-1d96d63b771d None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:27.667290 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72884d-f75f-4d70-96b4-1d96d63b771d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:27.668709 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72884d-f75f-4d70-96b4-1d96d63b771d None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:27.676223 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 503/988] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Jul 21 08:20:27 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:20:27.707213 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3014e9-2b60-4c67-8ef7-4a172c08f143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:27.707897 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3014e9-2b60-4c67-8ef7-4a172c08f143 None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:27.708174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3014e9-2b60-4c67-8ef7-4a172c08f143 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:27.708442 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3014e9-2b60-4c67-8ef7-4a172c08f143 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:27.709174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3014e9-2b60-4c67-8ef7-4a172c08f143 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:27.710615 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3014e9-2b60-4c67-8ef7-4a172c08f143 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:27.794431 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 486/989] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 08:20:27 2022] POST /identity/v3/services => generated 242 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:20:27.990729 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a52312-31ca-4bcd-b2f5-4c5e8c9a71a5 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:27.991276 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a52312-31ca-4bcd-b2f5-4c5e8c9a71a5 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:27.991276 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a52312-31ca-4bcd-b2f5-4c5e8c9a71a5 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:27.992927 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 504/990] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:27.998368 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5960afe-b375-4caf-88c7-67dc45a577f2 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:27.998661 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5960afe-b375-4caf-88c7-67dc45a577f2 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:27.998941 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5960afe-b375-4caf-88c7-67dc45a577f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:28.015617 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-a5960afe-b375-4caf-88c7-67dc45a577f2 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:28.016803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a5960afe-b375-4caf-88c7-67dc45a577f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:28.092604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 487/991] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:28.115228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a52312-31ca-4bcd-b2f5-4c5e8c9a71a5 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:28.220683 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a52312-31ca-4bcd-b2f5-4c5e8c9a71a5 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:28.255468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e5245-ff44-4aad-9e02-44c15f85cc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:28.256171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e5245-ff44-4aad-9e02-44c15f85cc0a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:28.256456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e5245-ff44-4aad-9e02-44c15f85cc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:28.256735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e5245-ff44-4aad-9e02-44c15f85cc0a None admin] PATH_INFO: `/v3/services/image` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:28.257384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e5245-ff44-4aad-9e02-44c15f85cc0a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:28.258787 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e5245-ff44-4aad-9e02-44c15f85cc0a None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:28.270316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-d02e5245-ff44-4aad-9e02-44c15f85cc0a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:20:28.270316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:28.270316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:28.270316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:28.270316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:28.270316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:28.270316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:28.270316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:28.270316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:20:28.270316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:28.270316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:28.270316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:28.270316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:28.270316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:28.270316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:28.270316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:28.270316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:28.271300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:28.271300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:28.271300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:28.271300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:28.271300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:28.271300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:28.271300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:28.271300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:28.271300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:28.271300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:28.271300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:28.271300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:28.271300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:28.271300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:28.271300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:28.271300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:28.272154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:28.272154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:28.272154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:28.272154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:28.272154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:28.272154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:28.272154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:28.272154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:28.272154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:28.272154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:28.272154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:28.272154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:28.272154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:20:28.272154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:28.273720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 505/992] 10.222.0.57 () {56 vars in 1105 bytes} [Thu Jul 21 08:20:28 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:28.277393 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5960afe-b375-4caf-88c7-67dc45a577f2 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:28.298848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:28.381210 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5960afe-b375-4caf-88c7-67dc45a577f2 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:28.414501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0524f2-a79e-4dfc-b6a1-3c319e4f8156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:28.415698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0524f2-a79e-4dfc-b6a1-3c319e4f8156 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:28.415983 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0524f2-a79e-4dfc-b6a1-3c319e4f8156 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:28.416259 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0524f2-a79e-4dfc-b6a1-3c319e4f8156 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:28.416963 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0524f2-a79e-4dfc-b6a1-3c319e4f8156 None admin] RBAC: Adding query filter params (name=image) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:28.417270 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0524f2-a79e-4dfc-b6a1-3c319e4f8156 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:28.418670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0524f2-a79e-4dfc-b6a1-3c319e4f8156 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:28.423605 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 488/993] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:28.429362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e5245-ff44-4aad-9e02-44c15f85cc0a None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:28.465132 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:28.530300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e5245-ff44-4aad-9e02-44c15f85cc0a None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:28.563975 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da725c-3077-4617-a5b6-688c0e6b9c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:28.564546 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da725c-3077-4617-a5b6-688c0e6b9c45 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:28.564828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da725c-3077-4617-a5b6-688c0e6b9c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:28.565103 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da725c-3077-4617-a5b6-688c0e6b9c45 None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:28.565827 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da725c-3077-4617-a5b6-688c0e6b9c45 None admin] RBAC: Adding query filter params (type=image) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:28.566132 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da725c-3077-4617-a5b6-688c0e6b9c45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:28.567493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da725c-3077-4617-a5b6-688c0e6b9c45 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:28.577777 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 506/994] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:28 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:29.725930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8920a96-eca1-4898-9126-3f0cf6cc065d None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:29.726707 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8920a96-eca1-4898-9126-3f0cf6cc065d None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:29.726814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8920a96-eca1-4898-9126-3f0cf6cc065d None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:29.728264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 489/995] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:29.733349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41958485-a70a-4670-8316-f39e6cb169b1 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:29.733755 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41958485-a70a-4670-8316-f39e6cb169b1 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:29.733931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41958485-a70a-4670-8316-f39e6cb169b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:29.751580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-41958485-a70a-4670-8316-f39e6cb169b1 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:29.753098 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-41958485-a70a-4670-8316-f39e6cb169b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:29.822268 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 507/996] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:29.845487 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8920a96-eca1-4898-9126-3f0cf6cc065d None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:29.860813 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97176977-dae6-4096-8712-c0549a43724b None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:29.861108 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97176977-dae6-4096-8712-c0549a43724b None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:29.861392 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97176977-dae6-4096-8712-c0549a43724b None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:29.862920 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 508/997] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:20:29.867451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6ac25-d0fd-4ca5-9282-6ac32e7f93bf None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:29.867737 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6ac25-d0fd-4ca5-9282-6ac32e7f93bf None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:29.868012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6ac25-d0fd-4ca5-9282-6ac32e7f93bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:29.885036 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-28d6ac25-d0fd-4ca5-9282-6ac32e7f93bf None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:29.886258 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-28d6ac25-d0fd-4ca5-9282-6ac32e7f93bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:29.911302 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:29.931969 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:29.951762 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8920a96-eca1-4898-9126-3f0cf6cc065d None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:29.957004 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 509/998] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:29 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:20:29.980618 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6ac25-d0fd-4ca5-9282-6ac32e7f93bf None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:29.986684 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc1291-9ca0-48b8-82bd-117315eba0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:29.987481 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc1291-9ca0-48b8-82bd-117315eba0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:29.987780 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc1291-9ca0-48b8-82bd-117315eba0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:29.988039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc1291-9ca0-48b8-82bd-117315eba0c5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:29.988693 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc1291-9ca0-48b8-82bd-117315eba0c5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:29.990129 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc1291-9ca0-48b8-82bd-117315eba0c5 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:30.002332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-e9dc1291-9ca0-48b8-82bd-117315eba0c5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:20:30.002332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:30.002332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:30.002332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:30.002332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:30.002332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:30.002332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:30.002332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:30.002332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:20:30.002332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:30.002332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:30.002332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:30.002332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:30.002332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:30.002332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:30.002332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:30.002332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:30.003333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:30.003333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:30.003333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:30.003333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:30.003333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:30.003333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:30.003333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:30.003333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:30.003333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:30.003333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:30.003333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:30.003333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:30.003333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:30.003333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:30.003333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:30.003333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:30.004804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:30.004804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:30.004804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:30.004804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:30.004804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:30.004804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:30.004804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:30.004804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:30.004804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:30.004804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:30.004804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:30.004804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:30.004804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 08:20:30.004804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:30.004804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 490/999] 10.222.0.57 () {56 vars in 1126 bytes} [Thu Jul 21 08:20:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:30.009959 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc1291-9ca0-48b8-82bd-117315eba0c5 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:30.092359 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6ac25-d0fd-4ca5-9282-6ac32e7f93bf None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:30.116416 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc1291-9ca0-48b8-82bd-117315eba0c5 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:30.129315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58a179-f723-4e83-a80b-524c05b55f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:30.131317 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58a179-f723-4e83-a80b-524c05b55f8b None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:30.131317 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58a179-f723-4e83-a80b-524c05b55f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:30.131317 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58a179-f723-4e83-a80b-524c05b55f8b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:30.131317 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58a179-f723-4e83-a80b-524c05b55f8b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:30.132647 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58a179-f723-4e83-a80b-524c05b55f8b None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:30.144841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-6c58a179-f723-4e83-a80b-524c05b55f8b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:20:30.144841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:30.144841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:30.144841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:30.144841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:30.144841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:30.144841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:30.144841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:30.144841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:20:30.144841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:30.144841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:30.144841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:30.144841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:30.144841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:30.144841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:30.144841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:30.144841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:30.145954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:30.145954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:30.145954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:30.145954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:30.145954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:30.145954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:30.145954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:30.145954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:30.145954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:30.145954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:30.145954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:30.145954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:30.145954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:30.145954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:30.145954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:30.145954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:30.146811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:30.146811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:30.146811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:30.146811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:30.146811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:30.146811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:30.146811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:30.146811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:30.146811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:30.146811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:30.146811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:30.146811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:30.146811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:20:30.146811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:30.146811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 510/1000] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:30.151894 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58a179-f723-4e83-a80b-524c05b55f8b None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:30.159117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1240fe-f0d7-4a07-87f3-2498af58a444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:30.159778 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1240fe-f0d7-4a07-87f3-2498af58a444 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:30.160059 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1240fe-f0d7-4a07-87f3-2498af58a444 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:30.160330 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1240fe-f0d7-4a07-87f3-2498af58a444 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:30.161031 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1240fe-f0d7-4a07-87f3-2498af58a444 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:30.161339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1240fe-f0d7-4a07-87f3-2498af58a444 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:30.162838 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1240fe-f0d7-4a07-87f3-2498af58a444 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:30.168035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 491/1001] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Jul 21 08:20:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:30.173601 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1240fe-f0d7-4a07-87f3-2498af58a444 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:30.178413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:30.185466 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:30.254798 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58a179-f723-4e83-a80b-524c05b55f8b None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:30.280500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1240fe-f0d7-4a07-87f3-2498af58a444 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:30.289278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e03c3-8db0-4505-ac66-b821177186fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:30.290018 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e03c3-8db0-4505-ac66-b821177186fb None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:30.290309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e03c3-8db0-4505-ac66-b821177186fb None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:30.290590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e03c3-8db0-4505-ac66-b821177186fb None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:30.291290 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e03c3-8db0-4505-ac66-b821177186fb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:30.291599 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e03c3-8db0-4505-ac66-b821177186fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:30.292967 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e03c3-8db0-4505-ac66-b821177186fb None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:30.302469 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 511/1002] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 08:20:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:30.303471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e03c3-8db0-4505-ac66-b821177186fb None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:30.317773 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297530b1-c0c9-40c6-ab3e-38c62f447af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:30.318467 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297530b1-c0c9-40c6-ab3e-38c62f447af3 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:30.318721 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297530b1-c0c9-40c6-ab3e-38c62f447af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:30.318992 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297530b1-c0c9-40c6-ab3e-38c62f447af3 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:30.319695 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297530b1-c0c9-40c6-ab3e-38c62f447af3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:30.319999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297530b1-c0c9-40c6-ab3e-38c62f447af3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:30.322160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297530b1-c0c9-40c6-ab3e-38c62f447af3 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:30.327466 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 492/1003] 10.222.0.57 () {56 vars in 1122 bytes} [Thu Jul 21 08:20:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:30.332797 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297530b1-c0c9-40c6-ab3e-38c62f447af3 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:30.393745 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:30.405873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:30.407006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e03c3-8db0-4505-ac66-b821177186fb None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:30.437228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297530b1-c0c9-40c6-ab3e-38c62f447af3 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:30.442547 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a5c76-1d06-42e5-bd6c-b359a8b43f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:30.443231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a5c76-1d06-42e5-bd6c-b359a8b43f9a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:30.443516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a5c76-1d06-42e5-bd6c-b359a8b43f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:30.443786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a5c76-1d06-42e5-bd6c-b359a8b43f9a None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:30.444488 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a5c76-1d06-42e5-bd6c-b359a8b43f9a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:30.444792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a5c76-1d06-42e5-bd6c-b359a8b43f9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:30.446207 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a5c76-1d06-42e5-bd6c-b359a8b43f9a None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:30.452017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 512/1004] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 08:20:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:30.457886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a5c76-1d06-42e5-bd6c-b359a8b43f9a None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:30.473624 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8d114-6c5f-4ed2-85ef-4a90f1cabbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:30.474272 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8d114-6c5f-4ed2-85ef-4a90f1cabbc7 None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:30.474561 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8d114-6c5f-4ed2-85ef-4a90f1cabbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:30.474842 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8d114-6c5f-4ed2-85ef-4a90f1cabbc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:30.475581 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8d114-6c5f-4ed2-85ef-4a90f1cabbc7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:30.477213 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8d114-6c5f-4ed2-85ef-4a90f1cabbc7 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:30.557966 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 493/1005] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Jul 21 08:20:30 2022] POST /identity/v3/endpoints => generated 325 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:20:30.560684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a5c76-1d06-42e5-bd6c-b359a8b43f9a None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:30.607120 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7809201-bb1f-4278-8424-5a89a8d71b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:30.607795 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7809201-bb1f-4278-8424-5a89a8d71b8e None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:30.608088 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7809201-bb1f-4278-8424-5a89a8d71b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:30.608356 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7809201-bb1f-4278-8424-5a89a8d71b8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:30.609163 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7809201-bb1f-4278-8424-5a89a8d71b8e None admin] RBAC: Adding query filter params (interface=public, service_id=f5a08cea340e4073b62371cd4a2ce64d, region_id=RegionOne) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:30.609477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7809201-bb1f-4278-8424-5a89a8d71b8e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:30.610921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7809201-bb1f-4278-8424-5a89a8d71b8e None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:30.614921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce17d77-15f1-4f44-b459-3e9527584d1f None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:30.615252 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce17d77-15f1-4f44-b459-3e9527584d1f None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:30.615521 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce17d77-15f1-4f44-b459-3e9527584d1f None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:30.617136 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 494/1006] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:20:30.622915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 513/1007] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Jul 21 08:20:30 2022] GET /identity/v3/endpoints?service_id=f5a08cea340e4073b62371cd4a2ce64d&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:30.624581 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e537c8f-a906-47ae-b538-3f5cec3d2c02 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:30.624865 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e537c8f-a906-47ae-b538-3f5cec3d2c02 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:30.625140 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e537c8f-a906-47ae-b538-3f5cec3d2c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:30.626581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7809201-bb1f-4278-8424-5a89a8d71b8e None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:30.642622 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-0e537c8f-a906-47ae-b538-3f5cec3d2c02 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:30.643353 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:30.644059 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-0e537c8f-a906-47ae-b538-3f5cec3d2c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:30.725574 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 495/1008] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:30 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:30.735648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7809201-bb1f-4278-8424-5a89a8d71b8e None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:30.745703 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e537c8f-a906-47ae-b538-3f5cec3d2c02 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:30.777303 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd4cd2-ebb7-4bf1-838b-181152a9c513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:30.778079 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd4cd2-ebb7-4bf1-838b-181152a9c513 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:30.778369 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd4cd2-ebb7-4bf1-838b-181152a9c513 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:30.778647 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd4cd2-ebb7-4bf1-838b-181152a9c513 None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:30.779327 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd4cd2-ebb7-4bf1-838b-181152a9c513 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:30.780690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd4cd2-ebb7-4bf1-838b-181152a9c513 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:30.787039 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 514/1009] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Jul 21 08:20:30 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:20:30.813680 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:30.856881 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e537c8f-a906-47ae-b538-3f5cec3d2c02 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:30.894309 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6ae06-db16-4ebd-8804-80e1c0872e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:30.894991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6ae06-db16-4ebd-8804-80e1c0872e02 None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:30.895278 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6ae06-db16-4ebd-8804-80e1c0872e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:30.895554 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6ae06-db16-4ebd-8804-80e1c0872e02 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:30.896291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6ae06-db16-4ebd-8804-80e1c0872e02 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:30.897801 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6ae06-db16-4ebd-8804-80e1c0872e02 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:30.976644 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 496/1010] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 08:20:30 2022] POST /identity/v3/services => generated 242 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:20:32.649451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a0d45-4360-4c89-8d91-70cff04948da None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:32.650016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a0d45-4360-4c89-8d91-70cff04948da None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:32.650096 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a0d45-4360-4c89-8d91-70cff04948da None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:32.651574 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 515/1011] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:32.656648 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89de28-89b9-4b6a-bfab-d25349d103bb None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:32.657091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89de28-89b9-4b6a-bfab-d25349d103bb None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:32.657284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89de28-89b9-4b6a-bfab-d25349d103bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:32.674299 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-ff89de28-89b9-4b6a-bfab-d25349d103bb None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:32.675504 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ff89de28-89b9-4b6a-bfab-d25349d103bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:32.756344 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 497/1012] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:32 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:32.779252 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a0d45-4360-4c89-8d91-70cff04948da None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:32.816256 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309194d-a4d3-43ab-ac83-a51184007dc7 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:32.816569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309194d-a4d3-43ab-ac83-a51184007dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:32.816873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309194d-a4d3-43ab-ac83-a51184007dc7 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:32.818208 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 498/1013] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:32.823128 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42186dd8-3971-4d86-9f89-43122a063523 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:32.823413 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42186dd8-3971-4d86-9f89-43122a063523 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:32.823686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42186dd8-3971-4d86-9f89-43122a063523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:32.840476 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-42186dd8-3971-4d86-9f89-43122a063523 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:32.841698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-42186dd8-3971-4d86-9f89-43122a063523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:32.863998 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:32.887972 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a0d45-4360-4c89-8d91-70cff04948da None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:32.889949 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:32.919875 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 499/1014] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:32 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:20:32.925942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d214d5-dd76-45f8-b73f-31752eaa2a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:32.926736 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d214d5-dd76-45f8-b73f-31752eaa2a79 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:32.927020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d214d5-dd76-45f8-b73f-31752eaa2a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:32.927293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d214d5-dd76-45f8-b73f-31752eaa2a79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:32.928548 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d214d5-dd76-45f8-b73f-31752eaa2a79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:32.930024 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d214d5-dd76-45f8-b73f-31752eaa2a79 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:32.936827 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 516/1015] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:32.938468 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42186dd8-3971-4d86-9f89-43122a063523 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:32.938749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d214d5-dd76-45f8-b73f-31752eaa2a79 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:33.040924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42186dd8-3971-4d86-9f89-43122a063523 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:33.047497 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d214d5-dd76-45f8-b73f-31752eaa2a79 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:33.075118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e150e8-5c33-49e0-86f9-b898ada0df64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:33.075770 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e150e8-5c33-49e0-86f9-b898ada0df64 None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:33.076051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e150e8-5c33-49e0-86f9-b898ada0df64 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:33.076332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e150e8-5c33-49e0-86f9-b898ada0df64 None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:33.077045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e150e8-5c33-49e0-86f9-b898ada0df64 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:33.078504 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e150e8-5c33-49e0-86f9-b898ada0df64 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:33.080926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86617e20-e3cb-4ea5-95e0-68d75c2d5b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:33.081733 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86617e20-e3cb-4ea5-95e0-68d75c2d5b83 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:33.082016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86617e20-e3cb-4ea5-95e0-68d75c2d5b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:33.082283 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86617e20-e3cb-4ea5-95e0-68d75c2d5b83 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:33.082921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86617e20-e3cb-4ea5-95e0-68d75c2d5b83 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:33.084264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86617e20-e3cb-4ea5-95e0-68d75c2d5b83 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:33.096264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-86617e20-e3cb-4ea5-95e0-68d75c2d5b83 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:20:33.096264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:33.096264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:33.096264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:33.096264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:33.096264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:33.096264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:33.096264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:33.096264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:20:33.096264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:33.096264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:33.096264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:33.096264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:33.096264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:33.096264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:33.096264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:33.096264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:33.097468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:33.097468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:33.097468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:33.097468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:33.097468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:33.097468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:33.097468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:33.097468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:33.097468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:33.097468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:33.097468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:33.097468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:33.097468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:33.097468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:33.097468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:33.097468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:33.098580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:33.098580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:33.098580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:33.098580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:33.098580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:33.098580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:33.098580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:33.098580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:33.098580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:33.098580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:33.098580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:33.098580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:33.098580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 08:20:33.098580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:33.098580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 517/1016] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:33.099398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5fb46-5fe8-41b9-b297-215ada191903 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:33.099398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5fb46-5fe8-41b9-b297-215ada191903 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:33.099398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5fb46-5fe8-41b9-b297-215ada191903 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:33.100387 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 518/1017] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:33.104071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5fb46-5fe8-41b9-b297-215ada191903 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:33.115332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:33.194267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 500/1018] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 08:20:32 2022] POST /identity/v3/projects => generated 311 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:20:33.195859 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a81b52-3e15-4e3c-89ea-8671c16da65a None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:33.196128 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a81b52-3e15-4e3c-89ea-8671c16da65a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:33.196419 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a81b52-3e15-4e3c-89ea-8671c16da65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:33.214368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5fb46-5fe8-41b9-b297-215ada191903 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:33.215638 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-87a81b52-3e15-4e3c-89ea-8671c16da65a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:33.216807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-87a81b52-3e15-4e3c-89ea-8671c16da65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:33.243810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:33.259027 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a819c1-0916-44f0-8fdb-0afa6c7ae78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:33.259718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a819c1-0916-44f0-8fdb-0afa6c7ae78d None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:33.260005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a819c1-0916-44f0-8fdb-0afa6c7ae78d None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:33.260284 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a819c1-0916-44f0-8fdb-0afa6c7ae78d None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:33.261061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a819c1-0916-44f0-8fdb-0afa6c7ae78d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:33.261378 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a819c1-0916-44f0-8fdb-0afa6c7ae78d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:33.262825 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a819c1-0916-44f0-8fdb-0afa6c7ae78d None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:33.273609 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 519/1019] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 08:20:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:33.275607 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a819c1-0916-44f0-8fdb-0afa6c7ae78d None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:33.293194 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 501/1020] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:33 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:33.316331 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a81b52-3e15-4e3c-89ea-8671c16da65a None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:33.360448 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:33.398089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a819c1-0916-44f0-8fdb-0afa6c7ae78d None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:33.433314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a81b52-3e15-4e3c-89ea-8671c16da65a None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:33.440710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16824d-050a-493a-954c-0a5d3b79a90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:33.441623 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16824d-050a-493a-954c-0a5d3b79a90b None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:33.441913 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16824d-050a-493a-954c-0a5d3b79a90b None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:33.442193 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16824d-050a-493a-954c-0a5d3b79a90b None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:33.442897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16824d-050a-493a-954c-0a5d3b79a90b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:33.443317 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16824d-050a-493a-954c-0a5d3b79a90b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:33.444746 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16824d-050a-493a-954c-0a5d3b79a90b None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:33.450321 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 520/1021] 10.222.0.57 () {56 vars in 1112 bytes} [Thu Jul 21 08:20:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:33.456086 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16824d-050a-493a-954c-0a5d3b79a90b None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:33.480216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874a97f-9823-412a-81b2-e6f9543ec4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:33.483166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874a97f-9823-412a-81b2-e6f9543ec4eb None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:33.483166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874a97f-9823-412a-81b2-e6f9543ec4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:33.483166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874a97f-9823-412a-81b2-e6f9543ec4eb None admin] PATH_INFO: `/v3/services/image` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:33.483166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874a97f-9823-412a-81b2-e6f9543ec4eb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:33.483710 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874a97f-9823-412a-81b2-e6f9543ec4eb None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:33.497152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-4874a97f-9823-412a-81b2-e6f9543ec4eb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:20:33.497152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:33.497152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:33.497152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:33.497152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:33.497152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:33.497152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:33.497152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:33.497152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:20:33.497152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:33.497152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:33.497152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:33.497152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:33.497152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:33.497152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:33.497152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:33.497152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:33.498546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:33.498546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:33.498546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:33.498546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:33.498546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:33.498546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:33.498546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:33.498546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:33.498546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:33.498546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:33.498546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:33.498546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:33.498546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:33.498546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:33.498546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:33.498546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:33.499450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:33.499450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:33.499450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:33.499450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:33.499450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:33.499450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:33.499450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:33.499450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:33.499450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:33.499450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:33.499450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:33.499450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:33.499450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:20:33.499450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:33.501265 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 502/1022] 10.222.0.57 () {56 vars in 1105 bytes} [Thu Jul 21 08:20:33 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:33.504295 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874a97f-9823-412a-81b2-e6f9543ec4eb None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:33.532392 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:33.565113 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16824d-050a-493a-954c-0a5d3b79a90b None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:33.604379 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b3dc6-7f2b-4555-a224-715796277e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:33.605337 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b3dc6-7f2b-4555-a224-715796277e27 None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:33.605830 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b3dc6-7f2b-4555-a224-715796277e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:33.606378 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b3dc6-7f2b-4555-a224-715796277e27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:33.607505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b3dc6-7f2b-4555-a224-715796277e27 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:33.609184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b3dc6-7f2b-4555-a224-715796277e27 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:33.612340 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874a97f-9823-412a-81b2-e6f9543ec4eb None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:33.614302 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:33.645914 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3da0f-bb05-447d-8354-b3fec09b3460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:33.646575 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3da0f-bb05-447d-8354-b3fec09b3460 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:33.646858 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3da0f-bb05-447d-8354-b3fec09b3460 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:33.647146 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3da0f-bb05-447d-8354-b3fec09b3460 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:33.647837 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3da0f-bb05-447d-8354-b3fec09b3460 None admin] RBAC: Adding query filter params (name=image) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:33.648176 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3da0f-bb05-447d-8354-b3fec09b3460 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:33.650126 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3da0f-bb05-447d-8354-b3fec09b3460 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:33.655041 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 503/1023] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:33.660509 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3da0f-bb05-447d-8354-b3fec09b3460 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:33.677945 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 521/1024] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Jul 21 08:20:33 2022] POST /identity/v3/endpoints => generated 334 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:20:33.761418 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:33.775281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3da0f-bb05-447d-8354-b3fec09b3460 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:33.818115 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1602ed-f7c7-4857-96c2-e83dc641ff4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:33.818790 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1602ed-f7c7-4857-96c2-e83dc641ff4f None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:33.819077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1602ed-f7c7-4857-96c2-e83dc641ff4f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:33.819349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1602ed-f7c7-4857-96c2-e83dc641ff4f None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:33.820059 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1602ed-f7c7-4857-96c2-e83dc641ff4f None admin] RBAC: Adding query filter params (type=image) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:33.820363 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1602ed-f7c7-4857-96c2-e83dc641ff4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:33.822354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1602ed-f7c7-4857-96c2-e83dc641ff4f None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:33.827841 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 504/1025] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:33.833951 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b3dc6-7f2b-4555-a224-715796277e27 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:33.941228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b3dc6-7f2b-4555-a224-715796277e27 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:33.978519 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1c400-f76d-4c11-a925-6a26f5c2a685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:33.979540 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1c400-f76d-4c11-a925-6a26f5c2a685 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:33.980045 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1c400-f76d-4c11-a925-6a26f5c2a685 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:33.980521 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1c400-f76d-4c11-a925-6a26f5c2a685 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:33.981545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1c400-f76d-4c11-a925-6a26f5c2a685 None admin] RBAC: Adding query filter params (interface=public, service_id=1418933498744452bb0fa1ec4042a159, region_id=RegionOne) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:33.982073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1c400-f76d-4c11-a925-6a26f5c2a685 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:33.983647 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1c400-f76d-4c11-a925-6a26f5c2a685 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:33.989478 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 522/1026] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Jul 21 08:20:33 2022] GET /identity/v3/endpoints?service_id=1418933498744452bb0fa1ec4042a159&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:33.995548 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1602ed-f7c7-4857-96c2-e83dc641ff4f None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:34.098190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1602ed-f7c7-4857-96c2-e83dc641ff4f None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:34.131884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4f12c-0a5c-4bb5-8df0-874b69be48b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:34.132543 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4f12c-0a5c-4bb5-8df0-874b69be48b8 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:34.132826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4f12c-0a5c-4bb5-8df0-874b69be48b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:34.133103 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4f12c-0a5c-4bb5-8df0-874b69be48b8 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:34.134414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4f12c-0a5c-4bb5-8df0-874b69be48b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:34.135771 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4f12c-0a5c-4bb5-8df0-874b69be48b8 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:34.142588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 505/1027] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Jul 21 08:20:33 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:20:35.265022 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6ec89-4167-4aa9-9fa9-0850344bc80a None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:35.265779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6ec89-4167-4aa9-9fa9-0850344bc80a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:35.265779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6ec89-4167-4aa9-9fa9-0850344bc80a None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:35.266987 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 523/1028] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:35.272198 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3f3bc-7919-4d16-b3fd-bcfc424403fa None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:35.272579 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3f3bc-7919-4d16-b3fd-bcfc424403fa None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:35.272756 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3f3bc-7919-4d16-b3fd-bcfc424403fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:35.289945 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-4df3f3bc-7919-4d16-b3fd-bcfc424403fa None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:35.291107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-4df3f3bc-7919-4d16-b3fd-bcfc424403fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:35.298326 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:35.361810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 506/1029] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:35.387237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6ec89-4167-4aa9-9fa9-0850344bc80a None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:35.446651 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:35.491503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6ec89-4167-4aa9-9fa9-0850344bc80a None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:35.526153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb22d4-e050-4203-88d3-d5028f4295fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:35.526863 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb22d4-e050-4203-88d3-d5028f4295fd None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:35.527144 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb22d4-e050-4203-88d3-d5028f4295fd None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:35.527415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb22d4-e050-4203-88d3-d5028f4295fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:35.528579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb22d4-e050-4203-88d3-d5028f4295fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:35.530036 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb22d4-e050-4203-88d3-d5028f4295fd None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:35.531848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 524/1030] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:35.537363 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3f3bc-7919-4d16-b3fd-bcfc424403fa None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:35.638751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3f3bc-7919-4d16-b3fd-bcfc424403fa None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:35.672590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8a5a9-7294-4811-a770-11952595f303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:35.673247 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8a5a9-7294-4811-a770-11952595f303 None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:35.673601 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8a5a9-7294-4811-a770-11952595f303 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:35.673973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8a5a9-7294-4811-a770-11952595f303 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:35.674691 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8a5a9-7294-4811-a770-11952595f303 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:35.676138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8a5a9-7294-4811-a770-11952595f303 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:35.782371 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:35.788657 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 507/1031] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 08:20:35 2022] POST /identity/v3/users => generated 285 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:20:35.834931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b88127-d6be-4618-bc96-1abe92b0a336 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:35.835278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b88127-d6be-4618-bc96-1abe92b0a336 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:35.835487 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b88127-d6be-4618-bc96-1abe92b0a336 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:35.837075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 525/1032] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:35.842991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a972f9-6a26-482d-83d1-e75b009d1f6f None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:35.843338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a972f9-6a26-482d-83d1-e75b009d1f6f None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:35.843565 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a972f9-6a26-482d-83d1-e75b009d1f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:35.862292 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-65a972f9-6a26-482d-83d1-e75b009d1f6f None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:35.863508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-65a972f9-6a26-482d-83d1-e75b009d1f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:35.939906 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 508/1033] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:35.962627 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b88127-d6be-4618-bc96-1abe92b0a336 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:36.069262 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b88127-d6be-4618-bc96-1abe92b0a336 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:36.092738 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:36.104083 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd6ce1-d970-40e4-9820-8e3d07453ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:36.121711 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd6ce1-d970-40e4-9820-8e3d07453ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:36.121711 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd6ce1-d970-40e4-9820-8e3d07453ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:36.121711 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd6ce1-d970-40e4-9820-8e3d07453ec6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:36.121711 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd6ce1-d970-40e4-9820-8e3d07453ec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:20:36.124239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-08fd6ce1-d970-40e4-9820-8e3d07453ec6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:20:36.124239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:36.124239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:36.124239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:36.124239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:36.124239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:36.124239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:36.124239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:36.124239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:36.124239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:36.124239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:36.124239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:36.124239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:20:36.124239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:20:36.124239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:20:36.124239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:20:36.125164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:20:36.125164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:20:36.125164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:20:36.125164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:20:36.125164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:36.125164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:36.125164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:36.125164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:36.125164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:36.125164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:36.125164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:36.125164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:36.125164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:36.125164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:36.125164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:36.125164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:36.126486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:36.126486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:36.126486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:36.126486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:36.126486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:20:36.126486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:20:36.126486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:20:36.126486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:20:36.126486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:20:36.126486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:20:36.126486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:20:36.126486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:36.126486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 526/1034] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Jul 21 08:20:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:36.131516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a972f9-6a26-482d-83d1-e75b009d1f6f None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:36.170724 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecfd02-ad91-4033-8f6b-d3806750bc80 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:36.171072 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecfd02-ad91-4033-8f6b-d3806750bc80 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:36.171280 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecfd02-ad91-4033-8f6b-d3806750bc80 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:36.172792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 527/1035] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:20:36.177670 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d683d58-8ee1-44b7-a761-2d445b4ab717 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:36.177960 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d683d58-8ee1-44b7-a761-2d445b4ab717 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:36.178239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d683d58-8ee1-44b7-a761-2d445b4ab717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:36.195474 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-7d683d58-8ee1-44b7-a761-2d445b4ab717 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:36.197288 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-7d683d58-8ee1-44b7-a761-2d445b4ab717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:36.238139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a972f9-6a26-482d-83d1-e75b009d1f6f None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:36.268777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:36.273712 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 528/1036] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:20:36.276621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e45bd-62ae-4173-81f2-6f82bc28fa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:36.277277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e45bd-62ae-4173-81f2-6f82bc28fa75 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:36.277693 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e45bd-62ae-4173-81f2-6f82bc28fa75 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:36.282734 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e45bd-62ae-4173-81f2-6f82bc28fa75 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:36.282734 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e45bd-62ae-4173-81f2-6f82bc28fa75 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:36.282734 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e45bd-62ae-4173-81f2-6f82bc28fa75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:36.282734 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e45bd-62ae-4173-81f2-6f82bc28fa75 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:36.288315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 509/1037] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Jul 21 08:20:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:36.293059 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d683d58-8ee1-44b7-a761-2d445b4ab717 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:36.293826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e45bd-62ae-4173-81f2-6f82bc28fa75 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:36.401739 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d683d58-8ee1-44b7-a761-2d445b4ab717 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:36.405987 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e45bd-62ae-4173-81f2-6f82bc28fa75 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:36.418375 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:36.439432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a38299-220b-4b54-b15d-086d3c535c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:36.440222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a38299-220b-4b54-b15d-086d3c535c43 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:36.440509 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a38299-220b-4b54-b15d-086d3c535c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:36.440788 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a38299-220b-4b54-b15d-086d3c535c43 None admin] PATH_INFO: `/v3/services/image` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:36.441043 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f1e8e-d91e-4b75-8ef1-ced06e52411e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:36.441433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a38299-220b-4b54-b15d-086d3c535c43 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:36.441921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f1e8e-d91e-4b75-8ef1-ced06e52411e None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:36.442206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f1e8e-d91e-4b75-8ef1-ced06e52411e None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:36.442482 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f1e8e-d91e-4b75-8ef1-ced06e52411e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:36.442826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a38299-220b-4b54-b15d-086d3c535c43 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:36.455197 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f1e8e-d91e-4b75-8ef1-ced06e52411e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:36.456630 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f1e8e-d91e-4b75-8ef1-ced06e52411e None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:36.458182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-21a38299-220b-4b54-b15d-086d3c535c43 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:20:36.458182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:36.458182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:20:36.458182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:20:36.458182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:20:36.458182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:20:36.458182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:20:36.458182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:36.458182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:20:36.458182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:36.458182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:20:36.458182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:36.458182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:36.458182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:36.458182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:36.458182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:36.458182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:36.459383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:36.459383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:36.459383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:36.459383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:36.459383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:36.459383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:36.459383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:20:36.459383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:20:36.459383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:20:36.459383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:20:36.459383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:36.459383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:36.459383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:36.459383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:36.459383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:36.459383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:36.460249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:36.460249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:36.460249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:36.460249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:36.460249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:36.460249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:36.460249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:36.460249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:36.460249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:36.460249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:36.460249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:20:36.460249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:20:36.460249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 08:20:36.460249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:36.460249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 529/1038] 10.222.0.57 () {56 vars in 1105 bytes} [Thu Jul 21 08:20:36 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:36.466846 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a38299-220b-4b54-b15d-086d3c535c43 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:36.477874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-342f1e8e-d91e-4b75-8ef1-ced06e52411e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:36.477874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:36.477874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:36.477874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:36.477874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:36.477874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:36.477874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:36.477874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:36.477874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:36.477874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:36.477874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:36.477874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:36.477874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:36.477874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:36.477874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:36.478763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:36.478763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:36.478763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:36.478763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:36.478763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:36.478763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:36.478763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:36.478763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:36.478763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:36.478763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:36.478763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:36.478763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:36.478763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:36.478763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:36.478763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:36.478763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:36.478763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:36.479653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:36.479653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:36.479653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:36.479653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:36.482121 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 510/1039] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:36.484477 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f1e8e-d91e-4b75-8ef1-ced06e52411e None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:36.530064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:36.580689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a38299-220b-4b54-b15d-086d3c535c43 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:36.590252 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f1e8e-d91e-4b75-8ef1-ced06e52411e None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:36.616803 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b0ac3-9f79-49e6-93c2-8404d37a3b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:36.617680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b0ac3-9f79-49e6-93c2-8404d37a3b61 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:36.618557 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b0ac3-9f79-49e6-93c2-8404d37a3b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:36.618981 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b0ac3-9f79-49e6-93c2-8404d37a3b61 None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:36.619686 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b0ac3-9f79-49e6-93c2-8404d37a3b61 None admin] RBAC: Adding query filter params (name=image) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:36.619998 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b0ac3-9f79-49e6-93c2-8404d37a3b61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:36.621561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b0ac3-9f79-49e6-93c2-8404d37a3b61 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:36.631473 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 530/1040] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:36.632405 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b0ac3-9f79-49e6-93c2-8404d37a3b61 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:36.633361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fe7cf-809f-4e46-ac4d-ba384afa1283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:36.634111 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fe7cf-809f-4e46-ac4d-ba384afa1283 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:36.634401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fe7cf-809f-4e46-ac4d-ba384afa1283 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:36.634674 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8fe7cf-809f-4e46-ac4d-ba384afa1283 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:36.635408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fe7cf-809f-4e46-ac4d-ba384afa1283 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:36.635718 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fe7cf-809f-4e46-ac4d-ba384afa1283 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:36.637407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8fe7cf-809f-4e46-ac4d-ba384afa1283 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:36.657077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 511/1041] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:36.662443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fe7cf-809f-4e46-ac4d-ba384afa1283 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:36.690875 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:36.750823 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b0ac3-9f79-49e6-93c2-8404d37a3b61 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:36.771606 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8fe7cf-809f-4e46-ac4d-ba384afa1283 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:36.773365 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:36.786210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f54d3a-90a2-4ab5-b9a1-00e11bd25bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:36.786904 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f54d3a-90a2-4ab5-b9a1-00e11bd25bef None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:36.787193 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f54d3a-90a2-4ab5-b9a1-00e11bd25bef None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:36.787469 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f54d3a-90a2-4ab5-b9a1-00e11bd25bef None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:36.788159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f54d3a-90a2-4ab5-b9a1-00e11bd25bef None admin] RBAC: Adding query filter params (type=image) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:36.788466 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f54d3a-90a2-4ab5-b9a1-00e11bd25bef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:36.790370 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f54d3a-90a2-4ab5-b9a1-00e11bd25bef None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:36.795436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 531/1042] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:36.800942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f54d3a-90a2-4ab5-b9a1-00e11bd25bef None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:36.813320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec71ea-937d-4d74-b0f3-42caff54ef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:36.814133 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec71ea-937d-4d74-b0f3-42caff54ef63 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:36.814417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec71ea-937d-4d74-b0f3-42caff54ef63 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:36.814693 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec71ea-937d-4d74-b0f3-42caff54ef63 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:36.822364 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec71ea-937d-4d74-b0f3-42caff54ef63 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:36.823796 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec71ea-937d-4d74-b0f3-42caff54ef63 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:36.839463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-8eec71ea-937d-4d74-b0f3-42caff54ef63 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:20:36.839463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:36.839463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:36.839463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:36.839463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:36.839463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:36.839463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:36.839463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:36.839463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:36.839463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:36.839463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:36.839463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:36.839463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:20:36.839463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:20:36.839463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:20:36.839463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:20:36.840437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:36.840437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:36.840437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:20:36.840437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:36.840437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:20:36.840437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:36.840437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:36.840437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:36.840437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:36.840437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:36.840437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:36.840437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:36.840437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:36.840437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:36.840437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:36.840437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:36.840437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:36.840437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:36.841397 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:36.841397 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:36.841397 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:20:36.841397 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:20:36.841397 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:20:36.841397 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:20:36.841397 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:20:36.841397 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:20:36.841397 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:20:36.841397 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:36.841397 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 512/1043] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Jul 21 08:20:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:36.846163 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec71ea-937d-4d74-b0f3-42caff54ef63 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:36.905711 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f54d3a-90a2-4ab5-b9a1-00e11bd25bef None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:36.912654 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:36.945492 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa289e-fb59-430e-81dc-a492eb780e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:36.946652 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa289e-fb59-430e-81dc-a492eb780e96 None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:36.947132 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa289e-fb59-430e-81dc-a492eb780e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:36.947756 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa289e-fb59-430e-81dc-a492eb780e96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:36.948849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa289e-fb59-430e-81dc-a492eb780e96 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:36.950242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa289e-fb59-430e-81dc-a492eb780e96 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:36.959860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec71ea-937d-4d74-b0f3-42caff54ef63 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:36.997770 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79558f1-be0c-46f0-ba97-e75c953da059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:36.998451 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79558f1-be0c-46f0-ba97-e75c953da059 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:36.998733 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79558f1-be0c-46f0-ba97-e75c953da059 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:36.999009 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79558f1-be0c-46f0-ba97-e75c953da059 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:36.999869 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79558f1-be0c-46f0-ba97-e75c953da059 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:37.000179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79558f1-be0c-46f0-ba97-e75c953da059 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:37.001667 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79558f1-be0c-46f0-ba97-e75c953da059 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:37.020086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 513/1044] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Jul 21 08:20:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:37.026217 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79558f1-be0c-46f0-ba97-e75c953da059 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:37.049785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 532/1045] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Jul 21 08:20:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:20:37.050394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:37.136926 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79558f1-be0c-46f0-ba97-e75c953da059 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:37.181685 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6031a3f-3fe0-49e5-8b8c-6189af4ded1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:37.182252 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6031a3f-3fe0-49e5-8b8c-6189af4ded1f None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:37.182533 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6031a3f-3fe0-49e5-8b8c-6189af4ded1f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:37.182807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6031a3f-3fe0-49e5-8b8c-6189af4ded1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:37.256437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6031a3f-3fe0-49e5-8b8c-6189af4ded1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:37.257935 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6031a3f-3fe0-49e5-8b8c-6189af4ded1f None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:37.274700 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:37.357192 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 514/1046] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:20:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 08:20:37.362682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa289e-fb59-430e-81dc-a492eb780e96 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:37.466379 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa289e-fb59-430e-81dc-a492eb780e96 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:37.499921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a4383-8b25-41fd-b9fb-72ef8343430d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:37.500718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a4383-8b25-41fd-b9fb-72ef8343430d None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:37.500996 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a4383-8b25-41fd-b9fb-72ef8343430d None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:37.501265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a4383-8b25-41fd-b9fb-72ef8343430d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:37.513016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a4383-8b25-41fd-b9fb-72ef8343430d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:37.514487 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a4383-8b25-41fd-b9fb-72ef8343430d None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:37.533667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-7e5a4383-8b25-41fd-b9fb-72ef8343430d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:37.533667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:37.533667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:37.533667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:37.533667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:37.533667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:37.533667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:37.533667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:37.533667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:37.533667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:37.533667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:37.533667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:37.533667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:37.533667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:37.533667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:37.534639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:37.534639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:37.534639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:37.534639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:37.534639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:37.534639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:37.534639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:37.534639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:37.534639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:37.534639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:37.534639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:37.534639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:37.534639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:37.534639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:37.534639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:37.534639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:37.534639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:37.535574 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:37.535574 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:37.535574 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:37.535574 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:37.537840 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 533/1047] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:37.540564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6031a3f-3fe0-49e5-8b8c-6189af4ded1f None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:37.645666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6031a3f-3fe0-49e5-8b8c-6189af4ded1f None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:37.662399 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:37.680745 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d80750-a483-4584-b91e-a74979900207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:37.681460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d80750-a483-4584-b91e-a74979900207 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:37.681963 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d80750-a483-4584-b91e-a74979900207 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:37.682243 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d80750-a483-4584-b91e-a74979900207 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:37.682969 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d80750-a483-4584-b91e-a74979900207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:37.683277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d80750-a483-4584-b91e-a74979900207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:37.684640 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d80750-a483-4584-b91e-a74979900207 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:37.700434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 515/1048] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:37.701938 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a4383-8b25-41fd-b9fb-72ef8343430d None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:37.720874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:37.816408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a4383-8b25-41fd-b9fb-72ef8343430d None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:37.851931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab2638-4368-43ae-a45c-5c473463aa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:37.853266 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab2638-4368-43ae-a45c-5c473463aa6a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:37.853569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab2638-4368-43ae-a45c-5c473463aa6a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:37.853847 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab2638-4368-43ae-a45c-5c473463aa6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:37.860506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab2638-4368-43ae-a45c-5c473463aa6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:37.861975 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab2638-4368-43ae-a45c-5c473463aa6a None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:37.876954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-65ab2638-4368-43ae-a45c-5c473463aa6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:37.876954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:37.876954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:37.876954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:37.876954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:37.876954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:37.876954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:37.876954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:37.876954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:37.876954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:37.876954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:37.876954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:37.876954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:37.876954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:37.876954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:37.877919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:37.877919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:37.877919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:37.877919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:37.877919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:37.877919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:37.877919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:37.877919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:37.877919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:37.877919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:37.877919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:37.877919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:37.877919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:37.877919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:37.877919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:37.877919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:37.877919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:37.878845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:37.878845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:37.878845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:37.878845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:37.878845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:37.878845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:37.878845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:37.878845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:37.881840 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 534/1049] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:37.883886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d80750-a483-4584-b91e-a74979900207 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:37.992856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d80750-a483-4584-b91e-a74979900207 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:37.993812 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b08673-267e-47c4-a932-6084bf580333 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:37.994105 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b08673-267e-47c4-a932-6084bf580333 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:37.994404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b08673-267e-47c4-a932-6084bf580333 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:37.996127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 535/1050] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:38.001726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fce89-dcdd-4791-aae8-c32ec72137fa None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:38.002256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fce89-dcdd-4791-aae8-c32ec72137fa None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:38.002821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fce89-dcdd-4791-aae8-c32ec72137fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:38.021690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-5c0fce89-dcdd-4791-aae8-c32ec72137fa None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:38.022890 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5c0fce89-dcdd-4791-aae8-c32ec72137fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:38.031827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d7652-cf3d-4fd7-b5cf-4b814a1f69a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:38.032418 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d7652-cf3d-4fd7-b5cf-4b814a1f69a0 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:38.032700 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d7652-cf3d-4fd7-b5cf-4b814a1f69a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:38.032971 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d7652-cf3d-4fd7-b5cf-4b814a1f69a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:38.033783 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d7652-cf3d-4fd7-b5cf-4b814a1f69a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:38.034286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d7652-cf3d-4fd7-b5cf-4b814a1f69a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:38.035498 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d7652-cf3d-4fd7-b5cf-4b814a1f69a0 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:38.054760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 516/1051] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:20:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:38.056659 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d7652-cf3d-4fd7-b5cf-4b814a1f69a0 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:38.095182 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:38.102720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 536/1052] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:20:38.127423 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fce89-dcdd-4791-aae8-c32ec72137fa None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:38.130763 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:38.170118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d7652-cf3d-4fd7-b5cf-4b814a1f69a0 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:38.207968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63715f-b1c6-4b7d-aabe-c82ccef0dc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:38.208624 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63715f-b1c6-4b7d-aabe-c82ccef0dc23 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:38.208906 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63715f-b1c6-4b7d-aabe-c82ccef0dc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:38.209182 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63715f-b1c6-4b7d-aabe-c82ccef0dc23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:38.210065 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63715f-b1c6-4b7d-aabe-c82ccef0dc23 None admin] RBAC: Adding query filter params (role.id=fca61019937a482aa7bea9176fe21f2a, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=b6670a010c034f7999c9445452c02473) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:38.210357 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63715f-b1c6-4b7d-aabe-c82ccef0dc23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:38.211881 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63715f-b1c6-4b7d-aabe-c82ccef0dc23 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:38.225557 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 517/1053] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:20:38 2022] GET /identity/v3/role_assignments?user.id=b6670a010c034f7999c9445452c02473&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=fca61019937a482aa7bea9176fe21f2a => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:38.249351 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fce89-dcdd-4791-aae8-c32ec72137fa None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:38.286972 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc69c63-0bc6-423a-9ba4-cc9a85312bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:38.287786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc69c63-0bc6-423a-9ba4-cc9a85312bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:38.288071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc69c63-0bc6-423a-9ba4-cc9a85312bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:38.288349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc69c63-0bc6-423a-9ba4-cc9a85312bd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:38.300440 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc69c63-0bc6-423a-9ba4-cc9a85312bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:20:38.309053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-9dc69c63-0bc6-423a-9ba4-cc9a85312bd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:20:38.309053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:38.309053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:38.309053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:38.309053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:38.309053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:38.309053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:38.309053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:38.309053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:38.309053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:38.309053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:38.309053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:38.309053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:20:38.309053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:20:38.309053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:20:38.309053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:20:38.310169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:20:38.310169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:20:38.310169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:20:38.310169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:20:38.310169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:38.310169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:38.310169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:38.310169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:38.310169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:38.310169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:38.310169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:38.310169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:38.310169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:38.310169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:38.310169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:38.310169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:38.311230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:38.311230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:38.311230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:38.311230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:38.311230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:20:38.311230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:20:38.311230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:20:38.311230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:20:38.311230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:20:38.311230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:20:38.311230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:20:38.311230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:38.311230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 537/1054] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:20:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:38.316466 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63715f-b1c6-4b7d-aabe-c82ccef0dc23 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:38.419113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:38.423953 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63715f-b1c6-4b7d-aabe-c82ccef0dc23 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:38.458486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8a3f6-f2c3-4fee-bc80-70a83ec19442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:38.459155 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8a3f6-f2c3-4fee-bc80-70a83ec19442 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:38.459439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8a3f6-f2c3-4fee-bc80-70a83ec19442 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:38.459713 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8a3f6-f2c3-4fee-bc80-70a83ec19442 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:38.460462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8a3f6-f2c3-4fee-bc80-70a83ec19442 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:38.460771 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8a3f6-f2c3-4fee-bc80-70a83ec19442 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:38.462197 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8a3f6-f2c3-4fee-bc80-70a83ec19442 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:38.475021 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 518/1055] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:20:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:38.476383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc69c63-0bc6-423a-9ba4-cc9a85312bd0 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:38.540585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:38.579959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc69c63-0bc6-423a-9ba4-cc9a85312bd0 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:38.613985 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da90e2-6993-451d-9c0f-d2d930a9b445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:38.614855 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da90e2-6993-451d-9c0f-d2d930a9b445 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:38.615143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da90e2-6993-451d-9c0f-d2d930a9b445 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:38.615414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da90e2-6993-451d-9c0f-d2d930a9b445 None admin] PATH_INFO: `/v3/users/c8a8e62f990f43a7b4b169eeb89bc30c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:38.629696 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da90e2-6993-451d-9c0f-d2d930a9b445 None admin] RBAC: Authorizing `identity:get_user(user_id=c8a8e62f990f43a7b4b169eeb89bc30c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:38.631219 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da90e2-6993-451d-9c0f-d2d930a9b445 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:38.638166 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 538/1056] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:20:38 2022] GET /identity/v3/users/c8a8e62f990f43a7b4b169eeb89bc30c => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:38.639422 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8a3f6-f2c3-4fee-bc80-70a83ec19442 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:38.747928 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8a3f6-f2c3-4fee-bc80-70a83ec19442 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:38.785352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382cde5-17e5-4b5e-978f-d7c9f24556d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:38.786031 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382cde5-17e5-4b5e-978f-d7c9f24556d2 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:38.786314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382cde5-17e5-4b5e-978f-d7c9f24556d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:38.786588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f382cde5-17e5-4b5e-978f-d7c9f24556d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:38.817899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:38.856558 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382cde5-17e5-4b5e-978f-d7c9f24556d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:38.858062 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f382cde5-17e5-4b5e-978f-d7c9f24556d2 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:38.961040 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 519/1057] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:20:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:20:38.962705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da90e2-6993-451d-9c0f-d2d930a9b445 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:39.065500 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da90e2-6993-451d-9c0f-d2d930a9b445 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:39.088577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:39.100301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2987edd-4261-4484-8599-72528ace7a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:39.101408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2987edd-4261-4484-8599-72528ace7a30 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:39.101717 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2987edd-4261-4484-8599-72528ace7a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:39.101992 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2987edd-4261-4484-8599-72528ace7a30 None admin] PATH_INFO: `/v3/projects/e28134be2e2d4f688755bcb78877502c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:39.103762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2987edd-4261-4484-8599-72528ace7a30 None admin] RBAC: Authorizing `identity:get_project(project_id=e28134be2e2d4f688755bcb78877502c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:39.105193 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2987edd-4261-4484-8599-72528ace7a30 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:39.111991 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 539/1058] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:20:38 2022] GET /identity/v3/projects/e28134be2e2d4f688755bcb78877502c => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:39.113565 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382cde5-17e5-4b5e-978f-d7c9f24556d2 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:39.124628 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635186e6-1fee-47dc-b6ad-ae9b7acc74df None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:39.125144 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635186e6-1fee-47dc-b6ad-ae9b7acc74df None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:39.125422 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635186e6-1fee-47dc-b6ad-ae9b7acc74df None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:39.126795 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 540/1059] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:39.131748 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66204638-e799-437a-82e5-9a2c8be5c6d0 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:39.132031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66204638-e799-437a-82e5-9a2c8be5c6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:39.132301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66204638-e799-437a-82e5-9a2c8be5c6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:39.149600 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-66204638-e799-437a-82e5-9a2c8be5c6d0 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:39.151085 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-66204638-e799-437a-82e5-9a2c8be5c6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:39.179962 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:39.221862 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f382cde5-17e5-4b5e-978f-d7c9f24556d2 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:39.229594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 541/1060] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:20:39.249585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66204638-e799-437a-82e5-9a2c8be5c6d0 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:39.257328 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41397e5d-90d9-47aa-8b49-2b2bf2d41950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:39.258080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41397e5d-90d9-47aa-8b49-2b2bf2d41950 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:39.258910 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41397e5d-90d9-47aa-8b49-2b2bf2d41950 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:39.259199 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41397e5d-90d9-47aa-8b49-2b2bf2d41950 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:39.260028 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41397e5d-90d9-47aa-8b49-2b2bf2d41950 None admin] RBAC: Adding query filter params (role.id=beed8caad097496292e544146859df5c, scope.project.id=e28134be2e2d4f688755bcb78877502c, user.id=c8a8e62f990f43a7b4b169eeb89bc30c) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:39.260342 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41397e5d-90d9-47aa-8b49-2b2bf2d41950 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:39.261798 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41397e5d-90d9-47aa-8b49-2b2bf2d41950 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:39.273330 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 520/1061] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:20:39 2022] GET /identity/v3/role_assignments?user.id=c8a8e62f990f43a7b4b169eeb89bc30c&scope.project.id=e28134be2e2d4f688755bcb78877502c&role.id=beed8caad097496292e544146859df5c => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:39.366468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66204638-e799-437a-82e5-9a2c8be5c6d0 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:39.388977 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:39.404277 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca0c22-e12a-4b14-acb5-194303973e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:39.404944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca0c22-e12a-4b14-acb5-194303973e54 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:39.405230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca0c22-e12a-4b14-acb5-194303973e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:39.405867 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca0c22-e12a-4b14-acb5-194303973e54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:39.475562 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca0c22-e12a-4b14-acb5-194303973e54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:39.477815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca0c22-e12a-4b14-acb5-194303973e54 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:39.575448 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 542/1062] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:20:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 08:20:39.581022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41397e5d-90d9-47aa-8b49-2b2bf2d41950 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:39.682199 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41397e5d-90d9-47aa-8b49-2b2bf2d41950 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:39.707592 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:39.718509 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f90b4-dbf6-4fa5-9557-3b61feb67730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:39.719299 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f90b4-dbf6-4fa5-9557-3b61feb67730 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:39.719578 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f90b4-dbf6-4fa5-9557-3b61feb67730 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:39.724542 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f90b4-dbf6-4fa5-9557-3b61feb67730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:39.730731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f90b4-dbf6-4fa5-9557-3b61feb67730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:39.732278 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f90b4-dbf6-4fa5-9557-3b61feb67730 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:39.751318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-ca6f90b4-dbf6-4fa5-9557-3b61feb67730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:39.751318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:39.751318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:39.751318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:39.751318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:39.751318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:39.751318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:39.751318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:39.751318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:39.751318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:39.751318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:39.751318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:39.751318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:39.751318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:39.751318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:39.752306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:39.752306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:39.752306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:39.752306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:39.752306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:39.752306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:39.752306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:39.752306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:39.752306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:39.752306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:39.752306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:39.752306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:39.752306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:39.752306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:39.752306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:39.752306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:39.752306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:39.753221 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:39.753221 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:39.753221 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:39.753221 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:39.753221 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 521/1063] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:39.760473 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca0c22-e12a-4b14-acb5-194303973e54 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:39.780941 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:39.860961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca0c22-e12a-4b14-acb5-194303973e54 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:39.894727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2f93f-3c55-47ec-891a-18e84bec78d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:39.895392 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2f93f-3c55-47ec-891a-18e84bec78d5 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:39.895674 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2f93f-3c55-47ec-891a-18e84bec78d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:39.895951 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2f93f-3c55-47ec-891a-18e84bec78d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:39.896667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2f93f-3c55-47ec-891a-18e84bec78d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:39.896977 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2f93f-3c55-47ec-891a-18e84bec78d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:39.898374 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2f93f-3c55-47ec-891a-18e84bec78d5 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:39.910452 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 543/1064] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:40.254879 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e270c-05bd-4a1e-8f4f-dfdf1ff5d35d None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:40.255166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e270c-05bd-4a1e-8f4f-dfdf1ff5d35d None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:40.255438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e270c-05bd-4a1e-8f4f-dfdf1ff5d35d None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:40.256809 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 522/1065] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:40.261964 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da532f97-a099-4b4d-a1da-e406353b4230 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:40.262328 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da532f97-a099-4b4d-a1da-e406353b4230 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:40.262681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da532f97-a099-4b4d-a1da-e406353b4230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:40.279082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-da532f97-a099-4b4d-a1da-e406353b4230 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:40.280261 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-da532f97-a099-4b4d-a1da-e406353b4230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:40.348711 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 544/1066] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:40.372936 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e270c-05bd-4a1e-8f4f-dfdf1ff5d35d None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:40.471328 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e270c-05bd-4a1e-8f4f-dfdf1ff5d35d None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:40.504555 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f6084-51f1-4079-8571-f86bf84461b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:40.505388 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f6084-51f1-4079-8571-f86bf84461b0 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:40.505645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f6084-51f1-4079-8571-f86bf84461b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:40.505917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f6084-51f1-4079-8571-f86bf84461b0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:40.515742 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f6084-51f1-4079-8571-f86bf84461b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:20:40.523736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-997f6084-51f1-4079-8571-f86bf84461b0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:20:40.523736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:40.523736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:40.523736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:40.523736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:40.523736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:40.523736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:40.523736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:40.523736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:40.523736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:40.523736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:40.523736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:40.523736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:20:40.523736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:20:40.523736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:20:40.523736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:20:40.524698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:20:40.524698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:20:40.524698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:20:40.524698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:20:40.524698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:40.524698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:40.524698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:40.524698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:40.524698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:40.524698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:40.524698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:40.524698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:40.524698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:40.524698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:40.524698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:40.524698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:40.525589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:40.525589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:40.525589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:40.525589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:40.525589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:20:40.525589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:20:40.525589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:20:40.525589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:20:40.525589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:20:40.525589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:20:40.525589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:20:40.525589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:40.525589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 523/1067] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Jul 21 08:20:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:40.530906 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da532f97-a099-4b4d-a1da-e406353b4230 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:40.542802 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:40.627942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da532f97-a099-4b4d-a1da-e406353b4230 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:40.660588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91251f2-350a-4464-8d18-f27f10c1c9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:40.661244 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91251f2-350a-4464-8d18-f27f10c1c9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:40.661540 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91251f2-350a-4464-8d18-f27f10c1c9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:40.661828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91251f2-350a-4464-8d18-f27f10c1c9e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:40.662591 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91251f2-350a-4464-8d18-f27f10c1c9e2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:40.662895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91251f2-350a-4464-8d18-f27f10c1c9e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:40.664257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91251f2-350a-4464-8d18-f27f10c1c9e2 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:40.673221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 545/1068] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Jul 21 08:20:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:40.679868 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f6084-51f1-4079-8571-f86bf84461b0 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:40.725067 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:40.784946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f6084-51f1-4079-8571-f86bf84461b0 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:40.818582 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506da54f-15a1-4641-bc8c-52ec4107ff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:40.819378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506da54f-15a1-4641-bc8c-52ec4107ff3b None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:40.819661 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506da54f-15a1-4641-bc8c-52ec4107ff3b None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:40.819938 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506da54f-15a1-4641-bc8c-52ec4107ff3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:40.830489 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506da54f-15a1-4641-bc8c-52ec4107ff3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:40.831925 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506da54f-15a1-4641-bc8c-52ec4107ff3b None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:40.848968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-506da54f-15a1-4641-bc8c-52ec4107ff3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:40.848968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:40.848968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:40.848968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:40.848968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:40.848968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:40.848968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:40.848968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:40.848968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:40.848968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:40.848968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:40.848968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:40.848968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:40.848968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:40.848968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:40.849872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:40.849872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:40.849872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:40.849872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:40.849872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:40.849872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:40.849872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:40.849872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:40.849872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:40.849872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:40.849872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:40.849872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:40.849872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:40.849872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:40.849872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:40.849872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:40.849872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:40.850775 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:40.850775 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:40.850775 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:40.850775 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:40.850775 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 524/1069] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:40.856966 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91251f2-350a-4464-8d18-f27f10c1c9e2 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:40.925770 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:40.954435 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91251f2-350a-4464-8d18-f27f10c1c9e2 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:40.993310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7721b-5830-408e-9e78-1c3bdd7f9cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:40.994011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7721b-5830-408e-9e78-1c3bdd7f9cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:40.994291 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7721b-5830-408e-9e78-1c3bdd7f9cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:40.994563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7721b-5830-408e-9e78-1c3bdd7f9cb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:40.995271 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7721b-5830-408e-9e78-1c3bdd7f9cb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:40.995572 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7721b-5830-408e-9e78-1c3bdd7f9cb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:40.996922 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7721b-5830-408e-9e78-1c3bdd7f9cb0 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:41.008644 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 546/1070] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:41.014484 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506da54f-15a1-4641-bc8c-52ec4107ff3b None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:41.103665 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:41.111694 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506da54f-15a1-4641-bc8c-52ec4107ff3b None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:41.143895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b40d7b-d74d-4982-8ac6-a7947bb71caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:41.144668 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b40d7b-d74d-4982-8ac6-a7947bb71caf None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:41.145002 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b40d7b-d74d-4982-8ac6-a7947bb71caf None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:41.145257 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b40d7b-d74d-4982-8ac6-a7947bb71caf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:41.153654 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b40d7b-d74d-4982-8ac6-a7947bb71caf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:41.155083 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b40d7b-d74d-4982-8ac6-a7947bb71caf None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:41.169347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-c7b40d7b-d74d-4982-8ac6-a7947bb71caf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:20:41.169347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:41.169347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:41.169347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:41.169347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:41.169347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:41.169347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:41.169347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:41.169347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:41.169347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:41.169347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:41.169347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:41.169347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:20:41.169347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:20:41.169347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:20:41.169347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:20:41.170522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:41.170522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:41.170522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:20:41.170522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:41.170522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:20:41.170522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:41.170522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:41.170522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:41.170522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:41.170522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:41.170522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:41.170522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:41.170522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:41.170522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:41.170522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:41.170522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:41.170522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:41.170522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:41.171513 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:41.171513 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:41.171513 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:20:41.171513 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:20:41.171513 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:20:41.171513 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:20:41.171513 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:20:41.171513 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:20:41.171513 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:20:41.171513 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:41.171513 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 525/1071] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Jul 21 08:20:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:41.176431 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7721b-5830-408e-9e78-1c3bdd7f9cb0 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:41.275016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7721b-5830-408e-9e78-1c3bdd7f9cb0 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:41.299126 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74629228-abbc-418c-b9ac-7462245e8849 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:41.299407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74629228-abbc-418c-b9ac-7462245e8849 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:41.299678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74629228-abbc-418c-b9ac-7462245e8849 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:41.301037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 526/1072] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:20:41.303585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:41.306416 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b71fc9-52ca-4052-aefb-37b63e4c3d76 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:41.306693 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b71fc9-52ca-4052-aefb-37b63e4c3d76 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:41.306963 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b71fc9-52ca-4052-aefb-37b63e4c3d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:41.309256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb8ffc-954a-4e0d-8b1e-0b4c08dab8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:41.309952 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb8ffc-954a-4e0d-8b1e-0b4c08dab8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:41.310239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb8ffc-954a-4e0d-8b1e-0b4c08dab8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:41.310515 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb8ffc-954a-4e0d-8b1e-0b4c08dab8a7 None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:41.311352 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb8ffc-954a-4e0d-8b1e-0b4c08dab8a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:41.311666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb8ffc-954a-4e0d-8b1e-0b4c08dab8a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:41.313098 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb8ffc-954a-4e0d-8b1e-0b4c08dab8a7 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:41.323162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-47b71fc9-52ca-4052-aefb-37b63e4c3d76 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:41.324332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-47b71fc9-52ca-4052-aefb-37b63e4c3d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:41.330378 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 547/1073] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Jul 21 08:20:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:41.335847 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb8ffc-954a-4e0d-8b1e-0b4c08dab8a7 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:41.401969 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 527/1074] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:20:41.424580 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b71fc9-52ca-4052-aefb-37b63e4c3d76 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:41.443050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb8ffc-954a-4e0d-8b1e-0b4c08dab8a7 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:41.477980 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a734f-d4de-4c28-a55a-647923df854e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:41.478757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a734f-d4de-4c28-a55a-647923df854e None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:41.479037 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a734f-d4de-4c28-a55a-647923df854e None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:41.479313 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a734f-d4de-4c28-a55a-647923df854e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:41.489294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a734f-d4de-4c28-a55a-647923df854e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:41.490766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a734f-d4de-4c28-a55a-647923df854e None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:41.501737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:41.507769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-716a734f-d4de-4c28-a55a-647923df854e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:41.507769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:41.507769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:41.507769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:41.507769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:41.507769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:41.507769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:41.507769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:41.507769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:41.507769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:41.507769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:41.507769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:41.507769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:41.507769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:41.507769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:41.511883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:41.511883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:41.511883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:41.511883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:41.511883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:41.511883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:41.511883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:41.511883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:41.511883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:41.511883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:41.511883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:41.511883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:41.511883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:41.511883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:41.511883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:41.511883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:41.511883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:41.512807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:41.512807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:41.512807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:41.512807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:41.512807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 548/1075] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:41.514657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a734f-d4de-4c28-a55a-647923df854e None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:41.522925 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b71fc9-52ca-4052-aefb-37b63e4c3d76 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:41.556890 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:41.557370 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9d286-d8f4-47bb-a143-2acc3b340685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:41.558076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9d286-d8f4-47bb-a143-2acc3b340685 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:41.558361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9d286-d8f4-47bb-a143-2acc3b340685 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:41.558637 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9d286-d8f4-47bb-a143-2acc3b340685 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:41.568921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9d286-d8f4-47bb-a143-2acc3b340685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:20:41.576604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-efb9d286-d8f4-47bb-a143-2acc3b340685 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:20:41.576604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:41.576604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:41.576604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:41.576604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:41.576604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:41.576604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:41.576604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:41.576604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:41.576604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:41.576604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:41.576604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:41.576604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:20:41.576604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:20:41.576604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:20:41.576604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:20:41.577753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:20:41.577753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:20:41.577753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:20:41.577753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:20:41.577753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:41.577753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:41.577753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:41.577753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:41.577753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:41.577753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:41.577753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:41.577753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:41.577753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:41.577753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:41.577753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:41.577753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:41.578784 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:41.578784 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:41.578784 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:41.578784 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:41.578784 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:20:41.578784 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:20:41.578784 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:20:41.578784 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:20:41.578784 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:20:41.578784 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:20:41.578784 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:20:41.578784 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:41.578784 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 528/1076] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:20:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:41.583699 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9d286-d8f4-47bb-a143-2acc3b340685 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:41.614602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a734f-d4de-4c28-a55a-647923df854e None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:41.649332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abac89-4e33-4d04-b041-edf083125390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:41.650022 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abac89-4e33-4d04-b041-edf083125390 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:41.650458 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abac89-4e33-4d04-b041-edf083125390 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:41.650738 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abac89-4e33-4d04-b041-edf083125390 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:41.651446 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abac89-4e33-4d04-b041-edf083125390 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:41.651751 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abac89-4e33-4d04-b041-edf083125390 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:41.653157 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abac89-4e33-4d04-b041-edf083125390 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:41.664408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 549/1077] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:41.670502 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abac89-4e33-4d04-b041-edf083125390 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:41.682180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9d286-d8f4-47bb-a143-2acc3b340685 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:41.718256 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1bf49-315a-4b20-a1dd-8c57767bea06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:41.718918 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1bf49-315a-4b20-a1dd-8c57767bea06 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:41.719203 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1bf49-315a-4b20-a1dd-8c57767bea06 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:41.719491 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1bf49-315a-4b20-a1dd-8c57767bea06 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:41.720240 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1bf49-315a-4b20-a1dd-8c57767bea06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:41.720547 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1bf49-315a-4b20-a1dd-8c57767bea06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:41.722131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad1bf49-315a-4b20-a1dd-8c57767bea06 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:41.730716 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 529/1078] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:20:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:41.736354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1bf49-315a-4b20-a1dd-8c57767bea06 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:41.738975 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:41.783463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abac89-4e33-4d04-b041-edf083125390 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:41.784998 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:41.817834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db8b6c-b1f3-44cb-9492-636b101368ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:41.818619 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db8b6c-b1f3-44cb-9492-636b101368ac None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:41.818900 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db8b6c-b1f3-44cb-9492-636b101368ac None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:41.819173 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db8b6c-b1f3-44cb-9492-636b101368ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:41.826350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db8b6c-b1f3-44cb-9492-636b101368ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:41.827778 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db8b6c-b1f3-44cb-9492-636b101368ac None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:41.839228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1bf49-315a-4b20-a1dd-8c57767bea06 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:41.842254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-d5db8b6c-b1f3-44cb-9492-636b101368ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:41.842254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:41.842254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:41.842254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:41.842254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:41.842254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:41.842254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:41.842254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:41.842254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:41.842254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:41.842254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:41.842254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:41.842254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:41.842254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:41.842254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:41.843361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:41.843361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:41.843361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:41.843361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:41.843361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:41.843361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:41.843361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:41.843361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:41.843361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:41.843361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:41.843361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:41.843361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:41.843361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:41.843361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:41.843361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:41.843361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:41.843361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:41.849056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:41.849056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:41.849056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:41.849056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:41.849056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:41.849056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:41.849056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:41.849056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:41.849056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 550/1079] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:41.849690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db8b6c-b1f3-44cb-9492-636b101368ac None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:41.876103 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5ced7-6598-48b3-b377-fc9805f277a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:41.876957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5ced7-6598-48b3-b377-fc9805f277a0 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:41.877241 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5ced7-6598-48b3-b377-fc9805f277a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:41.877540 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5ced7-6598-48b3-b377-fc9805f277a0 None admin] PATH_INFO: `/v3/users/c8a8e62f990f43a7b4b169eeb89bc30c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:41.879124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5ced7-6598-48b3-b377-fc9805f277a0 None admin] RBAC: Authorizing `identity:get_user(user_id=c8a8e62f990f43a7b4b169eeb89bc30c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:41.880287 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5ced7-6598-48b3-b377-fc9805f277a0 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:41.881943 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 530/1080] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:20:41 2022] GET /identity/v3/users/c8a8e62f990f43a7b4b169eeb89bc30c => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:41.888176 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5ced7-6598-48b3-b377-fc9805f277a0 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:41.946362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db8b6c-b1f3-44cb-9492-636b101368ac None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:41.956388 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:41.980414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285693d-5f36-4250-9a5d-f8db113ed12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:41.981068 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285693d-5f36-4250-9a5d-f8db113ed12e None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:41.981354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285693d-5f36-4250-9a5d-f8db113ed12e None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:41.981664 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285693d-5f36-4250-9a5d-f8db113ed12e None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:41.982446 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285693d-5f36-4250-9a5d-f8db113ed12e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:41.982757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285693d-5f36-4250-9a5d-f8db113ed12e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:41.984189 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285693d-5f36-4250-9a5d-f8db113ed12e None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:41.987652 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5ced7-6598-48b3-b377-fc9805f277a0 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:41.996808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 551/1081] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:20:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:42.002470 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285693d-5f36-4250-9a5d-f8db113ed12e None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:42.027542 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:42.034701 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd93686-aef1-4662-a1f2-b9268aca2061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:42.035776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd93686-aef1-4662-a1f2-b9268aca2061 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:42.036059 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd93686-aef1-4662-a1f2-b9268aca2061 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:42.036341 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd93686-aef1-4662-a1f2-b9268aca2061 None admin] PATH_INFO: `/v3/projects/e28134be2e2d4f688755bcb78877502c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:42.037548 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd93686-aef1-4662-a1f2-b9268aca2061 None admin] RBAC: Authorizing `identity:get_project(project_id=e28134be2e2d4f688755bcb78877502c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:42.038990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd93686-aef1-4662-a1f2-b9268aca2061 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:42.040736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 531/1082] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:20:41 2022] GET /identity/v3/projects/e28134be2e2d4f688755bcb78877502c => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:42.048077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd93686-aef1-4662-a1f2-b9268aca2061 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:42.105036 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285693d-5f36-4250-9a5d-f8db113ed12e None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:42.138732 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b9c8b-a1e1-4cb5-8d65-4e6356f92e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:42.139857 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b9c8b-a1e1-4cb5-8d65-4e6356f92e1b None admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:42.140137 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b9c8b-a1e1-4cb5-8d65-4e6356f92e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:42.140410 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b9c8b-a1e1-4cb5-8d65-4e6356f92e1b None admin] PATH_INFO: `/v3/projects/83100b3a5d584e39886c234391fdb204/users/b6670a010c034f7999c9445452c02473/roles/fca61019937a482aa7bea9176fe21f2a` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:42.142633 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b9c8b-a1e1-4cb5-8d65-4e6356f92e1b None admin] RBAC: Authorizing `identity:create_grant(project_id=83100b3a5d584e39886c234391fdb204, user_id=b6670a010c034f7999c9445452c02473, role_id=fca61019937a482aa7bea9176fe21f2a)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:42.144040 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b9c8b-a1e1-4cb5-8d65-4e6356f92e1b None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:42.146303 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd93686-aef1-4662-a1f2-b9268aca2061 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:42.178714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8261015-8654-4b16-9fec-514c143e91dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:42.179626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8261015-8654-4b16-9fec-514c143e91dc None admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:42.179912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8261015-8654-4b16-9fec-514c143e91dc None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:42.180710 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8261015-8654-4b16-9fec-514c143e91dc None admin] PATH_INFO: `/v3/projects/e28134be2e2d4f688755bcb78877502c/users/c8a8e62f990f43a7b4b169eeb89bc30c/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:42.182703 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8261015-8654-4b16-9fec-514c143e91dc None admin] RBAC: Authorizing `identity:create_grant(project_id=e28134be2e2d4f688755bcb78877502c, user_id=c8a8e62f990f43a7b4b169eeb89bc30c, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:42.184118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8261015-8654-4b16-9fec-514c143e91dc None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:42.215085 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 552/1083] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:20:42 2022] PUT /identity/v3/projects/83100b3a5d584e39886c234391fdb204/users/b6670a010c034f7999c9445452c02473/roles/fca61019937a482aa7bea9176fe21f2a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:20:42.290827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:42.296781 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 532/1084] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:20:42 2022] PUT /identity/v3/projects/e28134be2e2d4f688755bcb78877502c/users/c8a8e62f990f43a7b4b169eeb89bc30c/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:20:44.233487 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec77ac-c178-4cbb-8b76-5e75214ce91a None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:44.234042 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec77ac-c178-4cbb-8b76-5e75214ce91a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:44.234135 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec77ac-c178-4cbb-8b76-5e75214ce91a None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:44.235441 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 553/1085] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:44.240455 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502daf1b-2085-443b-9c09-c1b3f237206f None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:44.240860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502daf1b-2085-443b-9c09-c1b3f237206f None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:44.241012 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502daf1b-2085-443b-9c09-c1b3f237206f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:44.257437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-502daf1b-2085-443b-9c09-c1b3f237206f None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:44.259239 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-502daf1b-2085-443b-9c09-c1b3f237206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:44.303313 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6709e75-c2a4-46a5-9ab4-83ae30b49eec None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:44.303605 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6709e75-c2a4-46a5-9ab4-83ae30b49eec None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:44.303880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6709e75-c2a4-46a5-9ab4-83ae30b49eec None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:44.305810 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 554/1086] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:20:44.310708 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcad8a1-ec39-4b13-a9fc-b076a5916c39 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:44.311005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcad8a1-ec39-4b13-a9fc-b076a5916c39 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:44.311290 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcad8a1-ec39-4b13-a9fc-b076a5916c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:44.324832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 533/1087] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:44.328951 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-fdcad8a1-ec39-4b13-a9fc-b076a5916c39 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:44.330175 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-fdcad8a1-ec39-4b13-a9fc-b076a5916c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:44.347943 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502daf1b-2085-443b-9c09-c1b3f237206f None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:44.396648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 555/1088] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:20:44.419844 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcad8a1-ec39-4b13-a9fc-b076a5916c39 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:44.433742 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:44.444884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502daf1b-2085-443b-9c09-c1b3f237206f None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:44.472150 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:44.480190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5b7b1-cd4a-48e5-887a-b57abe50dc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:44.481048 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5b7b1-cd4a-48e5-887a-b57abe50dc13 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:44.481333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5b7b1-cd4a-48e5-887a-b57abe50dc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:44.481841 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5b7b1-cd4a-48e5-887a-b57abe50dc13 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:44.491598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5b7b1-cd4a-48e5-887a-b57abe50dc13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:20:44.500471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-f7d5b7b1-cd4a-48e5-887a-b57abe50dc13 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:20:44.500471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:44.500471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:44.500471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:44.500471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:44.500471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:44.500471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:44.500471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:44.500471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:44.500471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:44.500471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:44.500471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:44.500471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:20:44.500471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:20:44.500471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:20:44.500471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:20:44.501507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:20:44.501507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:20:44.501507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:20:44.501507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:20:44.501507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:44.501507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:44.501507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:44.501507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:44.501507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:44.501507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:44.501507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:44.501507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:44.501507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:44.501507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:44.501507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:44.501507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:44.502415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:44.502415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:44.502415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:44.502415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:44.502415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:20:44.502415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:20:44.502415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:20:44.502415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:20:44.502415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:20:44.502415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:20:44.502415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 08:20:44.502415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:44.503475 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 534/1089] 10.222.0.57 () {56 vars in 1120 bytes} [Thu Jul 21 08:20:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:44.507606 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5b7b1-cd4a-48e5-887a-b57abe50dc13 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:44.518316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcad8a1-ec39-4b13-a9fc-b076a5916c39 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:44.552430 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113612a-f225-4d82-8ef8-f14d21b9e897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:44.553213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113612a-f225-4d82-8ef8-f14d21b9e897 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:44.553493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113612a-f225-4d82-8ef8-f14d21b9e897 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:44.553808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113612a-f225-4d82-8ef8-f14d21b9e897 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:44.564221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113612a-f225-4d82-8ef8-f14d21b9e897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:20:44.572477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-2113612a-f225-4d82-8ef8-f14d21b9e897 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:20:44.572477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:44.572477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:44.572477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:44.572477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:44.572477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:44.572477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:44.572477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:44.572477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:44.572477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:44.572477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:44.572477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:44.572477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:20:44.572477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:20:44.572477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:20:44.572477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:20:44.577720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:20:44.577720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:20:44.577720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:20:44.577720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:20:44.577720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:44.577720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:44.577720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:44.577720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:44.577720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:44.577720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:44.577720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:44.577720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:44.577720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:44.577720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:44.577720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:44.577720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:44.578844 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:44.578844 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:44.578844 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:44.578844 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:44.578844 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:20:44.578844 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:20:44.578844 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:20:44.578844 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:20:44.578844 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:20:44.578844 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:20:44.578844 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:20:44.578844 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:44.578844 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 556/1090] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:20:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:44.579693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113612a-f225-4d82-8ef8-f14d21b9e897 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:44.611014 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5b7b1-cd4a-48e5-887a-b57abe50dc13 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:44.645448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee55387-f7bc-4b50-8a24-e2e9674f7795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:44.646138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee55387-f7bc-4b50-8a24-e2e9674f7795 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:44.646423 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee55387-f7bc-4b50-8a24-e2e9674f7795 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:44.646701 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee55387-f7bc-4b50-8a24-e2e9674f7795 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:44.647447 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee55387-f7bc-4b50-8a24-e2e9674f7795 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:44.647758 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee55387-f7bc-4b50-8a24-e2e9674f7795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:44.647881 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:44.649570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee55387-f7bc-4b50-8a24-e2e9674f7795 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:44.657583 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 535/1091] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Jul 21 08:20:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:44.663414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee55387-f7bc-4b50-8a24-e2e9674f7795 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:44.676043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113612a-f225-4d82-8ef8-f14d21b9e897 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:44.710320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03584e9-975a-4206-ae43-3b268dd661eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:44.710968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03584e9-975a-4206-ae43-3b268dd661eb None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:44.711276 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03584e9-975a-4206-ae43-3b268dd661eb None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:44.711549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03584e9-975a-4206-ae43-3b268dd661eb None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:44.712185 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:44.712312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03584e9-975a-4206-ae43-3b268dd661eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:44.712564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03584e9-975a-4206-ae43-3b268dd661eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:44.713947 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03584e9-975a-4206-ae43-3b268dd661eb None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:44.721795 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 557/1092] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:20:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:44.728462 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03584e9-975a-4206-ae43-3b268dd661eb None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:44.765993 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee55387-f7bc-4b50-8a24-e2e9674f7795 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:44.799593 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a530674-ff57-4aaf-9225-d319c9406692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:44.800375 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a530674-ff57-4aaf-9225-d319c9406692 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:44.800660 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a530674-ff57-4aaf-9225-d319c9406692 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:44.800935 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a530674-ff57-4aaf-9225-d319c9406692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:44.811818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a530674-ff57-4aaf-9225-d319c9406692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:44.813278 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a530674-ff57-4aaf-9225-d319c9406692 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:44.830714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-1a530674-ff57-4aaf-9225-d319c9406692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:44.830714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:44.830714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:44.830714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:44.830714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:44.830714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:44.830714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:44.830714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:44.830714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:44.830714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:44.830714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:44.830714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:44.830714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:44.830714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:44.830714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:44.831666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:44.831666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:44.831666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:44.831666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:44.831666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:44.831666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:44.831666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:44.831666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:44.831666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:44.831666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:44.831666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:44.831666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:44.831666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:44.831666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:44.831666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:44.831666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:44.831666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:44.832583 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:44.832583 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:44.832583 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:44.832583 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:44.832583 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 536/1093] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:44.833016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03584e9-975a-4206-ae43-3b268dd661eb None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:44.837668 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a530674-ff57-4aaf-9225-d319c9406692 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:44.868632 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e21fa-eff1-4338-a0be-b545d8519a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:44.869503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e21fa-eff1-4338-a0be-b545d8519a1c None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:44.869805 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e21fa-eff1-4338-a0be-b545d8519a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:44.870073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e21fa-eff1-4338-a0be-b545d8519a1c None admin] PATH_INFO: `/v3/users/c8a8e62f990f43a7b4b169eeb89bc30c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:44.871242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e21fa-eff1-4338-a0be-b545d8519a1c None admin] RBAC: Authorizing `identity:get_user(user_id=c8a8e62f990f43a7b4b169eeb89bc30c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:44.872655 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e21fa-eff1-4338-a0be-b545d8519a1c None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:44.879080 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 558/1094] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:20:44 2022] GET /identity/v3/users/c8a8e62f990f43a7b4b169eeb89bc30c => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:44.880077 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e21fa-eff1-4338-a0be-b545d8519a1c None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:44.882689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:44.938962 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a530674-ff57-4aaf-9225-d319c9406692 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:44.940449 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:44.971272 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f812b3-42fb-4540-ab7c-043c6f69a1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:44.971924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f812b3-42fb-4540-ab7c-043c6f69a1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:44.972206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f812b3-42fb-4540-ab7c-043c6f69a1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:44.972486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f812b3-42fb-4540-ab7c-043c6f69a1a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:44.973315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f812b3-42fb-4540-ab7c-043c6f69a1a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:44.973651 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f812b3-42fb-4540-ab7c-043c6f69a1a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:44.975016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f812b3-42fb-4540-ab7c-043c6f69a1a5 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:44.980170 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e21fa-eff1-4338-a0be-b545d8519a1c None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:44.987456 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 537/1095] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:44.993544 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f812b3-42fb-4540-ab7c-043c6f69a1a5 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:45.014604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801374a-b31f-47d6-bd4c-f8ab8034a2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:45.015182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801374a-b31f-47d6-bd4c-f8ab8034a2db None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:45.015460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801374a-b31f-47d6-bd4c-f8ab8034a2db None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:45.015735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2801374a-b31f-47d6-bd4c-f8ab8034a2db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:45.082259 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801374a-b31f-47d6-bd4c-f8ab8034a2db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:45.083706 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2801374a-b31f-47d6-bd4c-f8ab8034a2db None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:45.085510 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:45.089414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f812b3-42fb-4540-ab7c-043c6f69a1a5 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:45.123983 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd116b-2195-4fad-ab22-86eb0a32606c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:45.124756 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd116b-2195-4fad-ab22-86eb0a32606c None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:45.125039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd116b-2195-4fad-ab22-86eb0a32606c None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:45.125317 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd116b-2195-4fad-ab22-86eb0a32606c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:45.132396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd116b-2195-4fad-ab22-86eb0a32606c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:45.134058 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd116b-2195-4fad-ab22-86eb0a32606c None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:45.149361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-e2dd116b-2195-4fad-ab22-86eb0a32606c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:20:45.149361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:45.149361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:45.149361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:45.149361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:45.149361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:45.149361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:45.149361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:45.149361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:45.149361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:45.149361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:45.149361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:45.149361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:20:45.149361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:20:45.149361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:20:45.149361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:20:45.150576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:45.150576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:45.150576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:20:45.150576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:45.150576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:20:45.150576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:20:45.150576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:45.150576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:45.150576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:45.150576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:45.150576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:45.150576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:45.150576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:45.150576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:45.150576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:45.150576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:45.150576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:45.150576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:45.151591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:45.151591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:45.151591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:20:45.151591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:20:45.151591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:20:45.151591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:20:45.151591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:20:45.151591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:20:45.151591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 08:20:45.151591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:20:45.151591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 538/1096] 10.222.0.57 () {56 vars in 1093 bytes} [Thu Jul 21 08:20:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:45.157078 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd116b-2195-4fad-ab22-86eb0a32606c None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:45.181532 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:45.188023 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 559/1097] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:20:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 08:20:45.193967 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801374a-b31f-47d6-bd4c-f8ab8034a2db None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:45.256372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd116b-2195-4fad-ab22-86eb0a32606c None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:45.290823 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91028abc-7cc7-4e3f-8448-e89750ea1ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:45.291417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91028abc-7cc7-4e3f-8448-e89750ea1ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:45.291700 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91028abc-7cc7-4e3f-8448-e89750ea1ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:45.291975 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91028abc-7cc7-4e3f-8448-e89750ea1ab6 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:45.292715 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2801374a-b31f-47d6-bd4c-f8ab8034a2db None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:45.293127 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91028abc-7cc7-4e3f-8448-e89750ea1ab6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:45.293127 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91028abc-7cc7-4e3f-8448-e89750ea1ab6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:45.294267 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:45.294562 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91028abc-7cc7-4e3f-8448-e89750ea1ab6 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:45.312409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 539/1098] 10.222.0.57 () {56 vars in 1133 bytes} [Thu Jul 21 08:20:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:45.318185 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91028abc-7cc7-4e3f-8448-e89750ea1ab6 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:45.332470 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab06f28-e9d8-4359-bef6-e582c25d29d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:45.333324 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab06f28-e9d8-4359-bef6-e582c25d29d2 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:45.333638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab06f28-e9d8-4359-bef6-e582c25d29d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:45.333919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab06f28-e9d8-4359-bef6-e582c25d29d2 None admin] PATH_INFO: `/v3/projects/e28134be2e2d4f688755bcb78877502c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:45.335095 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab06f28-e9d8-4359-bef6-e582c25d29d2 None admin] RBAC: Authorizing `identity:get_project(project_id=e28134be2e2d4f688755bcb78877502c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:45.336525 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab06f28-e9d8-4359-bef6-e582c25d29d2 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:45.343275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 560/1099] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:20:45 2022] GET /identity/v3/projects/e28134be2e2d4f688755bcb78877502c => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:45.344262 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab06f28-e9d8-4359-bef6-e582c25d29d2 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:45.397376 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:45.415727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91028abc-7cc7-4e3f-8448-e89750ea1ab6 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:45.443532 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab06f28-e9d8-4359-bef6-e582c25d29d2 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:45.449884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1dce9-df5d-436a-aabc-0506d864624d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:45.450524 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1dce9-df5d-436a-aabc-0506d864624d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:45.450807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1dce9-df5d-436a-aabc-0506d864624d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:45.451073 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1dce9-df5d-436a-aabc-0506d864624d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:45.477883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5d945-b900-46d9-ae08-f3b35b02d09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:45.478598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5d945-b900-46d9-ae08-f3b35b02d09f None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:45.478968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5d945-b900-46d9-ae08-f3b35b02d09f None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:45.479256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5d945-b900-46d9-ae08-f3b35b02d09f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:45.480077 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5d945-b900-46d9-ae08-f3b35b02d09f None admin] RBAC: Adding query filter params (role.id=beed8caad097496292e544146859df5c, scope.project.id=e28134be2e2d4f688755bcb78877502c, user.id=c8a8e62f990f43a7b4b169eeb89bc30c) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:45.480387 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5d945-b900-46d9-ae08-f3b35b02d09f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:45.481834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f5d945-b900-46d9-ae08-f3b35b02d09f None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:45.487794 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 561/1100] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:20:45 2022] GET /identity/v3/role_assignments?user.id=c8a8e62f990f43a7b4b169eeb89bc30c&scope.project.id=e28134be2e2d4f688755bcb78877502c&role.id=beed8caad097496292e544146859df5c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:45.518621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1dce9-df5d-436a-aabc-0506d864624d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:45.520108 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1dce9-df5d-436a-aabc-0506d864624d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:45.604369 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:45.624581 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 540/1101] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:20:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 08:20:45.630571 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5d945-b900-46d9-ae08-f3b35b02d09f None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:45.666092 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:45.731969 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f5d945-b900-46d9-ae08-f3b35b02d09f None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:45.769408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28293be-4d1f-49e6-9352-1ad5defef4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:45.770226 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28293be-4d1f-49e6-9352-1ad5defef4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:45.770507 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28293be-4d1f-49e6-9352-1ad5defef4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:45.770781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28293be-4d1f-49e6-9352-1ad5defef4f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:45.780946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28293be-4d1f-49e6-9352-1ad5defef4f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:45.782428 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28293be-4d1f-49e6-9352-1ad5defef4f1 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:45.800168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-e28293be-4d1f-49e6-9352-1ad5defef4f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:45.800168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:45.800168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:45.800168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:45.800168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:45.800168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:45.800168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:45.800168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:45.800168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:45.800168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:45.800168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:45.800168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:45.800168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:20:45.800168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:20:45.800168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:20:45.801301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:20:45.801301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:45.801301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:45.801301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:45.801301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:45.801301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:45.801301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:45.801301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:45.801301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:45.801301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:45.801301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:45.801301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:45.801301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:45.801301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:45.801301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:45.801301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:45.801301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:45.802528 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:20:45.802528 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:20:45.802528 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:20:45.802528 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:45.802528 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 562/1102] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:20:45.807659 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1dce9-df5d-436a-aabc-0506d864624d None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:45.909325 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1dce9-df5d-436a-aabc-0506d864624d None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:45.942097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46c48d-3334-40b1-ae6b-9e75c77b1f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:45.942749 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46c48d-3334-40b1-ae6b-9e75c77b1f13 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:45.943029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46c48d-3334-40b1-ae6b-9e75c77b1f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:45.943302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46c48d-3334-40b1-ae6b-9e75c77b1f13 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:45.944022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46c48d-3334-40b1-ae6b-9e75c77b1f13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:45.944329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46c48d-3334-40b1-ae6b-9e75c77b1f13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:45.945734 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46c48d-3334-40b1-ae6b-9e75c77b1f13 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:45.956938 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 541/1103] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:45.963238 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28293be-4d1f-49e6-9352-1ad5defef4f1 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:46.046642 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:46.060409 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28293be-4d1f-49e6-9352-1ad5defef4f1 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:46.093261 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a09fd-d9a9-4d9b-8044-3fb66d1a3bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:46.094059 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a09fd-d9a9-4d9b-8044-3fb66d1a3bff None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:46.094343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a09fd-d9a9-4d9b-8044-3fb66d1a3bff None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:46.094616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a09fd-d9a9-4d9b-8044-3fb66d1a3bff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:46.100994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a09fd-d9a9-4d9b-8044-3fb66d1a3bff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:46.103367 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a09fd-d9a9-4d9b-8044-3fb66d1a3bff None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:46.116849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-c50a09fd-d9a9-4d9b-8044-3fb66d1a3bff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:46.116849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:20:46.116849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:20:46.116849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:20:46.116849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:20:46.116849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:20:46.116849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:20:46.116849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:20:46.116849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:20:46.116849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:20:46.116849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:20:46.116849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:20:46.116849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:20:46.116849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:20:46.116849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:20:46.117786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:20:46.117786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:20:46.117786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:20:46.117786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:20:46.117786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:20:46.117786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:20:46.117786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:20:46.117786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:20:46.117786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:20:46.117786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:20:46.117786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:20:46.117786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:20:46.117786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:20:46.117786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:20:46.117786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:20:46.117786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:20:46.117786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:20:46.118689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:20:46.118689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:20:46.118689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:20:46.118689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:20:46.118689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:20:46.118689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:20:46.118689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:20:46.118689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:20:46.118689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 563/1104] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:20:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:20:46.123984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46c48d-3334-40b1-ae6b-9e75c77b1f13 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:46.167639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:46.225742 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46c48d-3334-40b1-ae6b-9e75c77b1f13 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:46.259232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85602fec-65bb-4e32-8008-868d487184bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:46.259887 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85602fec-65bb-4e32-8008-868d487184bd None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:46.260163 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85602fec-65bb-4e32-8008-868d487184bd None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:46.260438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85602fec-65bb-4e32-8008-868d487184bd None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:46.261215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85602fec-65bb-4e32-8008-868d487184bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:46.261542 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85602fec-65bb-4e32-8008-868d487184bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:46.262966 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85602fec-65bb-4e32-8008-868d487184bd None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:46.275525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 542/1105] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:20:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:46.281572 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a09fd-d9a9-4d9b-8044-3fb66d1a3bff None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:46.376416 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a09fd-d9a9-4d9b-8044-3fb66d1a3bff None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:46.408656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46d99f-d876-4912-a3fc-3e6a5f7d7a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:46.409282 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d99f-d876-4912-a3fc-3e6a5f7d7a71 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:46.409586 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d99f-d876-4912-a3fc-3e6a5f7d7a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:46.409861 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46d99f-d876-4912-a3fc-3e6a5f7d7a71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:46.410669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46d99f-d876-4912-a3fc-3e6a5f7d7a71 None admin] RBAC: Adding query filter params (role.id=fca61019937a482aa7bea9176fe21f2a, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=b6670a010c034f7999c9445452c02473) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:46.410977 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46d99f-d876-4912-a3fc-3e6a5f7d7a71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:46.412380 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46d99f-d876-4912-a3fc-3e6a5f7d7a71 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:46.418083 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 564/1106] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:20:46 2022] GET /identity/v3/role_assignments?user.id=b6670a010c034f7999c9445452c02473&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=fca61019937a482aa7bea9176fe21f2a => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:47.551610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cae394-6cb6-4b57-8a17-d2749d9f6a43 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:47.552143 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cae394-6cb6-4b57-8a17-d2749d9f6a43 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:47.552143 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cae394-6cb6-4b57-8a17-d2749d9f6a43 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:47.553547 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 543/1107] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:47.559262 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390c549-75be-4c8f-8e26-de380b098798 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:47.559676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390c549-75be-4c8f-8e26-de380b098798 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:47.559834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390c549-75be-4c8f-8e26-de380b098798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:47.577507 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-5390c549-75be-4c8f-8e26-de380b098798 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:47.578747 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5390c549-75be-4c8f-8e26-de380b098798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:47.581426 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:47.642727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 565/1108] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:20:47.667155 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cae394-6cb6-4b57-8a17-d2749d9f6a43 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:47.762536 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:47.768768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cae394-6cb6-4b57-8a17-d2749d9f6a43 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:47.807915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4b1e6-d7ee-4d2e-aa09-11ad244c733f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:47.808683 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4b1e6-d7ee-4d2e-aa09-11ad244c733f None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:47.808971 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4b1e6-d7ee-4d2e-aa09-11ad244c733f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:47.809248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4b1e6-d7ee-4d2e-aa09-11ad244c733f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:47.810450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4b1e6-d7ee-4d2e-aa09-11ad244c733f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:47.811879 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4b1e6-d7ee-4d2e-aa09-11ad244c733f None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:47.813497 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 544/1109] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:47.819265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390c549-75be-4c8f-8e26-de380b098798 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:47.915900 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390c549-75be-4c8f-8e26-de380b098798 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:47.948613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512fa16-205e-4176-abb5-4bd887807ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:47.949270 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512fa16-205e-4176-abb5-4bd887807ea7 None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:47.949572 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512fa16-205e-4176-abb5-4bd887807ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:47.949851 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512fa16-205e-4176-abb5-4bd887807ea7 None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:47.950542 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512fa16-205e-4176-abb5-4bd887807ea7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:47.951970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512fa16-205e-4176-abb5-4bd887807ea7 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:47.961264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:48.037082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 566/1110] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 08:20:47 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:20:50.072097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035f569-6163-42c2-804c-ef0e30d6635b None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:50.072598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035f569-6163-42c2-804c-ef0e30d6635b None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:50.072598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035f569-6163-42c2-804c-ef0e30d6635b None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:50.073939 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 545/1111] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:50.079193 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e89d5a-4320-4dff-a2e6-484dd6ae57fc None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:50.079585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e89d5a-4320-4dff-a2e6-484dd6ae57fc None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:50.079756 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e89d5a-4320-4dff-a2e6-484dd6ae57fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:50.099166 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-d5e89d5a-4320-4dff-a2e6-484dd6ae57fc None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:50.100346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-d5e89d5a-4320-4dff-a2e6-484dd6ae57fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:50.165190 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 567/1112] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:50.187843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035f569-6163-42c2-804c-ef0e30d6635b None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:50.287988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035f569-6163-42c2-804c-ef0e30d6635b None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:50.321169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e5a13-2188-4c39-bc10-7d9581a42174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:50.322025 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e5a13-2188-4c39-bc10-7d9581a42174 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:50.322356 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e5a13-2188-4c39-bc10-7d9581a42174 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:50.322582 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e5a13-2188-4c39-bc10-7d9581a42174 None admin] PATH_INFO: `/v3/roles/f6c74bb34f9c4b0faaf6a21007abcaa5` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:50.324083 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e5a13-2188-4c39-bc10-7d9581a42174 None admin] RBAC: Authorizing `identity:get_role(role_id=f6c74bb34f9c4b0faaf6a21007abcaa5)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:50.325478 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e5a13-2188-4c39-bc10-7d9581a42174 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:50.326860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 546/1113] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:20:50 2022] GET /identity/v3/roles/f6c74bb34f9c4b0faaf6a21007abcaa5 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:50.332668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e89d5a-4320-4dff-a2e6-484dd6ae57fc None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:50.427271 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e89d5a-4320-4dff-a2e6-484dd6ae57fc None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:50.452412 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:50.460685 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab037857-3c0e-4866-ace6-be2cc70554a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:50.461625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab037857-3c0e-4866-ace6-be2cc70554a7 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:50.461905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab037857-3c0e-4866-ace6-be2cc70554a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:50.467659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab037857-3c0e-4866-ace6-be2cc70554a7 None admin] PATH_INFO: `/v3/users/9b6ea3c101fa4f918b934bcb6ce4bf14` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:50.474651 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab037857-3c0e-4866-ace6-be2cc70554a7 None admin] RBAC: Authorizing `identity:get_user(user_id=9b6ea3c101fa4f918b934bcb6ce4bf14)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:50.476336 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab037857-3c0e-4866-ace6-be2cc70554a7 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:50.477999 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 568/1114] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:20:50 2022] GET /identity/v3/users/9b6ea3c101fa4f918b934bcb6ce4bf14 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:50.483697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e5a13-2188-4c39-bc10-7d9581a42174 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:50.518403 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:50.580854 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e5a13-2188-4c39-bc10-7d9581a42174 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:50.613986 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cb04b-5f26-4fc2-8414-d45a72fa8790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:50.614611 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cb04b-5f26-4fc2-8414-d45a72fa8790 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:50.614892 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cb04b-5f26-4fc2-8414-d45a72fa8790 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:50.615167 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cb04b-5f26-4fc2-8414-d45a72fa8790 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:50.678553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5cb04b-5f26-4fc2-8414-d45a72fa8790 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:50.680505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5cb04b-5f26-4fc2-8414-d45a72fa8790 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:50.712074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:50.776130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 547/1115] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:20:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:20:50.781882 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab037857-3c0e-4866-ace6-be2cc70554a7 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:50.878073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab037857-3c0e-4866-ace6-be2cc70554a7 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:50.910084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d8c3d-8437-4dd0-95ff-47b2b0706919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:50.910918 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d8c3d-8437-4dd0-95ff-47b2b0706919 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:50.911200 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d8c3d-8437-4dd0-95ff-47b2b0706919 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:50.911475 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d8c3d-8437-4dd0-95ff-47b2b0706919 None admin] PATH_INFO: `/v3/projects/e28134be2e2d4f688755bcb78877502c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:50.912635 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d8c3d-8437-4dd0-95ff-47b2b0706919 None admin] RBAC: Authorizing `identity:get_project(project_id=e28134be2e2d4f688755bcb78877502c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:50.914599 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d8c3d-8437-4dd0-95ff-47b2b0706919 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:50.916245 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 569/1116] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:20:50 2022] GET /identity/v3/projects/e28134be2e2d4f688755bcb78877502c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:50.922023 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cb04b-5f26-4fc2-8414-d45a72fa8790 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:51.017640 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cb04b-5f26-4fc2-8414-d45a72fa8790 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:51.052875 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a9df7-9b8b-4fb7-9d05-f88647e76607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:51.053509 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a9df7-9b8b-4fb7-9d05-f88647e76607 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:51.053816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a9df7-9b8b-4fb7-9d05-f88647e76607 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:51.054106 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a9df7-9b8b-4fb7-9d05-f88647e76607 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:51.055552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a9df7-9b8b-4fb7-9d05-f88647e76607 None admin] RBAC: Adding query filter params (role.id=f6c74bb34f9c4b0faaf6a21007abcaa5, scope.project.id=e28134be2e2d4f688755bcb78877502c, user.id=9b6ea3c101fa4f918b934bcb6ce4bf14) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:51.055857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a9df7-9b8b-4fb7-9d05-f88647e76607 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:51.057270 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a9df7-9b8b-4fb7-9d05-f88647e76607 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:51.060009 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:51.062805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 548/1117] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:20:50 2022] GET /identity/v3/role_assignments?user.id=9b6ea3c101fa4f918b934bcb6ce4bf14&scope.project.id=e28134be2e2d4f688755bcb78877502c&role.id=f6c74bb34f9c4b0faaf6a21007abcaa5 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:53.049983 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc52b2-58ed-4c76-9cf1-892b4dd4c0eb None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:53.050538 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc52b2-58ed-4c76-9cf1-892b4dd4c0eb None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:53.050538 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc52b2-58ed-4c76-9cf1-892b4dd4c0eb None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:53.051828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 570/1118] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:53.057516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b1c84-1962-46d5-b868-c8bf5f154aff None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:53.057977 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b1c84-1962-46d5-b868-c8bf5f154aff None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:53.058076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b1c84-1962-46d5-b868-c8bf5f154aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:53.074225 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-f43b1c84-1962-46d5-b868-c8bf5f154aff None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:53.075386 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f43b1c84-1962-46d5-b868-c8bf5f154aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:53.139175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 549/1119] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:20:53.161537 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc52b2-58ed-4c76-9cf1-892b4dd4c0eb None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:53.215396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:53.261284 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc52b2-58ed-4c76-9cf1-892b4dd4c0eb None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:53.297399 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183f9d5-969a-43b2-a93c-c23e98ee7b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:53.298265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183f9d5-969a-43b2-a93c-c23e98ee7b47 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:53.298546 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183f9d5-969a-43b2-a93c-c23e98ee7b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:53.298821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183f9d5-969a-43b2-a93c-c23e98ee7b47 None admin] PATH_INFO: `/v3/roles/f6c74bb34f9c4b0faaf6a21007abcaa5` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:53.300333 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183f9d5-969a-43b2-a93c-c23e98ee7b47 None admin] RBAC: Authorizing `identity:get_role(role_id=f6c74bb34f9c4b0faaf6a21007abcaa5)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:53.301685 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183f9d5-969a-43b2-a93c-c23e98ee7b47 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:53.303040 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 571/1120] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:20:53 2022] GET /identity/v3/roles/f6c74bb34f9c4b0faaf6a21007abcaa5 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:53.309434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b1c84-1962-46d5-b868-c8bf5f154aff None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:53.406976 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b1c84-1962-46d5-b868-c8bf5f154aff None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:53.434660 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:53.440401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb642c-9223-4cfd-aa2d-38a2c0c39e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:53.441260 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb642c-9223-4cfd-aa2d-38a2c0c39e04 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:53.441565 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb642c-9223-4cfd-aa2d-38a2c0c39e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:53.441904 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb642c-9223-4cfd-aa2d-38a2c0c39e04 None admin] PATH_INFO: `/v3/users/9b6ea3c101fa4f918b934bcb6ce4bf14` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:53.443040 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb642c-9223-4cfd-aa2d-38a2c0c39e04 None admin] RBAC: Authorizing `identity:get_user(user_id=9b6ea3c101fa4f918b934bcb6ce4bf14)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:53.444496 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb642c-9223-4cfd-aa2d-38a2c0c39e04 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:53.446148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 550/1121] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:20:53 2022] GET /identity/v3/users/9b6ea3c101fa4f918b934bcb6ce4bf14 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:53.451928 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183f9d5-969a-43b2-a93c-c23e98ee7b47 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:53.548005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183f9d5-969a-43b2-a93c-c23e98ee7b47 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:53.567028 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:53.580120 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafa276-55ec-4682-ad57-9a6843d58cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:53.593026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafa276-55ec-4682-ad57-9a6843d58cba None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:53.593026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafa276-55ec-4682-ad57-9a6843d58cba None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:53.593026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafa276-55ec-4682-ad57-9a6843d58cba None admin] PATH_INFO: `/v3/projects/e28134be2e2d4f688755bcb78877502c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:53.593026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafa276-55ec-4682-ad57-9a6843d58cba None admin] RBAC: Authorizing `identity:get_project(project_id=e28134be2e2d4f688755bcb78877502c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:53.593026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafa276-55ec-4682-ad57-9a6843d58cba None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:53.593026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 572/1122] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:20:53 2022] GET /identity/v3/projects/e28134be2e2d4f688755bcb78877502c => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:53.593569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb642c-9223-4cfd-aa2d-38a2c0c39e04 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:53.688627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb642c-9223-4cfd-aa2d-38a2c0c39e04 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:53.721884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1a446-b725-41e2-b8c8-bfc600f37987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:53.722751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1a446-b725-41e2-b8c8-bfc600f37987 None admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:53.723030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1a446-b725-41e2-b8c8-bfc600f37987 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:53.723302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1a446-b725-41e2-b8c8-bfc600f37987 None admin] PATH_INFO: `/v3/projects/e28134be2e2d4f688755bcb78877502c/users/9b6ea3c101fa4f918b934bcb6ce4bf14/roles/f6c74bb34f9c4b0faaf6a21007abcaa5` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:53.725474 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1a446-b725-41e2-b8c8-bfc600f37987 None admin] RBAC: Authorizing `identity:create_grant(project_id=e28134be2e2d4f688755bcb78877502c, user_id=9b6ea3c101fa4f918b934bcb6ce4bf14, role_id=f6c74bb34f9c4b0faaf6a21007abcaa5)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:53.727203 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1a446-b725-41e2-b8c8-bfc600f37987 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:53.801570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 551/1123] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:20:53 2022] PUT /identity/v3/projects/e28134be2e2d4f688755bcb78877502c/users/9b6ea3c101fa4f918b934bcb6ce4bf14/roles/f6c74bb34f9c4b0faaf6a21007abcaa5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:20:55.812289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca738f9-2cb8-438b-9dda-b72cdbd98f99 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:55.812783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca738f9-2cb8-438b-9dda-b72cdbd98f99 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:55.812888 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca738f9-2cb8-438b-9dda-b72cdbd98f99 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:55.814240 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 573/1124] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:55.819550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d316e-d297-4fe5-8dc4-fae996394861 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:55.819964 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d316e-d297-4fe5-8dc4-fae996394861 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:55.820629 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d316e-d297-4fe5-8dc4-fae996394861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:55.837457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-0c3d316e-d297-4fe5-8dc4-fae996394861 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:55.838635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-0c3d316e-d297-4fe5-8dc4-fae996394861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:55.890101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:55.903004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 552/1125] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:55.926025 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca738f9-2cb8-438b-9dda-b72cdbd98f99 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:56.023906 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca738f9-2cb8-438b-9dda-b72cdbd98f99 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:56.057126 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c31f56-eeac-460b-b9ba-0909d6a6ce0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:56.057999 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c31f56-eeac-460b-b9ba-0909d6a6ce0b None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:56.058277 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c31f56-eeac-460b-b9ba-0909d6a6ce0b None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:56.059526 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c31f56-eeac-460b-b9ba-0909d6a6ce0b None admin] PATH_INFO: `/v3/roles/f6c74bb34f9c4b0faaf6a21007abcaa5` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:56.060987 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c31f56-eeac-460b-b9ba-0909d6a6ce0b None admin] RBAC: Authorizing `identity:get_role(role_id=f6c74bb34f9c4b0faaf6a21007abcaa5)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:56.062373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c31f56-eeac-460b-b9ba-0909d6a6ce0b None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:56.063730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 574/1126] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:20:55 2022] GET /identity/v3/roles/f6c74bb34f9c4b0faaf6a21007abcaa5 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:56.069550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d316e-d297-4fe5-8dc4-fae996394861 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:56.164322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d316e-d297-4fe5-8dc4-fae996394861 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:56.196816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21c1fb-3399-4f3e-b543-296e0d4ea41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:56.197690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21c1fb-3399-4f3e-b543-296e0d4ea41a None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:56.197976 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21c1fb-3399-4f3e-b543-296e0d4ea41a None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:56.198248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21c1fb-3399-4f3e-b543-296e0d4ea41a None admin] PATH_INFO: `/v3/users/9b6ea3c101fa4f918b934bcb6ce4bf14` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:56.199421 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21c1fb-3399-4f3e-b543-296e0d4ea41a None admin] RBAC: Authorizing `identity:get_user(user_id=9b6ea3c101fa4f918b934bcb6ce4bf14)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:56.200844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21c1fb-3399-4f3e-b543-296e0d4ea41a None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:56.202475 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 553/1127] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:20:56 2022] GET /identity/v3/users/9b6ea3c101fa4f918b934bcb6ce4bf14 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:20:56.208259 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c31f56-eeac-460b-b9ba-0909d6a6ce0b None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:56.263143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:56.305490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c31f56-eeac-460b-b9ba-0909d6a6ce0b None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:56.338369 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc609211-514c-490b-9ff7-f37f9e6c4c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:56.339005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc609211-514c-490b-9ff7-f37f9e6c4c9d None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:56.339289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc609211-514c-490b-9ff7-f37f9e6c4c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:56.339564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc609211-514c-490b-9ff7-f37f9e6c4c9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:56.409112 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc609211-514c-490b-9ff7-f37f9e6c4c9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:56.410608 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc609211-514c-490b-9ff7-f37f9e6c4c9d None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:56.464938 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:56.508161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 575/1128] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:20:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 08:20:56.514072 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21c1fb-3399-4f3e-b543-296e0d4ea41a None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:56.569757 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:56.611647 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21c1fb-3399-4f3e-b543-296e0d4ea41a None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:56.643284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f9f96-3412-444b-96fc-d5a35f7e0a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:56.644124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f9f96-3412-444b-96fc-d5a35f7e0a6c None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:56.644408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f9f96-3412-444b-96fc-d5a35f7e0a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:56.644681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f9f96-3412-444b-96fc-d5a35f7e0a6c None admin] PATH_INFO: `/v3/projects/e28134be2e2d4f688755bcb78877502c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:56.645876 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f9f96-3412-444b-96fc-d5a35f7e0a6c None admin] RBAC: Authorizing `identity:get_project(project_id=e28134be2e2d4f688755bcb78877502c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:56.647300 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f9f96-3412-444b-96fc-d5a35f7e0a6c None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:56.649482 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 554/1129] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:20:56 2022] GET /identity/v3/projects/e28134be2e2d4f688755bcb78877502c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:56.655530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc609211-514c-490b-9ff7-f37f9e6c4c9d None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:56.750632 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc609211-514c-490b-9ff7-f37f9e6c4c9d None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:56.785129 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba3611-a02e-4037-97a6-7d228151bf20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:56.786038 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba3611-a02e-4037-97a6-7d228151bf20 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:56.786325 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba3611-a02e-4037-97a6-7d228151bf20 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:56.786600 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba3611-a02e-4037-97a6-7d228151bf20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:56.787420 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba3611-a02e-4037-97a6-7d228151bf20 None admin] RBAC: Adding query filter params (role.id=f6c74bb34f9c4b0faaf6a21007abcaa5, scope.project.id=e28134be2e2d4f688755bcb78877502c, user.id=9b6ea3c101fa4f918b934bcb6ce4bf14) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:20:56.787733 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba3611-a02e-4037-97a6-7d228151bf20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:56.789288 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba3611-a02e-4037-97a6-7d228151bf20 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:56.796163 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 576/1130] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:20:56 2022] GET /identity/v3/role_assignments?user.id=9b6ea3c101fa4f918b934bcb6ce4bf14&scope.project.id=e28134be2e2d4f688755bcb78877502c&role.id=f6c74bb34f9c4b0faaf6a21007abcaa5 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:58.819004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1e8f4-8ddc-4034-9e79-7be76530ed05 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:58.819505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1e8f4-8ddc-4034-9e79-7be76530ed05 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:58.819598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1e8f4-8ddc-4034-9e79-7be76530ed05 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:58.820948 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 555/1131] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:20:58.826162 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ac74a-4ae1-4a47-a8d0-359172d1ec13 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:58.826536 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ac74a-4ae1-4a47-a8d0-359172d1ec13 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:58.826728 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ac74a-4ae1-4a47-a8d0-359172d1ec13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:58.844297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-d70ac74a-4ae1-4a47-a8d0-359172d1ec13 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:20:58.845514 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-d70ac74a-4ae1-4a47-a8d0-359172d1ec13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:20:58.859996 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:58.911072 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 577/1132] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:20:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:20:58.934370 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1e8f4-8ddc-4034-9e79-7be76530ed05 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:59.033117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1e8f4-8ddc-4034-9e79-7be76530ed05 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:59.055464 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:20:59.065699 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7565188-05de-4a71-b19c-cab465a2793f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:59.066626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7565188-05de-4a71-b19c-cab465a2793f None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:59.066920 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7565188-05de-4a71-b19c-cab465a2793f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:59.067196 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7565188-05de-4a71-b19c-cab465a2793f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:59.068366 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7565188-05de-4a71-b19c-cab465a2793f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:59.070320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7565188-05de-4a71-b19c-cab465a2793f None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:59.072077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 556/1133] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:20:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:20:59.077836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ac74a-4ae1-4a47-a8d0-359172d1ec13 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:20:59.173057 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ac74a-4ae1-4a47-a8d0-359172d1ec13 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:20:59.205596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e16a24-fed9-45b0-ae61-a8ab525ab6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:20:59.206241 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e16a24-fed9-45b0-ae61-a8ab525ab6f2 None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:20:59.206524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e16a24-fed9-45b0-ae61-a8ab525ab6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:20:59.206798 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e16a24-fed9-45b0-ae61-a8ab525ab6f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:20:59.207489 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e16a24-fed9-45b0-ae61-a8ab525ab6f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:20:59.208916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e16a24-fed9-45b0-ae61-a8ab525ab6f2 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:20:59.301516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 578/1134] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 08:20:59 2022] POST /identity/v3/projects => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:21:01.334847 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e854c5b-110c-4a8c-aa8a-b9f87d7ff9fb None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:01.335416 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e854c5b-110c-4a8c-aa8a-b9f87d7ff9fb None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:01.335416 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e854c5b-110c-4a8c-aa8a-b9f87d7ff9fb None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:01.336775 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 557/1135] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:01.341932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a8a31-8730-471f-a574-f7345c8d6e5b None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:01.342316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a8a31-8730-471f-a574-f7345c8d6e5b None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:01.342504 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a8a31-8730-471f-a574-f7345c8d6e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:01.347538 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:01.360066 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-130a8a31-8730-471f-a574-f7345c8d6e5b None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:01.361931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-130a8a31-8730-471f-a574-f7345c8d6e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:01.427012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 579/1136] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:21:01.451724 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e854c5b-110c-4a8c-aa8a-b9f87d7ff9fb None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:01.549040 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e854c5b-110c-4a8c-aa8a-b9f87d7ff9fb None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:01.581736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f943b73-2aec-448a-b6c8-a9b5132c2a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:01.582497 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f943b73-2aec-448a-b6c8-a9b5132c2a45 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:01.582775 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f943b73-2aec-448a-b6c8-a9b5132c2a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:01.583046 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f943b73-2aec-448a-b6c8-a9b5132c2a45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:01.584195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f943b73-2aec-448a-b6c8-a9b5132c2a45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:01.586197 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f943b73-2aec-448a-b6c8-a9b5132c2a45 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:01.587729 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 558/1137] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:21:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:01.593382 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a8a31-8730-471f-a574-f7345c8d6e5b None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:01.688856 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a8a31-8730-471f-a574-f7345c8d6e5b None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:01.717005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:01.721787 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93dc92-e1ef-4ca6-acde-0e4e9508bb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:01.722443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93dc92-e1ef-4ca6-acde-0e4e9508bb6a None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:01.722723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93dc92-e1ef-4ca6-acde-0e4e9508bb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:01.722995 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93dc92-e1ef-4ca6-acde-0e4e9508bb6a None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:01.723685 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93dc92-e1ef-4ca6-acde-0e4e9508bb6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:01.725108 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93dc92-e1ef-4ca6-acde-0e4e9508bb6a None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:01.836135 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 580/1138] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 08:21:01 2022] POST /identity/v3/users => generated 286 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:21:03.875704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b5102-4a2f-4a51-bb21-ae78f90e2970 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:03.876264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b5102-4a2f-4a51-bb21-ae78f90e2970 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:03.876264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0b5102-4a2f-4a51-bb21-ae78f90e2970 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:03.877653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 559/1139] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:03.883901 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fd42a-d32a-44f1-ac5f-2bf6007896b5 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:03.884285 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fd42a-d32a-44f1-ac5f-2bf6007896b5 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:03.884457 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fd42a-d32a-44f1-ac5f-2bf6007896b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:03.900751 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-d65fd42a-d32a-44f1-ac5f-2bf6007896b5 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:03.902111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-d65fd42a-d32a-44f1-ac5f-2bf6007896b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:03.966224 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 581/1140] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:21:03.989416 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b5102-4a2f-4a51-bb21-ae78f90e2970 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:04.047356 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:04.087512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0b5102-4a2f-4a51-bb21-ae78f90e2970 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:04.121144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e5b32-7f4c-4321-a1c4-9fd71e70c5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:04.122028 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e5b32-7f4c-4321-a1c4-9fd71e70c5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:04.122319 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e5b32-7f4c-4321-a1c4-9fd71e70c5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:04.122595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e5b32-7f4c-4321-a1c4-9fd71e70c5c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:04.134051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e5b32-7f4c-4321-a1c4-9fd71e70c5c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:21:04.141603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-6c6e5b32-7f4c-4321-a1c4-9fd71e70c5c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:21:04.141603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:21:04.141603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:21:04.141603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:21:04.141603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:21:04.141603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:21:04.141603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:21:04.141603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:21:04.141603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:21:04.141603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:21:04.141603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:21:04.141603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:21:04.141603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:21:04.141603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:21:04.141603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:21:04.141603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:21:04.142807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:21:04.142807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:21:04.142807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:21:04.142807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:21:04.142807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:21:04.142807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:21:04.142807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:21:04.142807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:21:04.142807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:21:04.142807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:21:04.142807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:21:04.142807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:21:04.142807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:21:04.142807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:21:04.142807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:21:04.142807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:21:04.143899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:21:04.143899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:21:04.143899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:21:04.143899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:21:04.143899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:21:04.143899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:21:04.143899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:21:04.143899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:21:04.143899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:21:04.143899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:21:04.143899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:21:04.143899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:21:04.143899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 560/1141] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:21:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:21:04.148870 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fd42a-d32a-44f1-ac5f-2bf6007896b5 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:04.244819 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fd42a-d32a-44f1-ac5f-2bf6007896b5 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:04.261337 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:04.277504 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76073f9-f1fb-4fb0-b2cf-1c90bdd994f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:04.278187 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76073f9-f1fb-4fb0-b2cf-1c90bdd994f8 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:04.278468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76073f9-f1fb-4fb0-b2cf-1c90bdd994f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:04.278743 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76073f9-f1fb-4fb0-b2cf-1c90bdd994f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:04.279483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76073f9-f1fb-4fb0-b2cf-1c90bdd994f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:21:04.279788 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76073f9-f1fb-4fb0-b2cf-1c90bdd994f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:04.281144 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76073f9-f1fb-4fb0-b2cf-1c90bdd994f8 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:04.290056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 582/1142] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:21:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:04.295808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e5b32-7f4c-4321-a1c4-9fd71e70c5c4 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:04.392640 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e5b32-7f4c-4321-a1c4-9fd71e70c5c4 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:04.411205 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:04.424959 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9160d-2be6-45fa-8321-ec9e39694ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:04.427004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9160d-2be6-45fa-8321-ec9e39694ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:04.427004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9160d-2be6-45fa-8321-ec9e39694ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:04.427004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9160d-2be6-45fa-8321-ec9e39694ec3 None admin] PATH_INFO: `/v3/users/c2299b307060424a9c62742b400822eb` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:04.439862 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9160d-2be6-45fa-8321-ec9e39694ec3 None admin] RBAC: Authorizing `identity:get_user(user_id=c2299b307060424a9c62742b400822eb)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:04.441283 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9160d-2be6-45fa-8321-ec9e39694ec3 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:04.442929 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 561/1143] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:21:04 2022] GET /identity/v3/users/c2299b307060424a9c62742b400822eb => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:04.448626 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76073f9-f1fb-4fb0-b2cf-1c90bdd994f8 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:04.543490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76073f9-f1fb-4fb0-b2cf-1c90bdd994f8 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:04.575190 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2400e4c-262a-4a59-962d-bb21a73f7749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:04.575808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2400e4c-262a-4a59-962d-bb21a73f7749 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:04.576085 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2400e4c-262a-4a59-962d-bb21a73f7749 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:04.576354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2400e4c-262a-4a59-962d-bb21a73f7749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:04.622274 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:04.641175 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2400e4c-262a-4a59-962d-bb21a73f7749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:04.642633 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2400e4c-262a-4a59-962d-bb21a73f7749 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:04.738338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 583/1144] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:21:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:21:04.744164 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9160d-2be6-45fa-8321-ec9e39694ec3 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:04.839420 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9160d-2be6-45fa-8321-ec9e39694ec3 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:04.872056 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fd536-98c5-4e95-9796-87ea79349713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:04.872895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fd536-98c5-4e95-9796-87ea79349713 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:04.873179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fd536-98c5-4e95-9796-87ea79349713 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:04.873454 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fd536-98c5-4e95-9796-87ea79349713 None admin] PATH_INFO: `/v3/projects/ec5257a331194d3fbf29b39e3400a3e8` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:04.874661 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fd536-98c5-4e95-9796-87ea79349713 None admin] RBAC: Authorizing `identity:get_project(project_id=ec5257a331194d3fbf29b39e3400a3e8)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:04.876091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fd536-98c5-4e95-9796-87ea79349713 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:04.877808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 562/1145] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:21:04 2022] GET /identity/v3/projects/ec5257a331194d3fbf29b39e3400a3e8 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:04.883745 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2400e4c-262a-4a59-962d-bb21a73f7749 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:04.959519 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:04.978612 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2400e4c-262a-4a59-962d-bb21a73f7749 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:05.011300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efa163-2711-425b-a762-85bef3293d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:05.011871 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efa163-2711-425b-a762-85bef3293d8f None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:05.012150 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efa163-2711-425b-a762-85bef3293d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:05.012420 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efa163-2711-425b-a762-85bef3293d8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:05.013226 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1efa163-2711-425b-a762-85bef3293d8f None admin] RBAC: Adding query filter params (role.id=beed8caad097496292e544146859df5c, scope.project.id=ec5257a331194d3fbf29b39e3400a3e8, user.id=c2299b307060424a9c62742b400822eb) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:21:05.013547 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1efa163-2711-425b-a762-85bef3293d8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:05.014971 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1efa163-2711-425b-a762-85bef3293d8f None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:05.020182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 584/1146] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:21:04 2022] GET /identity/v3/role_assignments?user.id=c2299b307060424a9c62742b400822eb&scope.project.id=ec5257a331194d3fbf29b39e3400a3e8&role.id=beed8caad097496292e544146859df5c => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:07.003619 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54484418-e8e2-480e-9a79-d835c8ea4ce4 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:07.014011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54484418-e8e2-480e-9a79-d835c8ea4ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:07.014011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54484418-e8e2-480e-9a79-d835c8ea4ce4 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:07.014011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 563/1147] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:07.014350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a074580-83bc-449e-a919-cb45c4a8af27 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:07.014350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a074580-83bc-449e-a919-cb45c4a8af27 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:07.014350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a074580-83bc-449e-a919-cb45c4a8af27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:07.028422 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-0a074580-83bc-449e-a919-cb45c4a8af27 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:07.029636 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-0a074580-83bc-449e-a919-cb45c4a8af27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:07.094923 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 585/1148] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:21:07.117758 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54484418-e8e2-480e-9a79-d835c8ea4ce4 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:07.163755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:07.215884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54484418-e8e2-480e-9a79-d835c8ea4ce4 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:07.251394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14373e4f-53a1-4190-ab05-a502550736f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:07.252174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14373e4f-53a1-4190-ab05-a502550736f4 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:07.252460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14373e4f-53a1-4190-ab05-a502550736f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:07.252738 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14373e4f-53a1-4190-ab05-a502550736f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:07.262672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14373e4f-53a1-4190-ab05-a502550736f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:21:07.270337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-14373e4f-53a1-4190-ab05-a502550736f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:21:07.270337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:21:07.270337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:21:07.270337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:21:07.270337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:21:07.270337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:21:07.270337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:21:07.270337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:21:07.270337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:21:07.270337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:21:07.270337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:21:07.270337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:21:07.270337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:21:07.270337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:21:07.270337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:21:07.270337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:21:07.271436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:21:07.271436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:21:07.271436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:21:07.271436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:21:07.271436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:21:07.271436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:21:07.271436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:21:07.271436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:21:07.271436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:21:07.271436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:21:07.271436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:21:07.271436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:21:07.271436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:21:07.271436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:21:07.271436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:21:07.271436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:21:07.272302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:21:07.272302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:21:07.272302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:21:07.272302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:21:07.272302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:21:07.272302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:21:07.272302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:21:07.272302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:21:07.272302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:21:07.272302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:21:07.272302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:21:07.272302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:21:07.272302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 564/1149] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:21:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:21:07.277468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a074580-83bc-449e-a919-cb45c4a8af27 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:07.350231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:07.375054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a074580-83bc-449e-a919-cb45c4a8af27 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:07.407663 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0c2b8-bd0d-463e-ab51-ecde4f4c9d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:07.408317 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0c2b8-bd0d-463e-ab51-ecde4f4c9d92 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:07.408597 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0c2b8-bd0d-463e-ab51-ecde4f4c9d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:07.408871 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0c2b8-bd0d-463e-ab51-ecde4f4c9d92 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:07.409633 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0c2b8-bd0d-463e-ab51-ecde4f4c9d92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:21:07.409940 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0c2b8-bd0d-463e-ab51-ecde4f4c9d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:07.411304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0c2b8-bd0d-463e-ab51-ecde4f4c9d92 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:07.419609 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 586/1150] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:21:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:07.425486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14373e4f-53a1-4190-ab05-a502550736f4 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:07.520851 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14373e4f-53a1-4190-ab05-a502550736f4 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:07.527354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:07.553006 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab369bd-f17b-4324-9963-a27559e9d3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:07.554491 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab369bd-f17b-4324-9963-a27559e9d3fe None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:07.554775 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab369bd-f17b-4324-9963-a27559e9d3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:07.555046 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab369bd-f17b-4324-9963-a27559e9d3fe None admin] PATH_INFO: `/v3/users/c2299b307060424a9c62742b400822eb` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:07.556261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab369bd-f17b-4324-9963-a27559e9d3fe None admin] RBAC: Authorizing `identity:get_user(user_id=c2299b307060424a9c62742b400822eb)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:07.558111 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab369bd-f17b-4324-9963-a27559e9d3fe None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:07.559952 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 565/1151] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:21:07 2022] GET /identity/v3/users/c2299b307060424a9c62742b400822eb => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:07.565825 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0c2b8-bd0d-463e-ab51-ecde4f4c9d92 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:07.662707 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0c2b8-bd0d-463e-ab51-ecde4f4c9d92 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:07.695028 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd7dbf-14d6-4bf3-a854-f440e6dadcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:07.695854 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd7dbf-14d6-4bf3-a854-f440e6dadcb9 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:07.696136 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd7dbf-14d6-4bf3-a854-f440e6dadcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:07.696410 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd7dbf-14d6-4bf3-a854-f440e6dadcb9 None admin] PATH_INFO: `/v3/projects/ec5257a331194d3fbf29b39e3400a3e8` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:07.697599 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd7dbf-14d6-4bf3-a854-f440e6dadcb9 None admin] RBAC: Authorizing `identity:get_project(project_id=ec5257a331194d3fbf29b39e3400a3e8)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:07.699023 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd7dbf-14d6-4bf3-a854-f440e6dadcb9 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:07.700670 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 587/1152] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:21:07 2022] GET /identity/v3/projects/ec5257a331194d3fbf29b39e3400a3e8 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:07.706397 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab369bd-f17b-4324-9963-a27559e9d3fe None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:07.804747 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab369bd-f17b-4324-9963-a27559e9d3fe None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:07.836850 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf4fb1-8658-4e16-85bb-3c85bc8d3dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:07.837745 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf4fb1-8658-4e16-85bb-3c85bc8d3dcf None admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:07.838036 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf4fb1-8658-4e16-85bb-3c85bc8d3dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:07.838315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf4fb1-8658-4e16-85bb-3c85bc8d3dcf None admin] PATH_INFO: `/v3/projects/ec5257a331194d3fbf29b39e3400a3e8/users/c2299b307060424a9c62742b400822eb/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:07.840280 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf4fb1-8658-4e16-85bb-3c85bc8d3dcf None admin] RBAC: Authorizing `identity:create_grant(project_id=ec5257a331194d3fbf29b39e3400a3e8, user_id=c2299b307060424a9c62742b400822eb, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:07.841743 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf4fb1-8658-4e16-85bb-3c85bc8d3dcf None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:07.951680 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 566/1153] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:21:07 2022] PUT /identity/v3/projects/ec5257a331194d3fbf29b39e3400a3e8/users/c2299b307060424a9c62742b400822eb/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:21:09.947700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e17ee5-27db-41ae-b6c3-92b36377a98b None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:09.948251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e17ee5-27db-41ae-b6c3-92b36377a98b None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:09.948251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e17ee5-27db-41ae-b6c3-92b36377a98b None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:09.949736 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 588/1154] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:21:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:09.954668 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989a499-a07c-47ca-8a52-6c562f89aa86 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:09.955081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989a499-a07c-47ca-8a52-6c562f89aa86 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:09.955235 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989a499-a07c-47ca-8a52-6c562f89aa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:09.972040 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-4989a499-a07c-47ca-8a52-6c562f89aa86 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:09.973225 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-4989a499-a07c-47ca-8a52-6c562f89aa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:09.999439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:10.039494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 567/1155] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:21:10.064055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e17ee5-27db-41ae-b6c3-92b36377a98b None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:10.068769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:10.167021 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e17ee5-27db-41ae-b6c3-92b36377a98b None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:10.201290 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63367e62-7988-4b4c-97e0-929cb75baed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:10.202112 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63367e62-7988-4b4c-97e0-929cb75baed1 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:10.202398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63367e62-7988-4b4c-97e0-929cb75baed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:10.202703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63367e62-7988-4b4c-97e0-929cb75baed1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:10.213859 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63367e62-7988-4b4c-97e0-929cb75baed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:21:10.221433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-63367e62-7988-4b4c-97e0-929cb75baed1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:21:10.221433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:21:10.221433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:21:10.221433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:21:10.221433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:21:10.221433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:21:10.221433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:21:10.221433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:21:10.221433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:21:10.221433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:21:10.221433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:21:10.221433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:21:10.221433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:21:10.221433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:21:10.221433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:21:10.221433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:21:10.222523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:21:10.222523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:21:10.222523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:21:10.222523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:21:10.222523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:21:10.222523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:21:10.222523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:21:10.222523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:21:10.222523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:21:10.222523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:21:10.222523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:21:10.222523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:21:10.222523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:21:10.222523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:21:10.222523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:21:10.222523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:21:10.223682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:21:10.223682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:21:10.223682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:21:10.223682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:21:10.223682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:21:10.223682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:21:10.223682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:21:10.223682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:21:10.223682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:21:10.223682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:21:10.223682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:21:10.223682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:21:10.223682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 589/1156] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:21:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:21:10.228942 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989a499-a07c-47ca-8a52-6c562f89aa86 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:10.324890 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989a499-a07c-47ca-8a52-6c562f89aa86 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:10.357192 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e9b38-9dac-480b-bbe9-7e06ce1565c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:10.357860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e9b38-9dac-480b-bbe9-7e06ce1565c7 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:10.358138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e9b38-9dac-480b-bbe9-7e06ce1565c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:10.358408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292e9b38-9dac-480b-bbe9-7e06ce1565c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:10.359140 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e9b38-9dac-480b-bbe9-7e06ce1565c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:21:10.359443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e9b38-9dac-480b-bbe9-7e06ce1565c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:10.360792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292e9b38-9dac-480b-bbe9-7e06ce1565c7 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:10.368510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 568/1157] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:21:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:10.374185 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63367e62-7988-4b4c-97e0-929cb75baed1 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:10.435173 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:10.472087 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63367e62-7988-4b4c-97e0-929cb75baed1 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:10.504612 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c4d61-fca5-4496-9936-566dcb51ff26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:10.505452 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c4d61-fca5-4496-9936-566dcb51ff26 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:10.505759 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c4d61-fca5-4496-9936-566dcb51ff26 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:10.506031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c4d61-fca5-4496-9936-566dcb51ff26 None admin] PATH_INFO: `/v3/users/c2299b307060424a9c62742b400822eb` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:10.507720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c4d61-fca5-4496-9936-566dcb51ff26 None admin] RBAC: Authorizing `identity:get_user(user_id=c2299b307060424a9c62742b400822eb)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:10.509141 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c4d61-fca5-4496-9936-566dcb51ff26 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:10.510777 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 590/1158] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:21:10 2022] GET /identity/v3/users/c2299b307060424a9c62742b400822eb => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:10.516483 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e9b38-9dac-480b-bbe9-7e06ce1565c7 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:10.544030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:10.613956 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292e9b38-9dac-480b-bbe9-7e06ce1565c7 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:10.646613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd58b4-2118-47e3-8de9-619ea4725b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:10.647239 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd58b4-2118-47e3-8de9-619ea4725b59 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:10.647549 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd58b4-2118-47e3-8de9-619ea4725b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:10.647826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd58b4-2118-47e3-8de9-619ea4725b59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:10.712352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd58b4-2118-47e3-8de9-619ea4725b59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:10.713831 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd58b4-2118-47e3-8de9-619ea4725b59 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:10.738511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:10.808961 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 569/1159] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:21:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:21:10.814814 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c4d61-fca5-4496-9936-566dcb51ff26 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:10.910133 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c4d61-fca5-4496-9936-566dcb51ff26 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:10.938046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:10.942894 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028d157-478b-4fda-8979-2302b6591ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:10.943745 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028d157-478b-4fda-8979-2302b6591ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:10.944027 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028d157-478b-4fda-8979-2302b6591ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:10.944878 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028d157-478b-4fda-8979-2302b6591ea3 None admin] PATH_INFO: `/v3/projects/ec5257a331194d3fbf29b39e3400a3e8` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:10.946216 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028d157-478b-4fda-8979-2302b6591ea3 None admin] RBAC: Authorizing `identity:get_project(project_id=ec5257a331194d3fbf29b39e3400a3e8)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:10.950921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028d157-478b-4fda-8979-2302b6591ea3 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:10.950921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 591/1160] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:21:10 2022] GET /identity/v3/projects/ec5257a331194d3fbf29b39e3400a3e8 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:10.955369 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd58b4-2118-47e3-8de9-619ea4725b59 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:11.050858 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd58b4-2118-47e3-8de9-619ea4725b59 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:11.075622 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:11.083819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7151f-02d9-4593-bfcb-23ec96e91655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:11.084450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7151f-02d9-4593-bfcb-23ec96e91655 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:11.084732 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7151f-02d9-4593-bfcb-23ec96e91655 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:11.085032 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7151f-02d9-4593-bfcb-23ec96e91655 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:11.085896 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7151f-02d9-4593-bfcb-23ec96e91655 None admin] RBAC: Adding query filter params (role.id=beed8caad097496292e544146859df5c, scope.project.id=ec5257a331194d3fbf29b39e3400a3e8, user.id=c2299b307060424a9c62742b400822eb) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:21:11.086217 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7151f-02d9-4593-bfcb-23ec96e91655 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:11.087641 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7151f-02d9-4593-bfcb-23ec96e91655 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:11.093229 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 570/1161] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:21:10 2022] GET /identity/v3/role_assignments?user.id=c2299b307060424a9c62742b400822eb&scope.project.id=ec5257a331194d3fbf29b39e3400a3e8&role.id=beed8caad097496292e544146859df5c => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:13.141457 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf1d43-22d6-47c4-8b03-ba93a6e741c4 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:13.142024 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf1d43-22d6-47c4-8b03-ba93a6e741c4 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:13.142211 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf1d43-22d6-47c4-8b03-ba93a6e741c4 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:13.143568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 592/1162] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:13.149253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37441654-dfa2-4d19-aeae-1189d4f0b5e9 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:13.149685 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37441654-dfa2-4d19-aeae-1189d4f0b5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:13.149816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37441654-dfa2-4d19-aeae-1189d4f0b5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:13.166575 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-37441654-dfa2-4d19-aeae-1189d4f0b5e9 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:13.167734 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-37441654-dfa2-4d19-aeae-1189d4f0b5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:13.231159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 571/1163] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:21:13.252873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf1d43-22d6-47c4-8b03-ba93a6e741c4 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:13.351590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf1d43-22d6-47c4-8b03-ba93a6e741c4 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:13.384249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7fb4c-3706-4c47-8afb-583c03604036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:13.384882 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7fb4c-3706-4c47-8afb-583c03604036 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:13.385165 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7fb4c-3706-4c47-8afb-583c03604036 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:13.385441 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7fb4c-3706-4c47-8afb-583c03604036 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:13.449949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:13.452092 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7fb4c-3706-4c47-8afb-583c03604036 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:13.453582 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7fb4c-3706-4c47-8afb-583c03604036 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:13.551671 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 593/1164] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:21:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:21:13.558534 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37441654-dfa2-4d19-aeae-1189d4f0b5e9 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:13.653417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37441654-dfa2-4d19-aeae-1189d4f0b5e9 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:13.672096 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:13.685723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9f1d7-011b-4741-bb4b-38e6d0adbe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:13.686505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9f1d7-011b-4741-bb4b-38e6d0adbe1b None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:13.686781 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9f1d7-011b-4741-bb4b-38e6d0adbe1b None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:13.687067 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9f1d7-011b-4741-bb4b-38e6d0adbe1b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:13.693569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9f1d7-011b-4741-bb4b-38e6d0adbe1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:13.695575 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9f1d7-011b-4741-bb4b-38e6d0adbe1b None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:13.710291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-29c9f1d7-011b-4741-bb4b-38e6d0adbe1b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 08:21:13.710291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:21:13.710291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 21 08:21:13.710291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 21 08:21:13.710291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:21:13.710291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:21:13.710291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:21:13.710291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:21:13.710291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 21 08:21:13.710291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:21:13.710291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:21:13.710291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:21:13.710291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:21:13.710291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:21:13.710291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:21:13.710291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:21:13.710291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:21:13.712220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:21:13.712220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:21:13.712220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:21:13.712220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:21:13.712220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:21:13.712220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:21:13.712220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:21:13.712220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:21:13.712220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:21:13.712220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:21:13.712220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:21:13.712220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:21:13.712220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:21:13.712220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:21:13.712220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:21:13.712220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:21:13.713246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:21:13.713246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:21:13.713246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:21:13.713246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:21:13.713246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:21:13.713246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:21:13.713246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:21:13.713246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:21:13.713246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:21:13.713246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:21:13.713246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 21 08:21:13.713246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:21:13.713246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 08:21:13.713246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:21:13.713246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 572/1165] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Jul 21 08:21:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:21:13.717333 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7fb4c-3706-4c47-8afb-583c03604036 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:13.812469 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:13.815282 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7fb4c-3706-4c47-8afb-583c03604036 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:13.848063 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac555cc8-8a76-4f42-8542-92ffaa87d9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:13.848711 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac555cc8-8a76-4f42-8542-92ffaa87d9ba None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:13.848993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac555cc8-8a76-4f42-8542-92ffaa87d9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:13.849266 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac555cc8-8a76-4f42-8542-92ffaa87d9ba None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:13.850007 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac555cc8-8a76-4f42-8542-92ffaa87d9ba None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:21:13.850310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac555cc8-8a76-4f42-8542-92ffaa87d9ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:13.851946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac555cc8-8a76-4f42-8542-92ffaa87d9ba None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:13.858919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 594/1166] 10.222.0.57 () {56 vars in 1115 bytes} [Thu Jul 21 08:21:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:15.858032 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2033b1f-6671-4b66-a835-4c5e280f6f66 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:15.858535 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2033b1f-6671-4b66-a835-4c5e280f6f66 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:15.858650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2033b1f-6671-4b66-a835-4c5e280f6f66 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:15.859948 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 573/1167] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:15.865165 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f4840-0c55-4d43-92b3-cead13e30a9a None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:15.865555 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f4840-0c55-4d43-92b3-cead13e30a9a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:15.865747 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f4840-0c55-4d43-92b3-cead13e30a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:15.881978 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-149f4840-0c55-4d43-92b3-cead13e30a9a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:15.883146 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-149f4840-0c55-4d43-92b3-cead13e30a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:15.947552 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 595/1168] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:21:15.970370 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2033b1f-6671-4b66-a835-4c5e280f6f66 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:16.068096 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2033b1f-6671-4b66-a835-4c5e280f6f66 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:16.101463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e558b6-69a3-4702-a56a-eb7451eb9fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:16.102120 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e558b6-69a3-4702-a56a-eb7451eb9fea None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:16.102401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e558b6-69a3-4702-a56a-eb7451eb9fea None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:16.102673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e558b6-69a3-4702-a56a-eb7451eb9fea None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:16.103406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e558b6-69a3-4702-a56a-eb7451eb9fea None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:16.104770 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e558b6-69a3-4702-a56a-eb7451eb9fea None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:16.180375 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 574/1169] 10.222.0.57 () {60 vars in 1138 bytes} [Thu Jul 21 08:21:15 2022] POST /identity/v3/domains => generated 267 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:21:18.196416 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e54521-c073-4c17-bbc2-c9c8a95b1307 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:18.196983 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e54521-c073-4c17-bbc2-c9c8a95b1307 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:18.196983 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e54521-c073-4c17-bbc2-c9c8a95b1307 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:18.198378 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 596/1170] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:21:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:18.203375 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e03633-1dc6-427c-8ba0-06f19412ad5d None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:18.203785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e03633-1dc6-427c-8ba0-06f19412ad5d None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:18.203925 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e03633-1dc6-427c-8ba0-06f19412ad5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:18.220606 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-14e03633-1dc6-427c-8ba0-06f19412ad5d None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:18.221810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-14e03633-1dc6-427c-8ba0-06f19412ad5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:18.254698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:18.286326 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 575/1171] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:21:18.309680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e54521-c073-4c17-bbc2-c9c8a95b1307 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:18.399749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:18.406979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e54521-c073-4c17-bbc2-c9c8a95b1307 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:18.439542 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f497af-3dfb-49ba-af45-7d50ec67000c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:18.440380 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f497af-3dfb-49ba-af45-7d50ec67000c None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:18.440659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f497af-3dfb-49ba-af45-7d50ec67000c None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:18.440931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f497af-3dfb-49ba-af45-7d50ec67000c None admin] PATH_INFO: `/v3/domains/dfc18ecf7cc0468997e7c1e9a44a304b` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:18.451605 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f497af-3dfb-49ba-af45-7d50ec67000c None admin] RBAC: Authorizing `identity:get_domain(domain_id=dfc18ecf7cc0468997e7c1e9a44a304b)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:18.452978 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f497af-3dfb-49ba-af45-7d50ec67000c None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:18.454613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 597/1172] 10.222.0.57 () {56 vars in 1183 bytes} [Thu Jul 21 08:21:18 2022] GET /identity/v3/domains/dfc18ecf7cc0468997e7c1e9a44a304b => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:18.461029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e03633-1dc6-427c-8ba0-06f19412ad5d None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:18.555403 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e03633-1dc6-427c-8ba0-06f19412ad5d None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:18.588480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca05f4-3586-46ab-bb6c-6cf1302efccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:18.589119 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca05f4-3586-46ab-bb6c-6cf1302efccd None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:18.589398 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca05f4-3586-46ab-bb6c-6cf1302efccd None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:18.589697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca05f4-3586-46ab-bb6c-6cf1302efccd None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:18.590392 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca05f4-3586-46ab-bb6c-6cf1302efccd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:18.591815 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca05f4-3586-46ab-bb6c-6cf1302efccd None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:18.676850 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 576/1173] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 08:21:18 2022] POST /identity/v3/projects => generated 361 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:21:20.712804 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfa44a-e626-44cb-978f-7cbd3a07cd2c None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:20.713438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfa44a-e626-44cb-978f-7cbd3a07cd2c None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:20.713438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfa44a-e626-44cb-978f-7cbd3a07cd2c None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:20.714742 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 598/1174] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:21:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:20.719977 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c3349-eb32-42cc-baaf-ad186a5571ad None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:20.720378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c3349-eb32-42cc-baaf-ad186a5571ad None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:20.720517 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c3349-eb32-42cc-baaf-ad186a5571ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:20.737415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-401c3349-eb32-42cc-baaf-ad186a5571ad None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:20.738600 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-401c3349-eb32-42cc-baaf-ad186a5571ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:20.755058 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:20.805978 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 577/1175] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:21:20.830760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfa44a-e626-44cb-978f-7cbd3a07cd2c None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:20.929696 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfa44a-e626-44cb-978f-7cbd3a07cd2c None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:20.961019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0b88d-50f8-423a-a926-ab0791b6cf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:20.961886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0b88d-50f8-423a-a926-ab0791b6cf1c None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:20.962164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0b88d-50f8-423a-a926-ab0791b6cf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:20.962432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0b88d-50f8-423a-a926-ab0791b6cf1c None admin] PATH_INFO: `/v3/domains/dfc18ecf7cc0468997e7c1e9a44a304b` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:20.963639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0b88d-50f8-423a-a926-ab0791b6cf1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=dfc18ecf7cc0468997e7c1e9a44a304b)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:20.965005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0b88d-50f8-423a-a926-ab0791b6cf1c None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:20.966611 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 599/1176] 10.222.0.57 () {56 vars in 1183 bytes} [Thu Jul 21 08:21:20 2022] GET /identity/v3/domains/dfc18ecf7cc0468997e7c1e9a44a304b => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:20.972150 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c3349-eb32-42cc-baaf-ad186a5571ad None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:21.068721 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c3349-eb32-42cc-baaf-ad186a5571ad None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:21.102971 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faaec4-a2e4-446a-800b-6ea8be4c7a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:21.103621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faaec4-a2e4-446a-800b-6ea8be4c7a54 None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:21.103904 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faaec4-a2e4-446a-800b-6ea8be4c7a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:21.104181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faaec4-a2e4-446a-800b-6ea8be4c7a54 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:21.104891 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92faaec4-a2e4-446a-800b-6ea8be4c7a54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:21.106359 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92faaec4-a2e4-446a-800b-6ea8be4c7a54 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:21.190516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 578/1177] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 08:21:20 2022] POST /identity/v3/users => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:21:23.239421 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968818af-8b95-4f35-9c60-fcdbc603962d None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:23.240003 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968818af-8b95-4f35-9c60-fcdbc603962d None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:23.240003 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968818af-8b95-4f35-9c60-fcdbc603962d None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:23.241365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 600/1178] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:21:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:23.246582 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02139e-206d-49c9-bab6-e8bf7497c0c2 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:23.247024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02139e-206d-49c9-bab6-e8bf7497c0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:23.247146 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02139e-206d-49c9-bab6-e8bf7497c0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:23.264902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-7f02139e-206d-49c9-bab6-e8bf7497c0c2 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:23.266134 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7f02139e-206d-49c9-bab6-e8bf7497c0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:23.268119 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:23.331760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 579/1179] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:21:23.355255 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968818af-8b95-4f35-9c60-fcdbc603962d None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:23.379767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:23.457083 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968818af-8b95-4f35-9c60-fcdbc603962d None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:23.489803 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdd7fb-2e29-468a-b0e5-c8dd20c29e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:23.490514 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdd7fb-2e29-468a-b0e5-c8dd20c29e1e None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:23.491328 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdd7fb-2e29-468a-b0e5-c8dd20c29e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:23.491610 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdd7fb-2e29-468a-b0e5-c8dd20c29e1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:23.501977 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdd7fb-2e29-468a-b0e5-c8dd20c29e1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:21:23.510075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-3afdd7fb-2e29-468a-b0e5-c8dd20c29e1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:21:23.510075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:21:23.510075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:21:23.510075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:21:23.510075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:21:23.510075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:21:23.510075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:21:23.510075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:21:23.510075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:21:23.510075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:21:23.510075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:21:23.510075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:21:23.510075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:21:23.510075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:21:23.510075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:21:23.510075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:21:23.511256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:21:23.511256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:21:23.511256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:21:23.511256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:21:23.511256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:21:23.511256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:21:23.511256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:21:23.511256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:21:23.511256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:21:23.511256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:21:23.511256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:21:23.511256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:21:23.511256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:21:23.511256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:21:23.511256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:21:23.511256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:21:23.512339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:21:23.512339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:21:23.512339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:21:23.512339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:21:23.512339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:21:23.512339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:21:23.512339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:21:23.512339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:21:23.512339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:21:23.512339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:21:23.512339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:21:23.512339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:21:23.512339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 601/1180] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:21:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:21:23.517306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02139e-206d-49c9-bab6-e8bf7497c0c2 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:23.611556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02139e-206d-49c9-bab6-e8bf7497c0c2 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:23.644626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf24a3b-f57a-4723-bf18-74d550b33db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:23.645275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf24a3b-f57a-4723-bf18-74d550b33db8 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:23.645580 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf24a3b-f57a-4723-bf18-74d550b33db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:23.645857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf24a3b-f57a-4723-bf18-74d550b33db8 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:23.646595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf24a3b-f57a-4723-bf18-74d550b33db8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:21:23.646929 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf24a3b-f57a-4723-bf18-74d550b33db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:23.648316 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf24a3b-f57a-4723-bf18-74d550b33db8 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:23.653126 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:23.656417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 580/1181] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:21:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:23.662203 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdd7fb-2e29-468a-b0e5-c8dd20c29e1e None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:23.743704 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:23.761162 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdd7fb-2e29-468a-b0e5-c8dd20c29e1e None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:23.794980 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c3110-0cd9-4b7b-a4b4-b9bba22d8891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:23.795835 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c3110-0cd9-4b7b-a4b4-b9bba22d8891 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:23.796117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c3110-0cd9-4b7b-a4b4-b9bba22d8891 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:23.796391 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c3110-0cd9-4b7b-a4b4-b9bba22d8891 None admin] PATH_INFO: `/v3/users/3c13c8fa85a1473ea210cc7d409c5df6` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:23.809631 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c3110-0cd9-4b7b-a4b4-b9bba22d8891 None admin] RBAC: Authorizing `identity:get_user(user_id=3c13c8fa85a1473ea210cc7d409c5df6)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:23.811058 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c3110-0cd9-4b7b-a4b4-b9bba22d8891 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:23.812668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 602/1182] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:21:23 2022] GET /identity/v3/users/3c13c8fa85a1473ea210cc7d409c5df6 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:23.818402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf24a3b-f57a-4723-bf18-74d550b33db8 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:23.915255 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf24a3b-f57a-4723-bf18-74d550b33db8 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:23.947407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674dcfd-7caa-4bc1-9ba5-a7b98957a3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:23.948034 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674dcfd-7caa-4bc1-9ba5-a7b98957a3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:23.948320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674dcfd-7caa-4bc1-9ba5-a7b98957a3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:23.948595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674dcfd-7caa-4bc1-9ba5-a7b98957a3f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:24.011709 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:24.013826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674dcfd-7caa-4bc1-9ba5-a7b98957a3f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:24.015276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674dcfd-7caa-4bc1-9ba5-a7b98957a3f9 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:24.110134 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 581/1183] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:21:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:21:24.116118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c3110-0cd9-4b7b-a4b4-b9bba22d8891 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:24.212047 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c3110-0cd9-4b7b-a4b4-b9bba22d8891 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:24.245226 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aafdb1-89d9-4b00-9daf-3a6a0f72c379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:24.246102 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aafdb1-89d9-4b00-9daf-3a6a0f72c379 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:24.246385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aafdb1-89d9-4b00-9daf-3a6a0f72c379 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:24.246659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aafdb1-89d9-4b00-9daf-3a6a0f72c379 None admin] PATH_INFO: `/v3/projects/4d10ce1b77af4125a9e03f357f2c035e` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:24.247824 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aafdb1-89d9-4b00-9daf-3a6a0f72c379 None admin] RBAC: Authorizing `identity:get_project(project_id=4d10ce1b77af4125a9e03f357f2c035e)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:24.249249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aafdb1-89d9-4b00-9daf-3a6a0f72c379 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:24.250968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 603/1184] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:21:24 2022] GET /identity/v3/projects/4d10ce1b77af4125a9e03f357f2c035e => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:21:24.257152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674dcfd-7caa-4bc1-9ba5-a7b98957a3f9 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:24.353117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:24.355948 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674dcfd-7caa-4bc1-9ba5-a7b98957a3f9 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:24.387873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696494e-6fd2-447a-9331-cadf4f0f5a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:24.388507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696494e-6fd2-447a-9331-cadf4f0f5a63 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:24.388793 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696494e-6fd2-447a-9331-cadf4f0f5a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:24.389078 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696494e-6fd2-447a-9331-cadf4f0f5a63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:24.389944 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696494e-6fd2-447a-9331-cadf4f0f5a63 None admin] RBAC: Adding query filter params (role.id=beed8caad097496292e544146859df5c, scope.project.id=4d10ce1b77af4125a9e03f357f2c035e, user.id=3c13c8fa85a1473ea210cc7d409c5df6) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:21:24.390450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696494e-6fd2-447a-9331-cadf4f0f5a63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:24.392157 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696494e-6fd2-447a-9331-cadf4f0f5a63 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:24.398322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 582/1185] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:21:24 2022] GET /identity/v3/role_assignments?user.id=3c13c8fa85a1473ea210cc7d409c5df6&scope.project.id=4d10ce1b77af4125a9e03f357f2c035e&role.id=beed8caad097496292e544146859df5c => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:21:26.399361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a0b79-0039-4b8c-badd-18d9d46c50dd None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:26.399898 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a0b79-0039-4b8c-badd-18d9d46c50dd None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:26.399898 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a0b79-0039-4b8c-badd-18d9d46c50dd None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:26.401280 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 604/1186] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:21:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:26.406587 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695f7ec-9eee-4bf5-bd90-f431db6bdba4 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:26.407031 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695f7ec-9eee-4bf5-bd90-f431db6bdba4 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:26.407126 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695f7ec-9eee-4bf5-bd90-f431db6bdba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:26.424939 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-0695f7ec-9eee-4bf5-bd90-f431db6bdba4 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:26.426146 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-0695f7ec-9eee-4bf5-bd90-f431db6bdba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:26.489884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 583/1187] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 08:21:26.514117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a0b79-0039-4b8c-badd-18d9d46c50dd None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:26.525213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:26.611533 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a0b79-0039-4b8c-badd-18d9d46c50dd None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:26.643407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81499a95-c36b-49b7-80e9-2c4b86b2c277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:26.644171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81499a95-c36b-49b7-80e9-2c4b86b2c277 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:26.644451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81499a95-c36b-49b7-80e9-2c4b86b2c277 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:26.644723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81499a95-c36b-49b7-80e9-2c4b86b2c277 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:26.654900 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81499a95-c36b-49b7-80e9-2c4b86b2c277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:21:26.662298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-81499a95-c36b-49b7-80e9-2c4b86b2c277 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:21:26.662298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:21:26.662298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:21:26.662298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:21:26.662298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:21:26.662298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:21:26.662298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:21:26.662298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:21:26.662298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:21:26.662298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:21:26.662298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:21:26.662298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:21:26.662298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:21:26.662298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:21:26.662298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:21:26.662298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:21:26.663921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:21:26.663921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:21:26.663921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:21:26.663921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:21:26.663921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:21:26.663921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:21:26.663921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:21:26.663921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:21:26.663921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:21:26.663921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:21:26.663921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:21:26.663921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:21:26.663921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:21:26.663921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:21:26.663921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:21:26.663921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:21:26.664984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:21:26.664984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:21:26.664984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:21:26.664984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:21:26.664984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:21:26.664984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:21:26.664984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:21:26.664984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:21:26.664984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:21:26.664984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:21:26.664984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:21:26.664984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:21:26.664984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 605/1188] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:21:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:21:26.670202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695f7ec-9eee-4bf5-bd90-f431db6bdba4 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:26.758564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:26.764997 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695f7ec-9eee-4bf5-bd90-f431db6bdba4 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:26.798136 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27267f16-5024-4008-a150-2923adc883ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:26.798785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27267f16-5024-4008-a150-2923adc883ea None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:26.799067 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27267f16-5024-4008-a150-2923adc883ea None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:26.799347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27267f16-5024-4008-a150-2923adc883ea None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:26.800084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27267f16-5024-4008-a150-2923adc883ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:21:26.800391 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27267f16-5024-4008-a150-2923adc883ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:26.801771 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27267f16-5024-4008-a150-2923adc883ea None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:26.809736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 584/1189] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:21:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:26.815458 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81499a95-c36b-49b7-80e9-2c4b86b2c277 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:26.879522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:26.914571 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81499a95-c36b-49b7-80e9-2c4b86b2c277 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:26.951240 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb963a4e-9c62-4bd7-bb69-92c0d925c330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:26.952086 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb963a4e-9c62-4bd7-bb69-92c0d925c330 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:26.952363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb963a4e-9c62-4bd7-bb69-92c0d925c330 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:26.952635 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb963a4e-9c62-4bd7-bb69-92c0d925c330 None admin] PATH_INFO: `/v3/users/3c13c8fa85a1473ea210cc7d409c5df6` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:26.953817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb963a4e-9c62-4bd7-bb69-92c0d925c330 None admin] RBAC: Authorizing `identity:get_user(user_id=3c13c8fa85a1473ea210cc7d409c5df6)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:26.955246 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb963a4e-9c62-4bd7-bb69-92c0d925c330 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:26.956846 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 606/1190] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:21:26 2022] GET /identity/v3/users/3c13c8fa85a1473ea210cc7d409c5df6 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:26.963715 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27267f16-5024-4008-a150-2923adc883ea None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:27.060491 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27267f16-5024-4008-a150-2923adc883ea None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:27.093610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a7e4f-576c-4781-8dc1-1f94b9c7cfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:27.094465 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a7e4f-576c-4781-8dc1-1f94b9c7cfb1 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:27.094749 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a7e4f-576c-4781-8dc1-1f94b9c7cfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:27.095026 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a7e4f-576c-4781-8dc1-1f94b9c7cfb1 None admin] PATH_INFO: `/v3/projects/4d10ce1b77af4125a9e03f357f2c035e` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:27.096207 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a7e4f-576c-4781-8dc1-1f94b9c7cfb1 None admin] RBAC: Authorizing `identity:get_project(project_id=4d10ce1b77af4125a9e03f357f2c035e)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:27.097674 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a7e4f-576c-4781-8dc1-1f94b9c7cfb1 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:27.099370 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 585/1191] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:21:26 2022] GET /identity/v3/projects/4d10ce1b77af4125a9e03f357f2c035e => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:27.105724 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb963a4e-9c62-4bd7-bb69-92c0d925c330 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:27.201036 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb963a4e-9c62-4bd7-bb69-92c0d925c330 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:27.232493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74aba4f-ee49-4fe1-8a0f-967932ba1879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:27.233353 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aba4f-ee49-4fe1-8a0f-967932ba1879 None admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:27.233660 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aba4f-ee49-4fe1-8a0f-967932ba1879 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:27.233933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74aba4f-ee49-4fe1-8a0f-967932ba1879 None admin] PATH_INFO: `/v3/projects/4d10ce1b77af4125a9e03f357f2c035e/users/3c13c8fa85a1473ea210cc7d409c5df6/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:27.235842 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74aba4f-ee49-4fe1-8a0f-967932ba1879 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d10ce1b77af4125a9e03f357f2c035e, user_id=3c13c8fa85a1473ea210cc7d409c5df6, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:27.237244 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74aba4f-ee49-4fe1-8a0f-967932ba1879 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:27.240219 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:27.305278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 607/1192] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:21:27 2022] PUT /identity/v3/projects/4d10ce1b77af4125a9e03f357f2c035e/users/3c13c8fa85a1473ea210cc7d409c5df6/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:21:29.302046 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f719c-f9d5-4e5d-9b46-683dce1aa096 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:29.302598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f719c-f9d5-4e5d-9b46-683dce1aa096 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:29.302598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f719c-f9d5-4e5d-9b46-683dce1aa096 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:29.304481 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 586/1193] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:21:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:21:29.309851 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c5754-1ff3-40f3-bd7d-80b814ed44c7 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:29.310231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c5754-1ff3-40f3-bd7d-80b814ed44c7 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:29.310418 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c5754-1ff3-40f3-bd7d-80b814ed44c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:29.327391 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-930c5754-1ff3-40f3-bd7d-80b814ed44c7 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:21:29.328573 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-930c5754-1ff3-40f3-bd7d-80b814ed44c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:21:29.394069 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 608/1194] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:21:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:21:29.417390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f719c-f9d5-4e5d-9b46-683dce1aa096 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:29.442647 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:29.519071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f719c-f9d5-4e5d-9b46-683dce1aa096 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:29.550707 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559db94-f34c-440a-82fb-e5377f113191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:29.551481 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559db94-f34c-440a-82fb-e5377f113191 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:29.551763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559db94-f34c-440a-82fb-e5377f113191 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:29.552038 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559db94-f34c-440a-82fb-e5377f113191 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:29.562879 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559db94-f34c-440a-82fb-e5377f113191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:21:29.571054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-f559db94-f34c-440a-82fb-e5377f113191 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:21:29.571054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:21:29.571054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:21:29.571054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:21:29.571054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:21:29.571054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:21:29.571054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:21:29.571054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:21:29.571054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:21:29.571054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:21:29.571054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:21:29.571054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:21:29.571054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:21:29.571054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:21:29.571054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:21:29.571054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:21:29.572159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:21:29.572159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:21:29.572159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:21:29.572159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:21:29.572159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:21:29.572159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:21:29.572159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:21:29.572159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:21:29.572159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:21:29.572159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:21:29.572159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:21:29.572159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:21:29.572159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:21:29.572159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:21:29.572159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:21:29.572159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:21:29.573180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:21:29.573180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:21:29.573180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:21:29.573180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:21:29.573180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:21:29.573180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:21:29.573180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:21:29.573180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:21:29.573180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:21:29.573180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:21:29.573180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:21:29.573180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:21:29.573180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 587/1195] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:21:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:21:29.578232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c5754-1ff3-40f3-bd7d-80b814ed44c7 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:29.672366 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c5754-1ff3-40f3-bd7d-80b814ed44c7 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:29.697782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:29.706097 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b70eb0-b720-413c-aaa1-b34c369535e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:29.706747 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b70eb0-b720-413c-aaa1-b34c369535e3 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:29.709774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b70eb0-b720-413c-aaa1-b34c369535e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:29.709774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b70eb0-b720-413c-aaa1-b34c369535e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:29.709774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b70eb0-b720-413c-aaa1-b34c369535e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:21:29.709774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b70eb0-b720-413c-aaa1-b34c369535e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:29.709774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b70eb0-b720-413c-aaa1-b34c369535e3 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:29.717631 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 609/1196] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:21:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:29.723293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559db94-f34c-440a-82fb-e5377f113191 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:29.805077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:29.820276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559db94-f34c-440a-82fb-e5377f113191 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:29.853117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d948eb4-0f3f-444c-a5eb-436420319373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:29.853993 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d948eb4-0f3f-444c-a5eb-436420319373 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:29.854279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d948eb4-0f3f-444c-a5eb-436420319373 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:29.854555 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d948eb4-0f3f-444c-a5eb-436420319373 None admin] PATH_INFO: `/v3/users/3c13c8fa85a1473ea210cc7d409c5df6` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:29.855732 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d948eb4-0f3f-444c-a5eb-436420319373 None admin] RBAC: Authorizing `identity:get_user(user_id=3c13c8fa85a1473ea210cc7d409c5df6)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:29.857192 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d948eb4-0f3f-444c-a5eb-436420319373 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:29.858824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 588/1197] 10.222.0.57 () {56 vars in 1177 bytes} [Thu Jul 21 08:21:29 2022] GET /identity/v3/users/3c13c8fa85a1473ea210cc7d409c5df6 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:29.864522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b70eb0-b720-413c-aaa1-b34c369535e3 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:29.959015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b70eb0-b720-413c-aaa1-b34c369535e3 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:29.991344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69469dc-8f91-4594-92b4-4f7d90b25a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:29.992280 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69469dc-8f91-4594-92b4-4f7d90b25a0b None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:29.992557 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69469dc-8f91-4594-92b4-4f7d90b25a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:29.992825 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69469dc-8f91-4594-92b4-4f7d90b25a0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:30.044117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:30.056126 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69469dc-8f91-4594-92b4-4f7d90b25a0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:30.070023 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69469dc-8f91-4594-92b4-4f7d90b25a0b None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:30.150829 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 610/1198] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:21:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:21:30.156725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d948eb4-0f3f-444c-a5eb-436420319373 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:30.253288 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d948eb4-0f3f-444c-a5eb-436420319373 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:30.288150 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafde74-07ee-4bec-989e-ceba38a13d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:30.288980 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafde74-07ee-4bec-989e-ceba38a13d0f None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:30.289261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafde74-07ee-4bec-989e-ceba38a13d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:30.289556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafde74-07ee-4bec-989e-ceba38a13d0f None admin] PATH_INFO: `/v3/projects/4d10ce1b77af4125a9e03f357f2c035e` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:30.290726 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafde74-07ee-4bec-989e-ceba38a13d0f None admin] RBAC: Authorizing `identity:get_project(project_id=4d10ce1b77af4125a9e03f357f2c035e)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:30.292151 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafde74-07ee-4bec-989e-ceba38a13d0f None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:30.293854 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 589/1199] 10.222.0.57 () {56 vars in 1186 bytes} [Thu Jul 21 08:21:30 2022] GET /identity/v3/projects/4d10ce1b77af4125a9e03f357f2c035e => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:30.300145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69469dc-8f91-4594-92b4-4f7d90b25a0b None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:21:30.384297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:30.395659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69469dc-8f91-4594-92b4-4f7d90b25a0b None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:21:30.429385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a1190-26ce-4041-8071-fe5ac4be54d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:21:30.429993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a1190-26ce-4041-8071-fe5ac4be54d7 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:21:30.430276 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a1190-26ce-4041-8071-fe5ac4be54d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:21:30.430550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a1190-26ce-4041-8071-fe5ac4be54d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:21:30.431361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a1190-26ce-4041-8071-fe5ac4be54d7 None admin] RBAC: Adding query filter params (role.id=beed8caad097496292e544146859df5c, scope.project.id=4d10ce1b77af4125a9e03f357f2c035e, user.id=3c13c8fa85a1473ea210cc7d409c5df6) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:21:30.431672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a1190-26ce-4041-8071-fe5ac4be54d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:21:30.433079 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a1190-26ce-4041-8071-fe5ac4be54d7 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:21:30.438752 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 611/1200] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:21:30 2022] GET /identity/v3/role_assignments?user.id=3c13c8fa85a1473ea210cc7d409c5df6&scope.project.id=4d10ce1b77af4125a9e03f357f2c035e&role.id=beed8caad097496292e544146859df5c => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:21:40.283404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=90 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:21:40.436178 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=24 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:42.056874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa07893-304e-4acb-b44b-2fcca3e5e03a None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:42.057426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa07893-304e-4acb-b44b-2fcca3e5e03a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:42.057426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa07893-304e-4acb-b44b-2fcca3e5e03a None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:42.058732 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 590/1201] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:42.063738 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085525e9-c6d6-4775-b53d-a73838c206de None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:42.064178 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085525e9-c6d6-4775-b53d-a73838c206de None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:42.064283 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085525e9-c6d6-4775-b53d-a73838c206de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:42.081216 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-085525e9-c6d6-4775-b53d-a73838c206de None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:42.082429 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-085525e9-c6d6-4775-b53d-a73838c206de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:42.148427 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 612/1202] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:22:42.173384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa07893-304e-4acb-b44b-2fcca3e5e03a None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:42.276366 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa07893-304e-4acb-b44b-2fcca3e5e03a None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:42.310014 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e1783-42fc-4830-8f88-7666425e99e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:42.310730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e1783-42fc-4830-8f88-7666425e99e6 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:42.311014 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e1783-42fc-4830-8f88-7666425e99e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:42.311293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e1783-42fc-4830-8f88-7666425e99e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:42.321233 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e1783-42fc-4830-8f88-7666425e99e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:42.322705 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e1783-42fc-4830-8f88-7666425e99e6 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:42.340480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-aa9e1783-42fc-4830-8f88-7666425e99e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:22:42.340480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:42.340480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:42.340480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:42.340480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:42.340480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:42.340480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:42.340480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:42.340480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:42.340480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:42.340480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:42.340480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:42.340480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:22:42.340480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:22:42.340480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:22:42.341677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:22:42.341677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:42.341677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:42.341677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:42.341677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:42.341677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:42.341677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:42.341677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:42.341677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:42.341677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:42.341677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:42.341677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:42.341677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:42.341677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:42.341677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:42.341677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:42.341677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:42.342686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:22:42.342686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:22:42.342686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:22:42.342686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:22:42.342686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 591/1203] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:22:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:22:42.347840 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085525e9-c6d6-4775-b53d-a73838c206de None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:42.445891 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085525e9-c6d6-4775-b53d-a73838c206de None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:42.473500 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:42.480014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d419da7-f65a-43b9-97ad-49a50b30fd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:42.480665 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d419da7-f65a-43b9-97ad-49a50b30fd56 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:42.480942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d419da7-f65a-43b9-97ad-49a50b30fd56 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:42.481213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d419da7-f65a-43b9-97ad-49a50b30fd56 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:42.481948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d419da7-f65a-43b9-97ad-49a50b30fd56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:42.482250 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d419da7-f65a-43b9-97ad-49a50b30fd56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:42.483598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d419da7-f65a-43b9-97ad-49a50b30fd56 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:42.494414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 613/1204] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:22:42.500212 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e1783-42fc-4830-8f88-7666425e99e6 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:42.552024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:42.598324 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e1783-42fc-4830-8f88-7666425e99e6 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:42.632063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d050e69-7519-41b6-897e-d8f5ea4abc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:42.632712 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d050e69-7519-41b6-897e-d8f5ea4abc34 None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:42.632991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d050e69-7519-41b6-897e-d8f5ea4abc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:42.633261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d050e69-7519-41b6-897e-d8f5ea4abc34 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:42.633987 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d050e69-7519-41b6-897e-d8f5ea4abc34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:42.635409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d050e69-7519-41b6-897e-d8f5ea4abc34 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:42.714397 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 592/1205] 10.222.0.57 () {60 vars in 1132 bytes} [Thu Jul 21 08:22:42 2022] POST /identity/v3/users => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:22:44.770578 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c352858-e9fb-4165-831d-df67514305ac None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:44.775957 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c352858-e9fb-4165-831d-df67514305ac None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:44.775957 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c352858-e9fb-4165-831d-df67514305ac None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:44.775957 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 614/1206] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:44.778235 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ca465-69ec-468b-b8da-bd4a949b7178 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:44.778644 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ca465-69ec-468b-b8da-bd4a949b7178 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:44.778795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ca465-69ec-468b-b8da-bd4a949b7178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:44.796025 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-073ca465-69ec-468b-b8da-bd4a949b7178 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:44.797209 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-073ca465-69ec-468b-b8da-bd4a949b7178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:44.863219 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 593/1207] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:22:44.886431 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c352858-e9fb-4165-831d-df67514305ac None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:44.987958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c352858-e9fb-4165-831d-df67514305ac None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:45.020639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a22e6-72f0-4436-ace4-9b2ea4befad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:45.021354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a22e6-72f0-4436-ace4-9b2ea4befad6 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:45.021731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a22e6-72f0-4436-ace4-9b2ea4befad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:45.022013 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47a22e6-72f0-4436-ace4-9b2ea4befad6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:45.033413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47a22e6-72f0-4436-ace4-9b2ea4befad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:22:45.041253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-a47a22e6-72f0-4436-ace4-9b2ea4befad6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:22:45.041253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:45.041253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:45.041253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:45.041253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:45.041253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:45.041253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:45.041253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:45.041253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:45.041253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:45.041253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:45.041253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:45.041253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:22:45.041253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:22:45.041253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:22:45.041253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:22:45.042415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:22:45.042415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:22:45.042415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:22:45.042415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:22:45.042415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:45.042415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:45.042415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:45.042415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:45.042415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:45.042415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:45.042415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:45.042415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:45.042415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:45.042415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:45.042415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:45.042415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:45.043681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:45.043681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:45.043681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:45.043681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:45.043681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:22:45.043681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:22:45.043681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:22:45.043681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:22:45.043681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:22:45.043681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:22:45.043681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:22:45.043681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:22:45.043681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 615/1208] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:22:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 08:22:45.048413 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ca465-69ec-468b-b8da-bd4a949b7178 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:45.087785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:45.144809 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ca465-69ec-468b-b8da-bd4a949b7178 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:45.177254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee947d-a532-4eb6-9e90-959bde4ed195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:45.177998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee947d-a532-4eb6-9e90-959bde4ed195 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:45.178280 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee947d-a532-4eb6-9e90-959bde4ed195 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:45.178549 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee947d-a532-4eb6-9e90-959bde4ed195 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:45.179306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee947d-a532-4eb6-9e90-959bde4ed195 None admin] RBAC: Adding query filter params (name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:45.179608 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee947d-a532-4eb6-9e90-959bde4ed195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:45.180959 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee947d-a532-4eb6-9e90-959bde4ed195 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:45.189050 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 594/1209] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:22:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:22:45.195134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a22e6-72f0-4436-ace4-9b2ea4befad6 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:45.244869 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:45.293295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47a22e6-72f0-4436-ace4-9b2ea4befad6 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:45.327096 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b2380-3ea9-4e9e-bc17-b0148a8e43e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:45.327881 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b2380-3ea9-4e9e-bc17-b0148a8e43e4 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:45.328162 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b2380-3ea9-4e9e-bc17-b0148a8e43e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:45.328436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b2380-3ea9-4e9e-bc17-b0148a8e43e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:45.338875 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b2380-3ea9-4e9e-bc17-b0148a8e43e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:45.340314 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b2380-3ea9-4e9e-bc17-b0148a8e43e4 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:45.357549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-b24b2380-3ea9-4e9e-bc17-b0148a8e43e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:22:45.357549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:45.357549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:45.357549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:45.357549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:45.357549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:45.357549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:45.357549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:45.357549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:45.357549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:45.357549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:45.357549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:45.357549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:22:45.357549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:22:45.357549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:22:45.358511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:22:45.358511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:45.358511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:45.358511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:45.358511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:45.358511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:45.358511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:45.358511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:45.358511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:45.358511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:45.358511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:45.358511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:45.358511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:45.358511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:45.358511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:45.358511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:45.358511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:45.359561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:22:45.359561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:22:45.359561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:22:45.359561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:22:45.359561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 616/1210] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:22:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:22:45.364581 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee947d-a532-4eb6-9e90-959bde4ed195 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:45.460071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:45.463139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee947d-a532-4eb6-9e90-959bde4ed195 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:45.495782 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664e964-89b5-4da2-b076-583ab4aec59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:45.496431 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664e964-89b5-4da2-b076-583ab4aec59a None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:45.496717 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664e964-89b5-4da2-b076-583ab4aec59a None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:45.496993 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5664e964-89b5-4da2-b076-583ab4aec59a None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:45.497742 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664e964-89b5-4da2-b076-583ab4aec59a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:45.498051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664e964-89b5-4da2-b076-583ab4aec59a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:45.499420 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5664e964-89b5-4da2-b076-583ab4aec59a None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:45.511977 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 595/1211] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:22:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:22:45.517673 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b2380-3ea9-4e9e-bc17-b0148a8e43e4 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:45.623454 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b2380-3ea9-4e9e-bc17-b0148a8e43e4 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:45.624999 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:45.659613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e4a8a-0528-47d9-8ace-a5021786a814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:45.660479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e4a8a-0528-47d9-8ace-a5021786a814 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:45.660803 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e4a8a-0528-47d9-8ace-a5021786a814 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:45.661120 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e4a8a-0528-47d9-8ace-a5021786a814 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:45.668406 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e4a8a-0528-47d9-8ace-a5021786a814 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:45.669879 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e4a8a-0528-47d9-8ace-a5021786a814 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:45.684703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-f31e4a8a-0528-47d9-8ace-a5021786a814 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:22:45.684703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:45.684703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:45.684703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:45.684703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:45.684703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:45.684703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:45.684703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:45.684703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:45.684703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:45.684703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:45.684703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:45.684703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:22:45.684703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:22:45.684703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:22:45.684703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:22:45.685718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:45.685718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:45.685718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:22:45.685718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:22:45.685718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:22:45.685718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:22:45.685718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:45.685718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:45.685718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:45.685718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:45.685718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:45.685718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:45.685718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:45.685718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:45.685718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:45.685718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:45.685718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:45.685718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:45.686789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:45.686789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:45.686789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:22:45.686789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:22:45.686789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:22:45.686789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:22:45.686789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:22:45.686789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:22:45.686789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:22:45.686789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:22:45.689676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 617/1212] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:22:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:22:45.691992 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664e964-89b5-4da2-b076-583ab4aec59a None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:45.796622 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5664e964-89b5-4da2-b076-583ab4aec59a None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:45.830015 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41359748-16b7-4169-8c70-3774a2f3bb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:45.830671 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41359748-16b7-4169-8c70-3774a2f3bb95 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:45.830957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41359748-16b7-4169-8c70-3774a2f3bb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:45.831231 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41359748-16b7-4169-8c70-3774a2f3bb95 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:45.832064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41359748-16b7-4169-8c70-3774a2f3bb95 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:45.832374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41359748-16b7-4169-8c70-3774a2f3bb95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:45.833816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41359748-16b7-4169-8c70-3774a2f3bb95 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:45.851376 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 596/1213] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Jul 21 08:22:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:22:45.857732 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e4a8a-0528-47d9-8ace-a5021786a814 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:45.963886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e4a8a-0528-47d9-8ace-a5021786a814 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:46.001233 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851ec42-35f9-4227-b2c9-834b29688847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:46.001897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851ec42-35f9-4227-b2c9-834b29688847 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:46.002180 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851ec42-35f9-4227-b2c9-834b29688847 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:46.002455 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851ec42-35f9-4227-b2c9-834b29688847 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:46.031817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:46.069372 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851ec42-35f9-4227-b2c9-834b29688847 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:46.070866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851ec42-35f9-4227-b2c9-834b29688847 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:46.167121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 618/1214] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:22:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:22:46.173086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41359748-16b7-4169-8c70-3774a2f3bb95 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:46.191592 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:46.272051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41359748-16b7-4169-8c70-3774a2f3bb95 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:46.312146 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796ed0b-44e8-4a29-987a-108c7efe4f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:46.312929 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796ed0b-44e8-4a29-987a-108c7efe4f69 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:46.313216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796ed0b-44e8-4a29-987a-108c7efe4f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:46.313495 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796ed0b-44e8-4a29-987a-108c7efe4f69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:46.323220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796ed0b-44e8-4a29-987a-108c7efe4f69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:46.324666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796ed0b-44e8-4a29-987a-108c7efe4f69 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:46.342645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-1796ed0b-44e8-4a29-987a-108c7efe4f69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:22:46.342645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:46.342645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:46.342645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:46.342645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:46.342645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:46.342645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:46.342645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:46.342645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:46.342645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:46.342645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:46.342645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:46.342645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:22:46.342645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:22:46.342645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:22:46.343768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:22:46.343768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:46.343768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:46.343768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:46.343768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:46.343768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:46.343768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:46.343768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:46.343768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:46.343768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:46.343768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:46.343768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:46.343768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:46.343768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:46.343768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:46.343768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:46.343768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:46.344871 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:22:46.344871 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:22:46.344871 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:22:46.344871 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:22:46.344871 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 597/1215] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:22:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:22:46.350517 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851ec42-35f9-4227-b2c9-834b29688847 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:46.409357 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:46.446756 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851ec42-35f9-4227-b2c9-834b29688847 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:46.479638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1fcc6-6950-4693-af60-b43fd369ff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:46.480278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1fcc6-6950-4693-af60-b43fd369ff4a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:46.480556 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1fcc6-6950-4693-af60-b43fd369ff4a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:46.482479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1fcc6-6950-4693-af60-b43fd369ff4a None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:46.482479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1fcc6-6950-4693-af60-b43fd369ff4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:46.482479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1fcc6-6950-4693-af60-b43fd369ff4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:46.483319 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1fcc6-6950-4693-af60-b43fd369ff4a None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:46.494298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 619/1216] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:22:46.499855 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796ed0b-44e8-4a29-987a-108c7efe4f69 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:46.567508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:46.600150 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796ed0b-44e8-4a29-987a-108c7efe4f69 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:46.638673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875dcd3-0df3-4ae3-8ee4-e677d60ac74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:46.639450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875dcd3-0df3-4ae3-8ee4-e677d60ac74f None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:46.639726 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875dcd3-0df3-4ae3-8ee4-e677d60ac74f None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:46.639996 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875dcd3-0df3-4ae3-8ee4-e677d60ac74f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:46.646621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875dcd3-0df3-4ae3-8ee4-e677d60ac74f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:46.648714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875dcd3-0df3-4ae3-8ee4-e677d60ac74f None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:46.662080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-7875dcd3-0df3-4ae3-8ee4-e677d60ac74f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:22:46.662080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:46.662080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:46.662080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:46.662080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:46.662080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:46.662080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:46.662080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:46.662080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:46.662080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:46.662080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:46.662080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:46.662080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:22:46.662080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:22:46.662080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:22:46.663011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:22:46.663011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:46.663011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:46.663011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:46.663011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:46.663011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:46.663011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:46.663011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:46.663011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:46.663011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:46.663011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:46.663011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:46.663011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:46.663011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:46.663011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:46.663011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:46.663011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:46.664022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:22:46.664022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:22:46.664022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:22:46.664022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:22:46.664022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:22:46.664022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:22:46.664022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:22:46.664022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:22:46.664022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 598/1217] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:22:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:22:46.669130 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1fcc6-6950-4693-af60-b43fd369ff4a None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:46.768087 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1fcc6-6950-4693-af60-b43fd369ff4a None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:46.792481 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:46.803692 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5430465-d934-459e-9344-42b34cf819a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:46.804376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5430465-d934-459e-9344-42b34cf819a1 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:46.804662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5430465-d934-459e-9344-42b34cf819a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:46.804939 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5430465-d934-459e-9344-42b34cf819a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:46.805742 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5430465-d934-459e-9344-42b34cf819a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:46.806054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5430465-d934-459e-9344-42b34cf819a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:46.807558 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5430465-d934-459e-9344-42b34cf819a1 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:46.819310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 620/1218] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:22:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:22:46.825937 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875dcd3-0df3-4ae3-8ee4-e677d60ac74f None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:46.923904 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875dcd3-0df3-4ae3-8ee4-e677d60ac74f None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:46.953434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:46.959139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ff8c8-ad5f-40a8-a2a7-c2237fb57d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:46.959785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ff8c8-ad5f-40a8-a2a7-c2237fb57d65 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:46.960065 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ff8c8-ad5f-40a8-a2a7-c2237fb57d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:46.960336 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ff8c8-ad5f-40a8-a2a7-c2237fb57d65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:46.961155 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ff8c8-ad5f-40a8-a2a7-c2237fb57d65 None admin] RBAC: Adding query filter params (role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=4e38b7e84d6a43efbb4c1a52e2b3e681) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:46.961465 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ff8c8-ad5f-40a8-a2a7-c2237fb57d65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:46.962955 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ff8c8-ad5f-40a8-a2a7-c2237fb57d65 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:46.968323 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 599/1219] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:22:46 2022] GET /identity/v3/role_assignments?user.id=4e38b7e84d6a43efbb4c1a52e2b3e681&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:22:48.980367 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c05147-9a1f-4dad-8c54-e073029d10e0 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:48.980892 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c05147-9a1f-4dad-8c54-e073029d10e0 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:48.980892 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c05147-9a1f-4dad-8c54-e073029d10e0 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:48.982315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 621/1220] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:48.987538 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d68816-48b6-44cf-a2b2-8e43405540f9 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:48.988003 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d68816-48b6-44cf-a2b2-8e43405540f9 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:48.988104 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d68816-48b6-44cf-a2b2-8e43405540f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:49.009736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-01d68816-48b6-44cf-a2b2-8e43405540f9 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:49.009736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-01d68816-48b6-44cf-a2b2-8e43405540f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:49.073802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 600/1221] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:22:49.097565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c05147-9a1f-4dad-8c54-e073029d10e0 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:49.199332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c05147-9a1f-4dad-8c54-e073029d10e0 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:49.231854 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da673d8d-122f-4589-928c-6d0001cf1397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:49.232637 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da673d8d-122f-4589-928c-6d0001cf1397 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:49.232920 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da673d8d-122f-4589-928c-6d0001cf1397 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:49.233196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da673d8d-122f-4589-928c-6d0001cf1397 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:49.243695 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da673d8d-122f-4589-928c-6d0001cf1397 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:22:49.251413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-da673d8d-122f-4589-928c-6d0001cf1397 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:22:49.251413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:49.251413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:49.251413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:49.251413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:49.251413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:49.251413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:49.251413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:49.251413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:49.251413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:49.251413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:49.251413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:49.251413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:22:49.251413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:22:49.251413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:22:49.251413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:22:49.252545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:22:49.252545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:22:49.252545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:22:49.252545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:22:49.252545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:49.252545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:49.252545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:49.252545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:49.252545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:49.252545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:49.252545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:49.252545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:49.252545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:49.252545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:49.252545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:49.252545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:49.253414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:49.253414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:49.253414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:49.253414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:49.253414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:22:49.253414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:22:49.253414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:22:49.253414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:22:49.253414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:22:49.253414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:22:49.253414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:22:49.253414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:22:49.253414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 622/1222] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:22:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:22:49.259567 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d68816-48b6-44cf-a2b2-8e43405540f9 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:49.355016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d68816-48b6-44cf-a2b2-8e43405540f9 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:49.377913 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:49.389070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63df3bf-e845-4cb9-87aa-2d023f83af04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:49.389761 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63df3bf-e845-4cb9-87aa-2d023f83af04 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:49.390042 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63df3bf-e845-4cb9-87aa-2d023f83af04 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:49.390315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63df3bf-e845-4cb9-87aa-2d023f83af04 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:49.391058 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63df3bf-e845-4cb9-87aa-2d023f83af04 None admin] RBAC: Adding query filter params (name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:49.391366 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63df3bf-e845-4cb9-87aa-2d023f83af04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:49.392744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63df3bf-e845-4cb9-87aa-2d023f83af04 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:49.400490 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 601/1223] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:22:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:22:49.406486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da673d8d-122f-4589-928c-6d0001cf1397 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:49.449362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:49.508255 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da673d8d-122f-4589-928c-6d0001cf1397 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:49.541148 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69de29-4652-43d3-9b62-655bd00495d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:49.541990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69de29-4652-43d3-9b62-655bd00495d3 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:49.542270 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69de29-4652-43d3-9b62-655bd00495d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:49.542542 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69de29-4652-43d3-9b62-655bd00495d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:49.552758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69de29-4652-43d3-9b62-655bd00495d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:49.557607 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69de29-4652-43d3-9b62-655bd00495d3 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:49.571318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-6d69de29-4652-43d3-9b62-655bd00495d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:22:49.571318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:49.571318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:49.571318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:49.571318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:49.571318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:49.571318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:49.571318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:49.571318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:49.571318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:49.571318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:49.571318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:49.571318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:22:49.571318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:22:49.571318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:22:49.572411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:22:49.572411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:49.572411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:49.572411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:49.572411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:49.572411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:49.572411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:49.572411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:49.572411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:49.572411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:49.572411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:49.572411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:49.572411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:49.572411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:49.572411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:49.572411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:49.572411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:49.573565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:22:49.573565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:22:49.573565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:22:49.573565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:22:49.573565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 623/1224] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:22:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:22:49.578538 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63df3bf-e845-4cb9-87aa-2d023f83af04 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:49.676796 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63df3bf-e845-4cb9-87aa-2d023f83af04 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:49.709285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8c2f1-b672-4da4-891f-c881cc363373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:49.709966 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8c2f1-b672-4da4-891f-c881cc363373 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:49.710278 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8c2f1-b672-4da4-891f-c881cc363373 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:49.710556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b8c2f1-b672-4da4-891f-c881cc363373 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:49.711272 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8c2f1-b672-4da4-891f-c881cc363373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:49.711581 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8c2f1-b672-4da4-891f-c881cc363373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:49.712947 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b8c2f1-b672-4da4-891f-c881cc363373 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:49.724328 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 602/1225] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:22:49.731066 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69de29-4652-43d3-9b62-655bd00495d3 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:49.827411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:49.833894 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69de29-4652-43d3-9b62-655bd00495d3 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:49.867196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd75db5-6d3d-4db5-bde5-3f37db7b1a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:49.867993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd75db5-6d3d-4db5-bde5-3f37db7b1a68 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:49.868273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd75db5-6d3d-4db5-bde5-3f37db7b1a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:49.868551 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd75db5-6d3d-4db5-bde5-3f37db7b1a68 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:49.876118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd75db5-6d3d-4db5-bde5-3f37db7b1a68 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:49.877587 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd75db5-6d3d-4db5-bde5-3f37db7b1a68 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:49.891699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-5bd75db5-6d3d-4db5-bde5-3f37db7b1a68 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:22:49.891699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:49.891699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:49.891699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:49.891699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:49.891699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:49.891699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:49.891699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:49.891699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:49.891699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:49.891699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:49.891699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:49.891699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:22:49.891699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:22:49.891699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:22:49.891699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:22:49.892621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:49.892621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:49.892621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:22:49.892621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:22:49.892621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:22:49.892621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:22:49.892621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:49.892621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:49.892621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:49.892621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:49.892621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:49.892621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:49.892621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:49.892621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:49.892621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:49.892621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:49.892621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:49.892621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:49.893625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:49.893625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:49.893625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:22:49.893625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:22:49.893625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:22:49.893625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:22:49.893625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:22:49.893625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:22:49.893625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:22:49.893625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:22:49.893625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 624/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:22:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:22:49.899480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8c2f1-b672-4da4-891f-c881cc363373 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:49.945688 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:49.996674 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b8c2f1-b672-4da4-891f-c881cc363373 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:50.029086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8662da-8cf9-4736-916f-7147c5a21f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:50.029795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8662da-8cf9-4736-916f-7147c5a21f1d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:50.030081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8662da-8cf9-4736-916f-7147c5a21f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:50.030359 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8662da-8cf9-4736-916f-7147c5a21f1d None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:50.031192 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8662da-8cf9-4736-916f-7147c5a21f1d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:50.031506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8662da-8cf9-4736-916f-7147c5a21f1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:50.032974 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8662da-8cf9-4736-916f-7147c5a21f1d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:50.050258 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 603/1227] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Jul 21 08:22:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:22:50.055903 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd75db5-6d3d-4db5-bde5-3f37db7b1a68 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:50.155040 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd75db5-6d3d-4db5-bde5-3f37db7b1a68 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:50.187792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127ad49-3d2b-4467-8161-adf9e8e1992d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:50.188576 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127ad49-3d2b-4467-8161-adf9e8e1992d None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:50.188855 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127ad49-3d2b-4467-8161-adf9e8e1992d None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:50.189124 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127ad49-3d2b-4467-8161-adf9e8e1992d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:50.199967 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127ad49-3d2b-4467-8161-adf9e8e1992d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:50.201350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127ad49-3d2b-4467-8161-adf9e8e1992d None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:50.218311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-8127ad49-3d2b-4467-8161-adf9e8e1992d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:22:50.218311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:50.218311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:50.218311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:50.218311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:50.218311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:50.218311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:50.218311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:50.218311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:50.218311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:50.218311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:50.218311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:50.218311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:22:50.218311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:22:50.218311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:22:50.219365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:22:50.219365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:50.219365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:50.219365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:50.219365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:50.219365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:50.219365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:50.219365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:50.219365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:50.219365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:50.219365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:50.219365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:50.219365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:50.219365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:50.219365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:50.219365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:50.219365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:50.220595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:22:50.220595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:22:50.220595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:22:50.220595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:22:50.220595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 625/1228] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:22:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:22:50.225677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8662da-8cf9-4736-916f-7147c5a21f1d None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:50.323327 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8662da-8cf9-4736-916f-7147c5a21f1d None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:50.325639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:50.356511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c14a6-5cc9-4ac4-a56d-b5c1621a2579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:50.357314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c14a6-5cc9-4ac4-a56d-b5c1621a2579 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:50.357623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c14a6-5cc9-4ac4-a56d-b5c1621a2579 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:50.357922 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c14a6-5cc9-4ac4-a56d-b5c1621a2579 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:50.358630 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c14a6-5cc9-4ac4-a56d-b5c1621a2579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:50.358931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c14a6-5cc9-4ac4-a56d-b5c1621a2579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:50.360279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c14a6-5cc9-4ac4-a56d-b5c1621a2579 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:50.371213 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 604/1229] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:22:50.376898 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127ad49-3d2b-4467-8161-adf9e8e1992d None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:50.386723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:50.475538 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127ad49-3d2b-4467-8161-adf9e8e1992d None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:50.507914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaedb01-f1b6-4407-8fe4-cc4b7158e27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:50.508685 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaedb01-f1b6-4407-8fe4-cc4b7158e27d None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:50.508968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaedb01-f1b6-4407-8fe4-cc4b7158e27d None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:50.509241 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaedb01-f1b6-4407-8fe4-cc4b7158e27d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:50.515913 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaedb01-f1b6-4407-8fe4-cc4b7158e27d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:50.518140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaedb01-f1b6-4407-8fe4-cc4b7158e27d None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:50.532782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-cbaedb01-f1b6-4407-8fe4-cc4b7158e27d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:22:50.532782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:50.532782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:50.532782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:50.532782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:50.532782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:50.532782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:50.532782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:50.532782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:50.532782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:50.532782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:50.532782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:50.532782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:22:50.532782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:22:50.532782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:22:50.533849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:22:50.533849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:50.533849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:50.533849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:50.533849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:50.533849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:50.533849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:50.533849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:50.533849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:50.533849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:50.533849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:50.533849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:50.533849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:50.533849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:50.533849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:50.533849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:50.533849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:50.534933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:22:50.534933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:22:50.534933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:22:50.534933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:22:50.534933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:22:50.534933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:22:50.534933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:22:50.534933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:22:50.534933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 626/1230] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:22:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:22:50.539957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c14a6-5cc9-4ac4-a56d-b5c1621a2579 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:50.639596 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c14a6-5cc9-4ac4-a56d-b5c1621a2579 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:50.671486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f3e7d-8371-42b4-aa53-1bfb52055970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:50.672127 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f3e7d-8371-42b4-aa53-1bfb52055970 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:50.672433 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f3e7d-8371-42b4-aa53-1bfb52055970 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:50.672707 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f3e7d-8371-42b4-aa53-1bfb52055970 None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:50.673483 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f3e7d-8371-42b4-aa53-1bfb52055970 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:50.673824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f3e7d-8371-42b4-aa53-1bfb52055970 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:50.675245 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f3e7d-8371-42b4-aa53-1bfb52055970 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:50.687661 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 605/1231] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:22:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:22:50.693886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaedb01-f1b6-4407-8fe4-cc4b7158e27d None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:50.760301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:50.795292 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaedb01-f1b6-4407-8fe4-cc4b7158e27d None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:50.829433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9807c-797a-4856-837f-e09f1492619b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:50.830393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9807c-797a-4856-837f-e09f1492619b None admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:50.830775 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9807c-797a-4856-837f-e09f1492619b None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:50.831052 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9807c-797a-4856-837f-e09f1492619b None admin] PATH_INFO: `/v3/projects/83100b3a5d584e39886c234391fdb204/users/4e38b7e84d6a43efbb4c1a52e2b3e681/roles/9bbdc03bd7dc4b7fb84bb74bf49e49d4` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:50.844768 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9807c-797a-4856-837f-e09f1492619b None admin] RBAC: Authorizing `identity:create_grant(project_id=83100b3a5d584e39886c234391fdb204, user_id=4e38b7e84d6a43efbb4c1a52e2b3e681, role_id=9bbdc03bd7dc4b7fb84bb74bf49e49d4)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:50.846243 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e9807c-797a-4856-837f-e09f1492619b None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:50.959753 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 627/1232] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:22:50 2022] PUT /identity/v3/projects/83100b3a5d584e39886c234391fdb204/users/4e38b7e84d6a43efbb4c1a52e2b3e681/roles/9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:22:53.013567 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3f1f1-5b5b-4bf6-b540-b3cc992cd7e8 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:53.014137 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3f1f1-5b5b-4bf6-b540-b3cc992cd7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:53.014137 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3f1f1-5b5b-4bf6-b540-b3cc992cd7e8 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:53.015488 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 606/1233] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:53.020689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823012b2-f81a-42a1-a45e-04abf8759481 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:53.021212 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823012b2-f81a-42a1-a45e-04abf8759481 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:53.021324 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823012b2-f81a-42a1-a45e-04abf8759481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:53.037714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-823012b2-f81a-42a1-a45e-04abf8759481 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:53.039490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-823012b2-f81a-42a1-a45e-04abf8759481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:53.104128 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 628/1234] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:22:53.127400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3f1f1-5b5b-4bf6-b540-b3cc992cd7e8 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:53.152496 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:53.226319 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3f1f1-5b5b-4bf6-b540-b3cc992cd7e8 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:53.259099 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbf8f1-5f6f-4f35-adef-99ae5ee328ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:53.259885 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf8f1-5f6f-4f35-adef-99ae5ee328ea None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:53.260168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf8f1-5f6f-4f35-adef-99ae5ee328ea None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:53.260444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbf8f1-5f6f-4f35-adef-99ae5ee328ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:53.270603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbf8f1-5f6f-4f35-adef-99ae5ee328ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:22:53.278833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-fdfbf8f1-5f6f-4f35-adef-99ae5ee328ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:22:53.278833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:53.278833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:53.278833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:53.278833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:53.278833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:53.278833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:53.278833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:53.278833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:53.278833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:53.278833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:53.278833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:53.278833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:22:53.278833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:22:53.278833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:22:53.278833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:22:53.280045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:22:53.280045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:22:53.280045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:22:53.280045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:22:53.280045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:53.280045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:53.280045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:53.280045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:53.280045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:53.280045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:53.280045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:53.280045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:53.280045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:53.280045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:53.280045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:53.280045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:53.281074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:53.281074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:53.281074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:53.281074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:53.281074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:22:53.281074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:22:53.281074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:22:53.281074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:22:53.281074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:22:53.281074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:22:53.281074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 08:22:53.281074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:22:53.281074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 607/1235] 10.222.0.57 () {56 vars in 1102 bytes} [Thu Jul 21 08:22:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:22:53.286052 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823012b2-f81a-42a1-a45e-04abf8759481 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:53.331172 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:53.382808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823012b2-f81a-42a1-a45e-04abf8759481 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:53.414977 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3c14c-72ca-42bb-96b7-6606e96be40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:53.415699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3c14c-72ca-42bb-96b7-6606e96be40e None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:53.415977 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3c14c-72ca-42bb-96b7-6606e96be40e None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:53.416250 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3c14c-72ca-42bb-96b7-6606e96be40e None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:53.416987 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3c14c-72ca-42bb-96b7-6606e96be40e None admin] RBAC: Adding query filter params (name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:53.417288 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3c14c-72ca-42bb-96b7-6606e96be40e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:53.418683 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3c14c-72ca-42bb-96b7-6606e96be40e None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:53.427136 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 629/1236] 10.222.0.57 () {56 vars in 1103 bytes} [Thu Jul 21 08:22:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:22:53.432858 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbf8f1-5f6f-4f35-adef-99ae5ee328ea None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:53.518426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:53.534395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbf8f1-5f6f-4f35-adef-99ae5ee328ea None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:53.566892 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d21690-0da1-451f-a403-cf4cc17c38a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:53.567667 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d21690-0da1-451f-a403-cf4cc17c38a9 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:53.567961 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d21690-0da1-451f-a403-cf4cc17c38a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:53.568364 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d21690-0da1-451f-a403-cf4cc17c38a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:53.578996 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d21690-0da1-451f-a403-cf4cc17c38a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:53.580572 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d21690-0da1-451f-a403-cf4cc17c38a9 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:53.597658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-82d21690-0da1-451f-a403-cf4cc17c38a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:22:53.597658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:53.597658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:53.597658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:53.597658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:53.597658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:53.597658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:53.597658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:53.597658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:53.597658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:53.597658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:53.597658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:53.597658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:22:53.597658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:22:53.597658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:22:53.603714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:22:53.603714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:53.603714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:53.603714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:53.603714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:53.603714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:53.603714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:53.603714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:53.603714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:53.603714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:53.603714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:53.603714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:53.603714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:53.603714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:53.603714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:53.603714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:53.603714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:53.604818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:22:53.604818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:22:53.604818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:22:53.604818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:22:53.604818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 608/1237] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:22:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:22:53.605552 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3c14c-72ca-42bb-96b7-6606e96be40e None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:53.703873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3c14c-72ca-42bb-96b7-6606e96be40e None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:53.713354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:53.739918 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da4ae4-d518-4432-91b5-d180ff93ac12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:53.740581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da4ae4-d518-4432-91b5-d180ff93ac12 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:53.740870 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da4ae4-d518-4432-91b5-d180ff93ac12 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:53.741146 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da4ae4-d518-4432-91b5-d180ff93ac12 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:53.741901 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da4ae4-d518-4432-91b5-d180ff93ac12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:53.742224 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da4ae4-d518-4432-91b5-d180ff93ac12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:53.743581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da4ae4-d518-4432-91b5-d180ff93ac12 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:53.755789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 630/1238] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:22:53.761445 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d21690-0da1-451f-a403-cf4cc17c38a9 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:53.864393 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d21690-0da1-451f-a403-cf4cc17c38a9 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:53.896626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b299824-54e8-49d3-a50a-5d3c62cdc9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:53.897921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299824-54e8-49d3-a50a-5d3c62cdc9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:53.898201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299824-54e8-49d3-a50a-5d3c62cdc9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:53.898470 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b299824-54e8-49d3-a50a-5d3c62cdc9f4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:53.901261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:53.906134 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b299824-54e8-49d3-a50a-5d3c62cdc9f4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:53.907671 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b299824-54e8-49d3-a50a-5d3c62cdc9f4 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:53.922147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-4b299824-54e8-49d3-a50a-5d3c62cdc9f4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:22:53.922147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:53.922147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:53.922147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:53.922147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:53.922147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:53.922147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:53.922147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:53.922147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:53.922147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:53.922147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:53.922147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:53.922147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:22:53.922147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:22:53.922147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:22:53.922147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:22:53.926973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:53.926973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:53.926973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:22:53.926973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:22:53.926973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:22:53.926973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:22:53.926973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:53.926973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:53.926973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:53.926973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:53.926973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:53.926973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:53.926973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:53.926973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:53.926973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:53.926973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:53.926973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:53.926973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:53.928097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:53.928097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:53.928097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:22:53.928097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:22:53.928097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:22:53.928097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:22:53.928097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:22:53.928097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:22:53.928097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:22:53.928097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:22:53.928097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 609/1239] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:22:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:22:53.929225 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da4ae4-d518-4432-91b5-d180ff93ac12 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:54.028018 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da4ae4-d518-4432-91b5-d180ff93ac12 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:54.059901 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a04b8-e871-4d51-a453-3d098932ada8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:54.060552 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a04b8-e871-4d51-a453-3d098932ada8 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:54.060899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a04b8-e871-4d51-a453-3d098932ada8 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:54.061171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a04b8-e871-4d51-a453-3d098932ada8 None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:54.062014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a04b8-e871-4d51-a453-3d098932ada8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:54.062321 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a04b8-e871-4d51-a453-3d098932ada8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:54.063721 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a04b8-e871-4d51-a453-3d098932ada8 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:54.081611 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 631/1240] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Jul 21 08:22:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:22:54.088054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b299824-54e8-49d3-a50a-5d3c62cdc9f4 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:54.187170 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b299824-54e8-49d3-a50a-5d3c62cdc9f4 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:54.221014 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31c25c-7266-4728-ac0b-75d29558cdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:54.222075 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31c25c-7266-4728-ac0b-75d29558cdbc None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:54.222075 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31c25c-7266-4728-ac0b-75d29558cdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:54.222424 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31c25c-7266-4728-ac0b-75d29558cdbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:54.283530 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:54.289897 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31c25c-7266-4728-ac0b-75d29558cdbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:54.291351 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31c25c-7266-4728-ac0b-75d29558cdbc None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:54.387866 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 610/1241] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:22:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:22:54.393664 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a04b8-e871-4d51-a453-3d098932ada8 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:54.420726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:54.491671 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a04b8-e871-4d51-a453-3d098932ada8 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:54.526382 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3d89b-21de-4702-9861-7d6c66cb666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:54.527181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3d89b-21de-4702-9861-7d6c66cb666a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:54.527465 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3d89b-21de-4702-9861-7d6c66cb666a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:54.527741 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3d89b-21de-4702-9861-7d6c66cb666a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:54.537619 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3d89b-21de-4702-9861-7d6c66cb666a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:54.539057 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3d89b-21de-4702-9861-7d6c66cb666a None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:54.556613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-34a3d89b-21de-4702-9861-7d6c66cb666a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:22:54.556613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:54.556613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:54.556613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:54.556613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:54.556613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:54.556613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:54.556613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:54.556613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:54.556613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:54.556613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:54.556613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:54.556613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:22:54.556613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:22:54.556613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:22:54.557700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:22:54.557700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:54.557700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:54.557700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:54.557700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:54.557700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:54.557700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:54.557700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:54.557700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:54.557700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:54.557700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:54.557700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:54.557700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:54.557700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:54.557700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:54.557700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:54.557700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:54.563443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:22:54.563443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:22:54.563443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:22:54.563443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:22:54.563443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 632/1242] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:22:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:22:54.563805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31c25c-7266-4728-ac0b-75d29558cdbc None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:54.655059 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:54.660804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31c25c-7266-4728-ac0b-75d29558cdbc None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:54.693638 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723aa34-7fe6-48e2-ad94-b018a6c05b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:54.694923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723aa34-7fe6-48e2-ad94-b018a6c05b47 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:54.695207 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723aa34-7fe6-48e2-ad94-b018a6c05b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:54.695488 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4723aa34-7fe6-48e2-ad94-b018a6c05b47 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:54.696208 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723aa34-7fe6-48e2-ad94-b018a6c05b47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:54.696512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723aa34-7fe6-48e2-ad94-b018a6c05b47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:54.697924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4723aa34-7fe6-48e2-ad94-b018a6c05b47 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:54.709000 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 611/1243] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:22:54.714719 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3d89b-21de-4702-9861-7d6c66cb666a None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:54.793530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:54.814269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3d89b-21de-4702-9861-7d6c66cb666a None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:54.846179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cded8-16d6-47d0-b29d-251586711560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:54.846959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cded8-16d6-47d0-b29d-251586711560 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:54.847318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cded8-16d6-47d0-b29d-251586711560 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:54.847606 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cded8-16d6-47d0-b29d-251586711560 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:54.855162 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cded8-16d6-47d0-b29d-251586711560 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:54.856601 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cded8-16d6-47d0-b29d-251586711560 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:54.871281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-b42cded8-16d6-47d0-b29d-251586711560 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:22:54.871281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:54.871281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:54.871281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:54.871281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:54.871281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:54.871281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:54.871281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:54.871281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:54.871281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:54.871281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:54.871281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:54.871281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:22:54.871281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:22:54.871281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:22:54.872624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:22:54.872624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:54.872624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:54.872624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:54.872624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:54.872624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:54.872624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:54.872624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:54.872624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:54.872624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:54.872624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:54.872624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:54.872624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:54.872624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:54.872624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:54.872624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:54.872624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:54.874196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:22:54.874196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:22:54.874196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:22:54.874196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:22:54.874196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:22:54.874196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:22:54.874196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:22:54.874196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:22:54.874196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 633/1244] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:22:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:22:54.878681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723aa34-7fe6-48e2-ad94-b018a6c05b47 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:54.978087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4723aa34-7fe6-48e2-ad94-b018a6c05b47 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:55.011606 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71219019-caab-47f7-af18-0a164ebd67c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:55.012172 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71219019-caab-47f7-af18-0a164ebd67c3 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:55.012456 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71219019-caab-47f7-af18-0a164ebd67c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:55.012738 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71219019-caab-47f7-af18-0a164ebd67c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:55.013510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71219019-caab-47f7-af18-0a164ebd67c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:55.013852 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71219019-caab-47f7-af18-0a164ebd67c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:55.015279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71219019-caab-47f7-af18-0a164ebd67c3 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:55.027181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 612/1245] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:22:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:22:55.033457 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cded8-16d6-47d0-b29d-251586711560 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:55.132624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cded8-16d6-47d0-b29d-251586711560 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:55.165607 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92f3ba-5b53-47fe-9371-1320e81a385c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:55.166248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92f3ba-5b53-47fe-9371-1320e81a385c None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:55.166529 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92f3ba-5b53-47fe-9371-1320e81a385c None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:55.166805 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92f3ba-5b53-47fe-9371-1320e81a385c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:55.167619 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92f3ba-5b53-47fe-9371-1320e81a385c None admin] RBAC: Adding query filter params (role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=4e38b7e84d6a43efbb4c1a52e2b3e681) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:55.167930 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92f3ba-5b53-47fe-9371-1320e81a385c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:55.169342 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92f3ba-5b53-47fe-9371-1320e81a385c None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:55.175026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 634/1246] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:22:55 2022] GET /identity/v3/role_assignments?user.id=4e38b7e84d6a43efbb4c1a52e2b3e681&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=9bbdc03bd7dc4b7fb84bb74bf49e49d4 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:22:57.225271 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef9403-695d-4650-a2f9-6af276fca3be None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:57.225883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef9403-695d-4650-a2f9-6af276fca3be None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:57.225992 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef9403-695d-4650-a2f9-6af276fca3be None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:57.227355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 613/1247] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:22:57.232484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b408ba-b873-4c2f-ba46-4f1bfad0474f None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:57.238703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b408ba-b873-4c2f-ba46-4f1bfad0474f None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:57.238703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b408ba-b873-4c2f-ba46-4f1bfad0474f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:57.238703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:57.250000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-97b408ba-b873-4c2f-ba46-4f1bfad0474f None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:22:57.255789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-97b408ba-b873-4c2f-ba46-4f1bfad0474f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:22:57.318330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 635/1248] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:22:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:22:57.342929 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef9403-695d-4650-a2f9-6af276fca3be None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:57.361030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:57.440641 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef9403-695d-4650-a2f9-6af276fca3be None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:57.475203 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99d833-2f99-4f2e-8d3a-39d0b69f28ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:57.476047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99d833-2f99-4f2e-8d3a-39d0b69f28ea None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:57.476278 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99d833-2f99-4f2e-8d3a-39d0b69f28ea None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:57.476552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99d833-2f99-4f2e-8d3a-39d0b69f28ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:57.486694 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99d833-2f99-4f2e-8d3a-39d0b69f28ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:22:57.494888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-9e99d833-2f99-4f2e-8d3a-39d0b69f28ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:22:57.494888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:57.494888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:57.494888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:57.494888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:57.494888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:57.494888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:57.494888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:57.494888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:57.494888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:57.494888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:57.494888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:57.494888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:22:57.494888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:22:57.494888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:22:57.494888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:22:57.496016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:22:57.496016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:22:57.496016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:22:57.496016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:22:57.496016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:57.496016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:57.496016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:57.496016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:57.496016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:57.496016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:57.496016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:57.496016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:57.496016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:57.496016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:57.496016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:57.496016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:57.497071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:57.497071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:57.497071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:57.497071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:57.497071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:22:57.497071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:22:57.497071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:22:57.497071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:22:57.497071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:22:57.497071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:22:57.497071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:22:57.497071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:22:57.497071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 614/1249] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:22:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:22:57.502215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b408ba-b873-4c2f-ba46-4f1bfad0474f None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:57.602860 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b408ba-b873-4c2f-ba46-4f1bfad0474f None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:57.631763 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:57.636897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd640682-4750-47fc-990e-f847f68bcc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:57.637596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd640682-4750-47fc-990e-f847f68bcc4b None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:57.637904 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd640682-4750-47fc-990e-f847f68bcc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:57.638177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd640682-4750-47fc-990e-f847f68bcc4b None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:57.638910 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd640682-4750-47fc-990e-f847f68bcc4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:57.639214 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd640682-4750-47fc-990e-f847f68bcc4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:57.640593 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd640682-4750-47fc-990e-f847f68bcc4b None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:57.648384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 636/1250] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:22:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:22:57.654268 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99d833-2f99-4f2e-8d3a-39d0b69f28ea None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:57.731995 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:57.755148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99d833-2f99-4f2e-8d3a-39d0b69f28ea None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:57.787125 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb15ff-38bb-4d3c-8fbf-b2bc7e5faa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:57.788499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb15ff-38bb-4d3c-8fbf-b2bc7e5faa11 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:57.788789 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb15ff-38bb-4d3c-8fbf-b2bc7e5faa11 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:57.789067 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb15ff-38bb-4d3c-8fbf-b2bc7e5faa11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:57.800154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb15ff-38bb-4d3c-8fbf-b2bc7e5faa11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:57.801618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb15ff-38bb-4d3c-8fbf-b2bc7e5faa11 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:57.818776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-27fb15ff-38bb-4d3c-8fbf-b2bc7e5faa11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:22:57.818776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:57.818776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:57.818776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:57.818776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:57.818776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:57.818776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:57.818776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:57.818776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:57.818776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:57.818776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:57.818776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:57.818776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:22:57.818776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:22:57.818776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:22:57.819946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:22:57.819946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:57.819946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:57.819946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:57.819946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:57.819946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:57.819946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:57.819946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:57.819946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:57.819946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:57.819946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:57.819946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:57.819946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:57.819946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:57.819946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:57.819946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:57.819946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:57.821094 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:22:57.821094 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:22:57.821094 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:22:57.821094 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:22:57.821094 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 615/1251] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:22:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:22:57.825941 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd640682-4750-47fc-990e-f847f68bcc4b None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:57.927198 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd640682-4750-47fc-990e-f847f68bcc4b None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:57.959794 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302c454-6ef0-4cd4-b3ec-ce9aed4425a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:57.960435 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302c454-6ef0-4cd4-b3ec-ce9aed4425a2 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:57.960713 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302c454-6ef0-4cd4-b3ec-ce9aed4425a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:57.960985 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302c454-6ef0-4cd4-b3ec-ce9aed4425a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:57.961716 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302c454-6ef0-4cd4-b3ec-ce9aed4425a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:57.962020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302c454-6ef0-4cd4-b3ec-ce9aed4425a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:57.963366 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2302c454-6ef0-4cd4-b3ec-ce9aed4425a2 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:57.976191 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 637/1252] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:22:57.988389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb15ff-38bb-4d3c-8fbf-b2bc7e5faa11 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:58.080278 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb15ff-38bb-4d3c-8fbf-b2bc7e5faa11 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:58.106506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:58.114337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644f0f4-d251-42eb-9a52-4a1968e38ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:58.120380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644f0f4-d251-42eb-9a52-4a1968e38ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:58.120380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644f0f4-d251-42eb-9a52-4a1968e38ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:58.120380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3644f0f4-d251-42eb-9a52-4a1968e38ef9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:58.123118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644f0f4-d251-42eb-9a52-4a1968e38ef9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:58.124601 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3644f0f4-d251-42eb-9a52-4a1968e38ef9 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:58.138666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-3644f0f4-d251-42eb-9a52-4a1968e38ef9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:22:58.138666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:58.138666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:58.138666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:58.138666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:58.138666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:58.138666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:58.138666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:58.138666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:58.138666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:58.138666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:58.138666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:58.138666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:22:58.138666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:22:58.138666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:22:58.138666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:22:58.139785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:58.139785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:58.139785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:22:58.139785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:22:58.139785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:22:58.139785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:22:58.139785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:58.139785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:58.139785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:58.139785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:58.139785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:58.139785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:58.139785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:58.139785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:58.139785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:58.139785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:58.139785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:58.139785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:58.141162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:58.141162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:58.141162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:22:58.141162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:22:58.141162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:22:58.141162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:22:58.141162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:22:58.141162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:22:58.141162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:22:58.141162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:22:58.141162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 616/1253] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:22:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:22:58.145641 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302c454-6ef0-4cd4-b3ec-ce9aed4425a2 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:58.201364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:58.244779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302c454-6ef0-4cd4-b3ec-ce9aed4425a2 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:58.279946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5eeb0f-968f-4dbc-87f1-4237841a6d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:58.280606 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eeb0f-968f-4dbc-87f1-4237841a6d71 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:58.280883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eeb0f-968f-4dbc-87f1-4237841a6d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:58.281154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5eeb0f-968f-4dbc-87f1-4237841a6d71 None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:58.282000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5eeb0f-968f-4dbc-87f1-4237841a6d71 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:58.282305 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5eeb0f-968f-4dbc-87f1-4237841a6d71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:58.283742 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5eeb0f-968f-4dbc-87f1-4237841a6d71 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:58.300471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 638/1254] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Jul 21 08:22:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:22:58.307012 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644f0f4-d251-42eb-9a52-4a1968e38ef9 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:58.405609 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3644f0f4-d251-42eb-9a52-4a1968e38ef9 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:58.439890 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13a239-964f-42dd-8b41-9436efe52ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:58.440524 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13a239-964f-42dd-8b41-9436efe52ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:58.440809 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13a239-964f-42dd-8b41-9436efe52ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:58.441084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13a239-964f-42dd-8b41-9436efe52ae1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:58.496779 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:58.508745 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13a239-964f-42dd-8b41-9436efe52ae1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:58.510247 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13a239-964f-42dd-8b41-9436efe52ae1 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:58.605073 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 617/1255] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:22:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:22:58.610931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5eeb0f-968f-4dbc-87f1-4237841a6d71 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:58.709176 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5eeb0f-968f-4dbc-87f1-4237841a6d71 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:58.721882 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:58.744781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56918758-94bf-4ae4-8eed-ec7b6ad959da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:58.745616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56918758-94bf-4ae4-8eed-ec7b6ad959da None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:58.745897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56918758-94bf-4ae4-8eed-ec7b6ad959da None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:58.746172 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56918758-94bf-4ae4-8eed-ec7b6ad959da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:58.756357 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56918758-94bf-4ae4-8eed-ec7b6ad959da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:58.757866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56918758-94bf-4ae4-8eed-ec7b6ad959da None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:58.775304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-56918758-94bf-4ae4-8eed-ec7b6ad959da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:22:58.775304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:58.775304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:58.775304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:58.775304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:58.775304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:58.775304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:58.775304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:58.775304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:58.775304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:58.775304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:58.775304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:58.775304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:22:58.775304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:22:58.775304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:22:58.776433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:22:58.776433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:58.776433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:58.776433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:58.776433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:58.776433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:58.776433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:58.776433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:58.776433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:58.776433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:58.776433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:58.776433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:58.776433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:58.776433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:58.776433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:58.776433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:58.776433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:58.777488 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:22:58.777488 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:22:58.777488 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:22:58.777488 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:22:58.777488 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 639/1256] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:22:58.783857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13a239-964f-42dd-8b41-9436efe52ae1 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:58.867581 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:58.878925 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13a239-964f-42dd-8b41-9436efe52ae1 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:58.911867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578338a9-ae38-4a9f-a603-e4685219bbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:58.912515 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578338a9-ae38-4a9f-a603-e4685219bbbe None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:58.913402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578338a9-ae38-4a9f-a603-e4685219bbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:58.913783 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578338a9-ae38-4a9f-a603-e4685219bbbe None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:58.914556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578338a9-ae38-4a9f-a603-e4685219bbbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:58.914865 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578338a9-ae38-4a9f-a603-e4685219bbbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:58.916248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578338a9-ae38-4a9f-a603-e4685219bbbe None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:58.927859 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 618/1257] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:22:58.933576 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56918758-94bf-4ae4-8eed-ec7b6ad959da None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:59.033972 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56918758-94bf-4ae4-8eed-ec7b6ad959da None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:59.067604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b9884-4965-412e-9888-8a81e2981aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:59.068398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b9884-4965-412e-9888-8a81e2981aad None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:59.068679 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b9884-4965-412e-9888-8a81e2981aad None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:59.068952 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b9884-4965-412e-9888-8a81e2981aad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:59.075402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b9884-4965-412e-9888-8a81e2981aad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:59.076825 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b9884-4965-412e-9888-8a81e2981aad None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:59.090585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-d00b9884-4965-412e-9888-8a81e2981aad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:22:59.090585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:22:59.090585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:22:59.090585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:22:59.090585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:22:59.090585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:22:59.090585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:22:59.090585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:22:59.090585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:22:59.090585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:22:59.090585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:22:59.090585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:22:59.090585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:22:59.090585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:22:59.090585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:22:59.094887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:22:59.094887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:22:59.094887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:22:59.094887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:22:59.094887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:22:59.094887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:22:59.094887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:22:59.094887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:22:59.094887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:22:59.094887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:22:59.094887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:22:59.094887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:22:59.094887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:22:59.094887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:22:59.094887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:22:59.094887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:22:59.094887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:22:59.096012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:22:59.096012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:22:59.096012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:22:59.096012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:22:59.096012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:22:59.096012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:22:59.096012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:22:59.096012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:22:59.096012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 640/1258] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:22:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:22:59.097816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578338a9-ae38-4a9f-a603-e4685219bbbe None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:59.196236 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578338a9-ae38-4a9f-a603-e4685219bbbe None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:59.228929 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733df54-5600-406c-9148-044f0507f3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:59.229588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733df54-5600-406c-9148-044f0507f3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:59.229866 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733df54-5600-406c-9148-044f0507f3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:59.230137 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733df54-5600-406c-9148-044f0507f3d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:59.230956 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733df54-5600-406c-9148-044f0507f3d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:59.231261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733df54-5600-406c-9148-044f0507f3d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:59.232702 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733df54-5600-406c-9148-044f0507f3d6 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:59.244225 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 619/1259] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:22:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:22:59.250268 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b9884-4965-412e-9888-8a81e2981aad None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:22:59.276962 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:22:59.351638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b9884-4965-412e-9888-8a81e2981aad None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:22:59.388716 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b62428-54ac-4238-9004-f7c9f82da88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:22:59.389452 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b62428-54ac-4238-9004-f7c9f82da88e None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:22:59.389764 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b62428-54ac-4238-9004-f7c9f82da88e None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:22:59.390053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b62428-54ac-4238-9004-f7c9f82da88e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:22:59.390862 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b62428-54ac-4238-9004-f7c9f82da88e None admin] RBAC: Adding query filter params (role.id=beed8caad097496292e544146859df5c, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=4e38b7e84d6a43efbb4c1a52e2b3e681) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:22:59.391175 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b62428-54ac-4238-9004-f7c9f82da88e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:22:59.392597 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b62428-54ac-4238-9004-f7c9f82da88e None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:22:59.398703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 641/1260] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:22:59 2022] GET /identity/v3/role_assignments?user.id=4e38b7e84d6a43efbb4c1a52e2b3e681&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=beed8caad097496292e544146859df5c => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:23:01.410795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50dcd1-5265-44cc-9c25-2218e79b1e0a None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:01.411373 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50dcd1-5265-44cc-9c25-2218e79b1e0a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:01.411373 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50dcd1-5265-44cc-9c25-2218e79b1e0a None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:01.412720 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 620/1261] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:01.418449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caae31d-2c6d-4312-818e-90f1d93fe7b3 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:01.418874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caae31d-2c6d-4312-818e-90f1d93fe7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:01.419015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caae31d-2c6d-4312-818e-90f1d93fe7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:01.435592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-2caae31d-2c6d-4312-818e-90f1d93fe7b3 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:01.436781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2caae31d-2c6d-4312-818e-90f1d93fe7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:01.503359 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 642/1262] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:23:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:23:01.526976 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50dcd1-5265-44cc-9c25-2218e79b1e0a None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:01.537824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:01.629426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50dcd1-5265-44cc-9c25-2218e79b1e0a None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:01.663686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33feb6f-ac64-4ccc-bc8c-455d17e393ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:01.664423 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33feb6f-ac64-4ccc-bc8c-455d17e393ad None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:01.664699 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33feb6f-ac64-4ccc-bc8c-455d17e393ad None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:01.664969 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33feb6f-ac64-4ccc-bc8c-455d17e393ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:01.676570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33feb6f-ac64-4ccc-bc8c-455d17e393ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:23:01.686800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-f33feb6f-ac64-4ccc-bc8c-455d17e393ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:23:01.686800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:23:01.686800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:23:01.686800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:23:01.686800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:23:01.686800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:23:01.686800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:23:01.686800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:23:01.686800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:23:01.686800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:23:01.686800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:23:01.686800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:23:01.686800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:23:01.686800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:23:01.686800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:23:01.686800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:23:01.687940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:23:01.687940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:23:01.687940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:23:01.687940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:23:01.687940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:23:01.687940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:23:01.687940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:23:01.687940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:23:01.687940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:23:01.687940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:23:01.687940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:23:01.687940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:23:01.687940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:23:01.687940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:23:01.687940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:23:01.687940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:23:01.689033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:23:01.689033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:23:01.689033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:23:01.689033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:23:01.689033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:23:01.689033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:23:01.689033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:23:01.689033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:23:01.689033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:23:01.689033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:23:01.689033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:23:01.689033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:23:01.689033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 621/1263] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:23:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:23:01.694966 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caae31d-2c6d-4312-818e-90f1d93fe7b3 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:01.713646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:01.795922 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caae31d-2c6d-4312-818e-90f1d93fe7b3 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:01.829206 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a0395-b404-4292-a9b6-d81cbb4c8101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:01.829890 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a0395-b404-4292-a9b6-d81cbb4c8101 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:01.830169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a0395-b404-4292-a9b6-d81cbb4c8101 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:01.830438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a0395-b404-4292-a9b6-d81cbb4c8101 None admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:01.831164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a0395-b404-4292-a9b6-d81cbb4c8101 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:23:01.831463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a0395-b404-4292-a9b6-d81cbb4c8101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:01.832920 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468a0395-b404-4292-a9b6-d81cbb4c8101 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:01.841412 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 643/1264] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:23:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:23:01.847538 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33feb6f-ac64-4ccc-bc8c-455d17e393ad None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:01.916799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:01.949906 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33feb6f-ac64-4ccc-bc8c-455d17e393ad None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:01.984951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6d731-cb83-400d-bd6c-6f0f4b47c12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:01.985757 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6d731-cb83-400d-bd6c-6f0f4b47c12d None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:01.986047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6d731-cb83-400d-bd6c-6f0f4b47c12d None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:01.986369 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6d731-cb83-400d-bd6c-6f0f4b47c12d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:01.997868 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6d731-cb83-400d-bd6c-6f0f4b47c12d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:01.999319 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6d731-cb83-400d-bd6c-6f0f4b47c12d None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:02.019390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-f4b6d731-cb83-400d-bd6c-6f0f4b47c12d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:23:02.019390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:23:02.019390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:23:02.019390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:23:02.019390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:23:02.019390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:23:02.019390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:23:02.019390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:23:02.019390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:23:02.019390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:23:02.019390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:23:02.019390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:23:02.019390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:23:02.019390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:23:02.019390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:23:02.020492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:23:02.020492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:23:02.020492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:23:02.020492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:23:02.020492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:23:02.020492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:23:02.020492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:23:02.020492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:23:02.020492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:23:02.020492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:23:02.020492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:23:02.020492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:23:02.020492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:23:02.020492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:23:02.020492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:23:02.020492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:23:02.020492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:23:02.021613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:23:02.021613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:23:02.021613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:23:02.021613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:23:02.021613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 622/1265] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:23:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:23:02.028672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a0395-b404-4292-a9b6-d81cbb4c8101 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:02.108548 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:02.128414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a0395-b404-4292-a9b6-d81cbb4c8101 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:02.160839 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68157b5c-94a3-4a31-aa5d-bf3ef3d89048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:02.161482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68157b5c-94a3-4a31-aa5d-bf3ef3d89048 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:02.161790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68157b5c-94a3-4a31-aa5d-bf3ef3d89048 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:02.162063 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68157b5c-94a3-4a31-aa5d-bf3ef3d89048 None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:02.162767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68157b5c-94a3-4a31-aa5d-bf3ef3d89048 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:23:02.163071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68157b5c-94a3-4a31-aa5d-bf3ef3d89048 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:02.164544 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68157b5c-94a3-4a31-aa5d-bf3ef3d89048 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:02.176439 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 644/1266] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:23:02.182795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6d731-cb83-400d-bd6c-6f0f4b47c12d None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:02.287264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6d731-cb83-400d-bd6c-6f0f4b47c12d None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:02.307310 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:02.321633 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65eb2a4-fd10-469a-845e-e552104e88b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:02.322420 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65eb2a4-fd10-469a-845e-e552104e88b0 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:02.322783 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65eb2a4-fd10-469a-845e-e552104e88b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:02.323077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65eb2a4-fd10-469a-845e-e552104e88b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:02.330446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65eb2a4-fd10-469a-845e-e552104e88b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:02.332008 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65eb2a4-fd10-469a-845e-e552104e88b0 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:02.346494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-e65eb2a4-fd10-469a-845e-e552104e88b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:23:02.346494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:23:02.346494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:23:02.346494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:23:02.346494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:23:02.346494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:23:02.346494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:23:02.346494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:23:02.346494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:23:02.346494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:23:02.346494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:23:02.346494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:23:02.346494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:23:02.346494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:23:02.346494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:23:02.346494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:23:02.347417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:23:02.347417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:23:02.347417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:23:02.347417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:23:02.347417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:23:02.347417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:23:02.347417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:23:02.347417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:23:02.347417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:23:02.347417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:23:02.347417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:23:02.347417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:23:02.347417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:23:02.347417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:23:02.347417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:23:02.347417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:23:02.347417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:23:02.347417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:23:02.348409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:23:02.348409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:23:02.348409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:23:02.348409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:23:02.348409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:23:02.348409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:23:02.348409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:23:02.348409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:23:02.348409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:23:02.348409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:23:02.348409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 623/1267] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:23:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:23:02.354780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68157b5c-94a3-4a31-aa5d-bf3ef3d89048 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:02.454185 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68157b5c-94a3-4a31-aa5d-bf3ef3d89048 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:02.487921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab671029-2643-4552-b134-42a60dcf72a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:02.488594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab671029-2643-4552-b134-42a60dcf72a5 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:02.488871 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab671029-2643-4552-b134-42a60dcf72a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:02.489147 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab671029-2643-4552-b134-42a60dcf72a5 None admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:02.490034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab671029-2643-4552-b134-42a60dcf72a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:23:02.490344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab671029-2643-4552-b134-42a60dcf72a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:02.492388 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab671029-2643-4552-b134-42a60dcf72a5 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:02.500835 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:02.509974 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 645/1268] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Jul 21 08:23:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:23:02.515669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65eb2a4-fd10-469a-845e-e552104e88b0 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:02.616060 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65eb2a4-fd10-469a-845e-e552104e88b0 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:02.648743 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01384d40-bc7d-40bf-9596-129851f22441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:02.649544 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01384d40-bc7d-40bf-9596-129851f22441 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:02.649827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01384d40-bc7d-40bf-9596-129851f22441 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:02.650100 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01384d40-bc7d-40bf-9596-129851f22441 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:02.661174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01384d40-bc7d-40bf-9596-129851f22441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:02.663270 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01384d40-bc7d-40bf-9596-129851f22441 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:02.679755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-01384d40-bc7d-40bf-9596-129851f22441 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:23:02.679755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:23:02.679755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:23:02.679755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:23:02.679755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:23:02.679755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:23:02.679755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:23:02.679755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:23:02.679755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:23:02.679755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:23:02.679755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:23:02.679755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:23:02.679755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:23:02.679755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:23:02.679755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:23:02.680856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:23:02.680856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:23:02.680856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:23:02.680856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:23:02.680856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:23:02.680856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:23:02.680856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:23:02.680856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:23:02.680856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:23:02.680856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:23:02.680856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:23:02.680856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:23:02.680856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:23:02.680856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:23:02.680856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:23:02.680856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:23:02.680856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:23:02.681984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:23:02.681984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:23:02.681984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:23:02.681984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:23:02.681984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 624/1269] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:23:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:23:02.686736 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab671029-2643-4552-b134-42a60dcf72a5 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:02.785041 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab671029-2643-4552-b134-42a60dcf72a5 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:02.819344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fbacd-e2d3-4158-851e-b5e04d75ad4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:02.820001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fbacd-e2d3-4158-851e-b5e04d75ad4e None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:02.820287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fbacd-e2d3-4158-851e-b5e04d75ad4e None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:02.820566 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6fbacd-e2d3-4158-851e-b5e04d75ad4e None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:02.821277 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6fbacd-e2d3-4158-851e-b5e04d75ad4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:23:02.821613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6fbacd-e2d3-4158-851e-b5e04d75ad4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:02.822977 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6fbacd-e2d3-4158-851e-b5e04d75ad4e None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:02.833958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 646/1270] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:23:02.840187 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01384d40-bc7d-40bf-9596-129851f22441 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:02.872613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:02.946041 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01384d40-bc7d-40bf-9596-129851f22441 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:02.981010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c0cf5-550f-4aa2-8c09-42826bd3cc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:02.981823 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c0cf5-550f-4aa2-8c09-42826bd3cc3b None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:02.982153 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c0cf5-550f-4aa2-8c09-42826bd3cc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:02.982541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c0cf5-550f-4aa2-8c09-42826bd3cc3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:02.989330 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c0cf5-550f-4aa2-8c09-42826bd3cc3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:02.990907 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c0cf5-550f-4aa2-8c09-42826bd3cc3b None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:03.005285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-cd1c0cf5-550f-4aa2-8c09-42826bd3cc3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:23:03.005285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:23:03.005285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:23:03.005285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:23:03.005285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:23:03.005285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:23:03.005285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:23:03.005285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:23:03.005285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:23:03.005285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:23:03.005285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:23:03.005285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:23:03.005285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:23:03.005285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:23:03.005285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:23:03.007017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:23:03.007017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:23:03.007017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:23:03.007017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:23:03.007017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:23:03.007017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:23:03.007017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:23:03.007017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:23:03.007017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:23:03.007017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:23:03.007017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:23:03.007017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:23:03.007017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:23:03.007017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:23:03.007017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:23:03.007017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:23:03.007017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:23:03.008079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:23:03.008079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:23:03.008079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:23:03.008079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:23:03.008079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:23:03.008079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:23:03.008079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:23:03.008079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:23:03.008079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 625/1271] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:23:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:23:03.013240 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fbacd-e2d3-4158-851e-b5e04d75ad4e None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:03.073015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:03.115038 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6fbacd-e2d3-4158-851e-b5e04d75ad4e None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:03.148473 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6801a4-15d2-43bc-826f-4e9f48e37174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:03.149118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6801a4-15d2-43bc-826f-4e9f48e37174 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:03.149395 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6801a4-15d2-43bc-826f-4e9f48e37174 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:03.149693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6801a4-15d2-43bc-826f-4e9f48e37174 None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:03.150462 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6801a4-15d2-43bc-826f-4e9f48e37174 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:23:03.150763 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6801a4-15d2-43bc-826f-4e9f48e37174 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:03.152204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6801a4-15d2-43bc-826f-4e9f48e37174 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:03.163765 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 647/1272] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:23:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:23:03.170068 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c0cf5-550f-4aa2-8c09-42826bd3cc3b None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:03.259634 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:03.268150 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c0cf5-550f-4aa2-8c09-42826bd3cc3b None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:03.300846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a6130-a25e-49c2-8d39-93d656a48c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:03.301751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a6130-a25e-49c2-8d39-93d656a48c20 None admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:03.303214 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a6130-a25e-49c2-8d39-93d656a48c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:03.303214 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a6130-a25e-49c2-8d39-93d656a48c20 None admin] PATH_INFO: `/v3/projects/83100b3a5d584e39886c234391fdb204/users/4e38b7e84d6a43efbb4c1a52e2b3e681/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:03.304264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a6130-a25e-49c2-8d39-93d656a48c20 None admin] RBAC: Authorizing `identity:create_grant(project_id=83100b3a5d584e39886c234391fdb204, user_id=4e38b7e84d6a43efbb4c1a52e2b3e681, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:03.305709 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a6130-a25e-49c2-8d39-93d656a48c20 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:03.469316 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 626/1273] 10.222.0.57 () {58 vars in 1439 bytes} [Thu Jul 21 08:23:03 2022] PUT /identity/v3/projects/83100b3a5d584e39886c234391fdb204/users/4e38b7e84d6a43efbb4c1a52e2b3e681/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:23:05.467861 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0317a2-b2e6-44ff-81ac-51086be0995e None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:05.468444 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0317a2-b2e6-44ff-81ac-51086be0995e None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:05.468444 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0317a2-b2e6-44ff-81ac-51086be0995e None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:05.469847 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 648/1274] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:05.475873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c3b1d-90e7-4438-8e2b-cba3f4eeaeaf None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:05.476283 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c3b1d-90e7-4438-8e2b-cba3f4eeaeaf None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:05.476419 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c3b1d-90e7-4438-8e2b-cba3f4eeaeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:05.492968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-b02c3b1d-90e7-4438-8e2b-cba3f4eeaeaf None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:05.494176 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b02c3b1d-90e7-4438-8e2b-cba3f4eeaeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:05.560409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 627/1275] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:23:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:23:05.584211 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0317a2-b2e6-44ff-81ac-51086be0995e None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:05.684719 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0317a2-b2e6-44ff-81ac-51086be0995e None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:05.701601 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:05.718426 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61b262-1814-4e7c-a52b-0f4c800061fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:05.719143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61b262-1814-4e7c-a52b-0f4c800061fa None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:05.719422 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61b262-1814-4e7c-a52b-0f4c800061fa None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:05.719694 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61b262-1814-4e7c-a52b-0f4c800061fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:05.730494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61b262-1814-4e7c-a52b-0f4c800061fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 08:23:05.738081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-4d61b262-1814-4e7c-a52b-0f4c800061fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:23:05.738081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:23:05.738081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:23:05.738081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:23:05.738081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:23:05.738081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:23:05.738081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:23:05.738081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:23:05.738081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:23:05.738081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:23:05.738081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:23:05.738081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:23:05.738081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 08:23:05.738081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 08:23:05.738081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 08:23:05.738081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 08:23:05.739073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 08:23:05.739073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 08:23:05.739073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 08:23:05.739073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 08:23:05.739073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:23:05.739073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:23:05.739073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:23:05.739073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:23:05.739073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:23:05.739073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:23:05.739073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:23:05.739073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:23:05.739073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:23:05.739073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:23:05.739073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:23:05.739073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:23:05.739931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:23:05.739931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:23:05.739931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:23:05.739931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:23:05.739931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 08:23:05.739931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 08:23:05.739931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 08:23:05.739931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 08:23:05.739931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 08:23:05.739931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 08:23:05.739931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 08:23:05.739931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:23:05.739931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 649/1276] 10.222.0.57 () {56 vars in 1096 bytes} [Thu Jul 21 08:23:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:23:05.745355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c3b1d-90e7-4438-8e2b-cba3f4eeaeaf None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:05.824950 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:05.842677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c3b1d-90e7-4438-8e2b-cba3f4eeaeaf None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:05.875830 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c48fbd-195e-42e4-87db-5f140408c640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:05.876490 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c48fbd-195e-42e4-87db-5f140408c640 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:05.876775 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c48fbd-195e-42e4-87db-5f140408c640 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:05.877054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c48fbd-195e-42e4-87db-5f140408c640 None admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:05.877835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c48fbd-195e-42e4-87db-5f140408c640 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:23:05.878140 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c48fbd-195e-42e4-87db-5f140408c640 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:05.879499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c48fbd-195e-42e4-87db-5f140408c640 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:05.887366 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 628/1277] 10.222.0.57 () {56 vars in 1099 bytes} [Thu Jul 21 08:23:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:23:05.893033 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61b262-1814-4e7c-a52b-0f4c800061fa None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:05.997477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61b262-1814-4e7c-a52b-0f4c800061fa None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:06.031061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ae198-2e5f-46ee-82b4-2ae5f99bd1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:06.031848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ae198-2e5f-46ee-82b4-2ae5f99bd1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:06.032123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ae198-2e5f-46ee-82b4-2ae5f99bd1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:06.032396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ae198-2e5f-46ee-82b4-2ae5f99bd1f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:06.043140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ae198-2e5f-46ee-82b4-2ae5f99bd1f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:06.044569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ae198-2e5f-46ee-82b4-2ae5f99bd1f3 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:06.061499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-8e9ae198-2e5f-46ee-82b4-2ae5f99bd1f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:23:06.061499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:23:06.061499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:23:06.061499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:23:06.061499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:23:06.061499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:23:06.061499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:23:06.061499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:23:06.061499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:23:06.061499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:23:06.061499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:23:06.061499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:23:06.061499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:23:06.061499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:23:06.061499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:23:06.068188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:23:06.068188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:23:06.068188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:23:06.068188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:23:06.068188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:23:06.068188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:23:06.068188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:23:06.068188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:23:06.068188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:23:06.068188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:23:06.068188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:23:06.068188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:23:06.068188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:23:06.068188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:23:06.068188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:23:06.068188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:23:06.068188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:23:06.069835 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:23:06.069835 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:23:06.069835 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:23:06.069835 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:23:06.069835 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 650/1278] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:23:06.070129 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c48fbd-195e-42e4-87db-5f140408c640 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:06.167667 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c48fbd-195e-42e4-87db-5f140408c640 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:06.200711 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b77ead-0f5d-44f0-a154-c455e177ae76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:06.201370 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b77ead-0f5d-44f0-a154-c455e177ae76 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:06.201697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b77ead-0f5d-44f0-a154-c455e177ae76 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:06.201974 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b77ead-0f5d-44f0-a154-c455e177ae76 None admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:06.207964 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b77ead-0f5d-44f0-a154-c455e177ae76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:23:06.207964 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b77ead-0f5d-44f0-a154-c455e177ae76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:06.207964 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b77ead-0f5d-44f0-a154-c455e177ae76 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:06.217337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 629/1279] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:23:06.222970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ae198-2e5f-46ee-82b4-2ae5f99bd1f3 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:06.253231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:06.322547 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ae198-2e5f-46ee-82b4-2ae5f99bd1f3 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:06.356040 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7c486-1f3d-4363-ba25-20e56b4664b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:06.356833 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7c486-1f3d-4363-ba25-20e56b4664b2 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:06.357123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7c486-1f3d-4363-ba25-20e56b4664b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:06.357405 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c7c486-1f3d-4363-ba25-20e56b4664b2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:06.364769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7c486-1f3d-4363-ba25-20e56b4664b2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:06.366745 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c7c486-1f3d-4363-ba25-20e56b4664b2 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:06.380749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-66c7c486-1f3d-4363-ba25-20e56b4664b2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:23:06.380749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:23:06.380749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:23:06.380749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:23:06.380749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:23:06.380749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:23:06.380749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:23:06.380749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:23:06.380749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:23:06.380749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:23:06.380749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:23:06.380749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:23:06.380749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 08:23:06.380749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 08:23:06.380749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 08:23:06.380749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 08:23:06.389873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:23:06.389873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:23:06.389873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 08:23:06.389873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:23:06.389873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 08:23:06.389873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 08:23:06.389873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:23:06.389873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:23:06.389873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:23:06.389873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:23:06.389873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:23:06.389873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:23:06.389873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:23:06.389873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:23:06.389873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:23:06.389873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:23:06.389873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:23:06.389873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:23:06.391051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:23:06.391051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:23:06.391051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 08:23:06.391051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 08:23:06.391051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 08:23:06.391051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 08:23:06.391051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 08:23:06.391051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 08:23:06.391051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 08:23:06.391051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:23:06.391051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 651/1280] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:23:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:23:06.391822 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b77ead-0f5d-44f0-a154-c455e177ae76 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:06.392283 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:06.486556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b77ead-0f5d-44f0-a154-c455e177ae76 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:06.520054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4972f-1973-4da8-accc-3fd69069a086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:06.520647 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4972f-1973-4da8-accc-3fd69069a086 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:06.520930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4972f-1973-4da8-accc-3fd69069a086 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:06.521208 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4972f-1973-4da8-accc-3fd69069a086 None admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:06.522096 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4972f-1973-4da8-accc-3fd69069a086 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:23:06.522413 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4972f-1973-4da8-accc-3fd69069a086 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:06.523890 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4972f-1973-4da8-accc-3fd69069a086 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:06.540305 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 630/1281] 10.222.0.57 () {56 vars in 1143 bytes} [Thu Jul 21 08:23:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:23:06.546279 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7c486-1f3d-4363-ba25-20e56b4664b2 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:06.636780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:06.646052 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c7c486-1f3d-4363-ba25-20e56b4664b2 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:06.678730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f2f99-5f26-404d-ade9-4c7e5ad17597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:06.679371 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f2f99-5f26-404d-ade9-4c7e5ad17597 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:06.679660 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f2f99-5f26-404d-ade9-4c7e5ad17597 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:06.679937 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f2f99-5f26-404d-ade9-4c7e5ad17597 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:06.747595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f2f99-5f26-404d-ade9-4c7e5ad17597 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:06.749343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f2f99-5f26-404d-ade9-4c7e5ad17597 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:06.839084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:06.848942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 652/1282] 10.222.0.57 () {58 vars in 1282 bytes} [Thu Jul 21 08:23:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 08:23:06.855567 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4972f-1973-4da8-accc-3fd69069a086 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:06.916227 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:06.953332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4972f-1973-4da8-accc-3fd69069a086 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:06.986502 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1573336-6da6-4b4d-8aa9-6866ff40af52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:06.987275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1573336-6da6-4b4d-8aa9-6866ff40af52 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:06.987560 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1573336-6da6-4b4d-8aa9-6866ff40af52 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:06.987834 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1573336-6da6-4b4d-8aa9-6866ff40af52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:06.998170 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1573336-6da6-4b4d-8aa9-6866ff40af52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:06.999960 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1573336-6da6-4b4d-8aa9-6866ff40af52 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:07.017886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-c1573336-6da6-4b4d-8aa9-6866ff40af52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:23:07.017886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:23:07.017886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:23:07.017886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:23:07.017886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:23:07.017886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:23:07.017886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:23:07.017886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:23:07.017886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:23:07.017886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:23:07.017886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:23:07.017886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:23:07.017886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 08:23:07.017886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 08:23:07.017886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 08:23:07.018982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 08:23:07.018982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:23:07.018982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:23:07.018982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:23:07.018982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:23:07.018982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:23:07.018982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:23:07.018982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:23:07.018982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:23:07.018982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:23:07.018982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:23:07.018982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:23:07.018982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:23:07.018982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:23:07.018982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:23:07.018982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:23:07.018982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:23:07.020141 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 08:23:07.020141 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 08:23:07.020141 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 08:23:07.020141 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:23:07.020141 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 631/1283] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:23:07.024825 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f2f99-5f26-404d-ade9-4c7e5ad17597 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:07.124581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f2f99-5f26-404d-ade9-4c7e5ad17597 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:07.157431 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833821b-03fc-42a8-9f2e-40c03ffe4c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:07.158110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833821b-03fc-42a8-9f2e-40c03ffe4c7a None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:07.158392 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833821b-03fc-42a8-9f2e-40c03ffe4c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:07.158667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833821b-03fc-42a8-9f2e-40c03ffe4c7a None admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:07.159373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833821b-03fc-42a8-9f2e-40c03ffe4c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:23:07.159677 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833821b-03fc-42a8-9f2e-40c03ffe4c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:07.161028 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833821b-03fc-42a8-9f2e-40c03ffe4c7a None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:07.172446 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 653/1284] 10.222.0.57 () {56 vars in 1109 bytes} [Thu Jul 21 08:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:23:07.178323 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1573336-6da6-4b4d-8aa9-6866ff40af52 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:07.282996 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1573336-6da6-4b4d-8aa9-6866ff40af52 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:07.297206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:07.316685 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c141234-a628-4f37-803c-010749f53166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:07.317465 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c141234-a628-4f37-803c-010749f53166 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:07.321760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c141234-a628-4f37-803c-010749f53166 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:07.321760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c141234-a628-4f37-803c-010749f53166 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:07.324573 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c141234-a628-4f37-803c-010749f53166 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:07.326122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c141234-a628-4f37-803c-010749f53166 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:07.341338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application [None req-1c141234-a628-4f37-803c-010749f53166 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:23:07.341338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:23:07.341338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:23:07.341338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:23:07.341338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:23:07.341338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:23:07.341338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:23:07.341338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:23:07.341338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:23:07.341338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:23:07.341338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:23:07.341338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:23:07.341338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 08:23:07.341338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 08:23:07.341338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 08:23:07.345723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 08:23:07.345723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:23:07.345723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:23:07.345723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:23:07.345723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:23:07.345723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:23:07.345723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:23:07.345723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:23:07.345723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application with Lock( Jul 21 08:23:07.345723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:23:07.345723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:23:07.345723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:23:07.345723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:23:07.345723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:23:07.345723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:23:07.345723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:23:07.345723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:23:07.346848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 08:23:07.346848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 08:23:07.346848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 08:23:07.346848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 08:23:07.346848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 08:23:07.346848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 08:23:07.346848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 08:23:07.346848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: ERROR keystone.server.flask.application Jul 21 08:23:07.346848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 632/1285] 10.222.0.57 () {56 vars in 1111 bytes} [Thu Jul 21 08:23:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:23:07.349479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833821b-03fc-42a8-9f2e-40c03ffe4c7a None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:07.401213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:07.450527 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833821b-03fc-42a8-9f2e-40c03ffe4c7a None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:07.483714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298c63c-b3be-4516-9ae2-73d4bf36a452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:07.484362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298c63c-b3be-4516-9ae2-73d4bf36a452 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:07.484644 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298c63c-b3be-4516-9ae2-73d4bf36a452 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:07.484917 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298c63c-b3be-4516-9ae2-73d4bf36a452 None admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:07.485751 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298c63c-b3be-4516-9ae2-73d4bf36a452 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:23:07.486058 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298c63c-b3be-4516-9ae2-73d4bf36a452 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:07.487486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298c63c-b3be-4516-9ae2-73d4bf36a452 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:07.499567 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 654/1286] 10.222.0.57 () {56 vars in 1148 bytes} [Thu Jul 21 08:23:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:23:07.505883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c141234-a628-4f37-803c-010749f53166 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:07.607779 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c141234-a628-4f37-803c-010749f53166 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:07.645019 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf27ef-38d6-4f97-926c-30a565ad3dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:07.645710 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf27ef-38d6-4f97-926c-30a565ad3dde None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:07.645999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf27ef-38d6-4f97-926c-30a565ad3dde None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:07.646279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf27ef-38d6-4f97-926c-30a565ad3dde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:07.647135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf27ef-38d6-4f97-926c-30a565ad3dde None admin] RBAC: Adding query filter params (role.id=beed8caad097496292e544146859df5c, scope.project.id=83100b3a5d584e39886c234391fdb204, user.id=4e38b7e84d6a43efbb4c1a52e2b3e681) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:23:07.647452 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf27ef-38d6-4f97-926c-30a565ad3dde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:07.649631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf27ef-38d6-4f97-926c-30a565ad3dde None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:07.666191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 633/1287] 10.222.0.57 () {56 vars in 1374 bytes} [Thu Jul 21 08:23:07 2022] GET /identity/v3/role_assignments?user.id=4e38b7e84d6a43efbb4c1a52e2b3e681&scope.project.id=83100b3a5d584e39886c234391fdb204&role.id=beed8caad097496292e544146859df5c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:23:09.730770 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fe4f5-d469-4e0c-a7b9-6f1df4e98314 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:09.731348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fe4f5-d469-4e0c-a7b9-6f1df4e98314 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:09.731493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fe4f5-d469-4e0c-a7b9-6f1df4e98314 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:09.732870 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 655/1288] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:09.738139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde2df8-897a-4b85-9980-f86360aefc67 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:09.738560 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde2df8-897a-4b85-9980-f86360aefc67 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:09.738724 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde2df8-897a-4b85-9980-f86360aefc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:09.756013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-9cde2df8-897a-4b85-9980-f86360aefc67 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:09.757769 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9cde2df8-897a-4b85-9980-f86360aefc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:09.787250 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:09.823591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 634/1289] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:23:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:23:09.846666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fe4f5-d469-4e0c-a7b9-6f1df4e98314 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:09.948310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fe4f5-d469-4e0c-a7b9-6f1df4e98314 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:09.959346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:09.982719 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cdd94-75b9-40db-899d-aca7f6a3e55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:09.983435 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cdd94-75b9-40db-899d-aca7f6a3e55e None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:09.983715 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cdd94-75b9-40db-899d-aca7f6a3e55e None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:09.983987 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cdd94-75b9-40db-899d-aca7f6a3e55e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:09.984624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cdd94-75b9-40db-899d-aca7f6a3e55e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:09.986004 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cdd94-75b9-40db-899d-aca7f6a3e55e None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:09.997451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-ef1cdd94-75b9-40db-899d-aca7f6a3e55e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:23:09.997451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:23:09.997451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:23:09.997451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:23:09.997451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:23:09.997451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:23:09.997451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:23:09.997451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:23:09.997451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:23:09.997451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:23:09.997451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:23:09.997451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:23:09.997451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:23:09.997451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:23:09.997451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:23:09.997451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:23:09.997451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:23:09.998705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:23:09.998705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:23:09.998705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:23:09.998705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:23:09.998705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:23:09.998705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:23:09.998705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:23:09.998705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:23:09.998705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:23:09.998705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:23:09.998705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:23:09.998705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:23:09.998705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:23:09.998705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:23:09.998705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:23:09.998705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:23:09.999767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:23:09.999767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:23:09.999767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:23:09.999767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:23:09.999767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:23:09.999767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:23:09.999767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:23:09.999767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:23:09.999767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:23:09.999767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:23:09.999767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:23:09.999767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:23:09.999767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:23:09.999767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:23:09.999767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 656/1290] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Jul 21 08:23:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:23:10.004579 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde2df8-897a-4b85-9980-f86360aefc67 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:10.102437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde2df8-897a-4b85-9980-f86360aefc67 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:10.135800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3bd46a-af16-4521-aae4-21050df56394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:10.136453 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bd46a-af16-4521-aae4-21050df56394 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:10.136736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bd46a-af16-4521-aae4-21050df56394 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:10.137009 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3bd46a-af16-4521-aae4-21050df56394 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:10.137738 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bd46a-af16-4521-aae4-21050df56394 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:23:10.138047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bd46a-af16-4521-aae4-21050df56394 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:10.139411 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3bd46a-af16-4521-aae4-21050df56394 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:10.144212 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 635/1291] 10.222.0.57 () {56 vars in 1116 bytes} [Thu Jul 21 08:23:10 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:23:10.150177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cdd94-75b9-40db-899d-aca7f6a3e55e None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:10.250912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cdd94-75b9-40db-899d-aca7f6a3e55e None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:10.283989 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21eafdc-0e41-4f7c-ac52-f13306fcc649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:10.284639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eafdc-0e41-4f7c-ac52-f13306fcc649 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:10.284925 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eafdc-0e41-4f7c-ac52-f13306fcc649 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:10.299504 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eafdc-0e41-4f7c-ac52-f13306fcc649 None admin] PATH_INFO: `/v3/services` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:10.299504 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21eafdc-0e41-4f7c-ac52-f13306fcc649 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:23:10.299504 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21eafdc-0e41-4f7c-ac52-f13306fcc649 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:10.299504 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21eafdc-0e41-4f7c-ac52-f13306fcc649 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:10.299504 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 657/1292] 10.222.0.57 () {56 vars in 1116 bytes} [Thu Jul 21 08:23:10 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:23:12.346004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ed6ef-4ee0-4c9b-95c6-543b9e2162dc None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:12.346620 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ed6ef-4ee0-4c9b-95c6-543b9e2162dc None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:12.346620 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ed6ef-4ee0-4c9b-95c6-543b9e2162dc None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:12.347948 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 636/1293] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:12.353383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9e92f-9b15-4702-b193-af97fb064a8f None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:12.353781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9e92f-9b15-4702-b193-af97fb064a8f None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:12.353981 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9e92f-9b15-4702-b193-af97fb064a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:12.371898 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-adf9e92f-9b15-4702-b193-af97fb064a8f None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:12.373084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-adf9e92f-9b15-4702-b193-af97fb064a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:12.402229 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:12.438487 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 658/1294] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:23:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:23:12.461668 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ed6ef-4ee0-4c9b-95c6-543b9e2162dc None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:12.492542 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:12.560381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ed6ef-4ee0-4c9b-95c6-543b9e2162dc None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:12.593887 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ff380-c543-4c90-ba04-8b678e751b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:12.594535 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ff380-c543-4c90-ba04-8b678e751b47 None admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:12.594814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ff380-c543-4c90-ba04-8b678e751b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:12.595083 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ff380-c543-4c90-ba04-8b678e751b47 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:12.595800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ff380-c543-4c90-ba04-8b678e751b47 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:12.597256 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ff380-c543-4c90-ba04-8b678e751b47 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:12.667470 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 637/1295] 10.222.0.57 () {60 vars in 1141 bytes} [Thu Jul 21 08:23:12 2022] POST /identity/v3/services => generated 246 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:23:14.719753 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3f7a2-0651-4c6b-99e0-d67fe889fc87 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:14.720290 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3f7a2-0651-4c6b-99e0-d67fe889fc87 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:14.720384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3f7a2-0651-4c6b-99e0-d67fe889fc87 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:14.721756 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 659/1296] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:14.727228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea90033-d900-4b67-b2f0-ebbd8051c9da None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:14.731355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea90033-d900-4b67-b2f0-ebbd8051c9da None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:14.731355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea90033-d900-4b67-b2f0-ebbd8051c9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:14.745208 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-6ea90033-d900-4b67-b2f0-ebbd8051c9da None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:14.746444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-6ea90033-d900-4b67-b2f0-ebbd8051c9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:14.818204 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 638/1297] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:23:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:23:14.842242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3f7a2-0651-4c6b-99e0-d67fe889fc87 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:14.941963 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3f7a2-0651-4c6b-99e0-d67fe889fc87 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:14.975336 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffecbb9-f2b6-40be-8f26-d3e0d68c75f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:14.976559 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffecbb9-f2b6-40be-8f26-d3e0d68c75f4 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:14.976836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffecbb9-f2b6-40be-8f26-d3e0d68c75f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:14.977113 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffecbb9-f2b6-40be-8f26-d3e0d68c75f4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:14.977778 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffecbb9-f2b6-40be-8f26-d3e0d68c75f4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:14.979125 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffecbb9-f2b6-40be-8f26-d3e0d68c75f4 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:14.990659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-4ffecbb9-f2b6-40be-8f26-d3e0d68c75f4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:23:14.990659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:23:14.990659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:23:14.990659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:23:14.990659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:23:14.990659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:23:14.990659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:23:14.990659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:23:14.990659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:23:14.990659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:23:14.990659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:23:14.990659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:23:14.990659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:23:14.990659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:23:14.990659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:23:14.990659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:23:14.990659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:23:14.992436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:23:14.992436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:23:14.992436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:23:14.992436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:23:14.992436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:23:14.992436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:23:14.992436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:23:14.992436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:23:14.992436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:23:14.992436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:23:14.992436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:23:14.992436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:23:14.992436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:23:14.992436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:23:14.992436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:23:14.992436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:23:14.993483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:23:14.993483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:23:14.993483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:23:14.993483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:23:14.993483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:23:14.993483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:23:14.993483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:23:14.993483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:23:14.993483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:23:14.993483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:23:14.993483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:23:14.993483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:23:14.993483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:23:14.993483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:23:14.993483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 660/1298] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Jul 21 08:23:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:23:14.998592 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea90033-d900-4b67-b2f0-ebbd8051c9da None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:15.017661 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:15.094778 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea90033-d900-4b67-b2f0-ebbd8051c9da None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:15.126583 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f0b60-f01e-471a-aa2a-f6aa2b8c6740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:15.127235 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0b60-f01e-471a-aa2a-f6aa2b8c6740 None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:15.127517 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0b60-f01e-471a-aa2a-f6aa2b8c6740 None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:15.127796 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0b60-f01e-471a-aa2a-f6aa2b8c6740 None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:15.128492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f0b60-f01e-471a-aa2a-f6aa2b8c6740 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:23:15.128797 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f0b60-f01e-471a-aa2a-f6aa2b8c6740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:15.130193 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f0b60-f01e-471a-aa2a-f6aa2b8c6740 None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:15.135814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 639/1299] 10.222.0.57 () {56 vars in 1116 bytes} [Thu Jul 21 08:23:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:23:15.141887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffecbb9-f2b6-40be-8f26-d3e0d68c75f4 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:15.173402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:15.240039 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffecbb9-f2b6-40be-8f26-d3e0d68c75f4 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:15.275045 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82509e-a63d-4611-98e7-e3c2c43395e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:15.275754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82509e-a63d-4611-98e7-e3c2c43395e7 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:15.276008 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82509e-a63d-4611-98e7-e3c2c43395e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:15.276282 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82509e-a63d-4611-98e7-e3c2c43395e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:15.277061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82509e-a63d-4611-98e7-e3c2c43395e7 None admin] RBAC: Adding query filter params (interface=public, service_id=a102e72ebe784517bcd62f7d5c521969, region_id=RegionOne) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:23:15.277371 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82509e-a63d-4611-98e7-e3c2c43395e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:15.278761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82509e-a63d-4611-98e7-e3c2c43395e7 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:15.283927 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 661/1300] 10.222.0.57 () {56 vars in 1251 bytes} [Thu Jul 21 08:23:15 2022] GET /identity/v3/endpoints?service_id=a102e72ebe784517bcd62f7d5c521969&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:23:15.289627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f0b60-f01e-471a-aa2a-f6aa2b8c6740 None admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:15.368334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:15.385850 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f0b60-f01e-471a-aa2a-f6aa2b8c6740 None admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:15.417860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23769ab2-1a55-42ba-b85e-ca407342798e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:15.418502 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23769ab2-1a55-42ba-b85e-ca407342798e None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:15.418783 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23769ab2-1a55-42ba-b85e-ca407342798e None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:15.419062 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23769ab2-1a55-42ba-b85e-ca407342798e None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:15.419740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23769ab2-1a55-42ba-b85e-ca407342798e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:15.421110 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23769ab2-1a55-42ba-b85e-ca407342798e None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:15.427783 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 640/1301] 10.222.0.57 () {56 vars in 1087 bytes} [Thu Jul 21 08:23:15 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:23:17.496291 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc1605-2279-4443-b3b7-e65d5b78c885 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:17.496826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc1605-2279-4443-b3b7-e65d5b78c885 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:17.496826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc1605-2279-4443-b3b7-e65d5b78c885 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:17.498219 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 662/1302] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:23:17.503292 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119def93-1887-4213-baf0-710a1e74f7f9 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:17.503762 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119def93-1887-4213-baf0-710a1e74f7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:17.503856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119def93-1887-4213-baf0-710a1e74f7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:17.519655 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-119def93-1887-4213-baf0-710a1e74f7f9 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:23:17.520835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-119def93-1887-4213-baf0-710a1e74f7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:23:17.586636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 641/1303] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:23:17 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 08:23:17.610397 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc1605-2279-4443-b3b7-e65d5b78c885 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:17.703524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:17.710589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc1605-2279-4443-b3b7-e65d5b78c885 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:17.744242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95e505-07c4-496e-9b5c-e273098fe989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:17.745029 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95e505-07c4-496e-9b5c-e273098fe989 None admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:17.745310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95e505-07c4-496e-9b5c-e273098fe989 None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:17.745617 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95e505-07c4-496e-9b5c-e273098fe989 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:17.746264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95e505-07c4-496e-9b5c-e273098fe989 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:17.747674 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d95e505-07c4-496e-9b5c-e273098fe989 None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:17.759568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-9d95e505-07c4-496e-9b5c-e273098fe989 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:23:17.759568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:23:17.759568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 08:23:17.759568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 08:23:17.759568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 08:23:17.759568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 08:23:17.759568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 08:23:17.759568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:23:17.759568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:23:17.759568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:23:17.759568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 08:23:17.759568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:23:17.759568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 08:23:17.759568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 08:23:17.759568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 08:23:17.759568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 08:23:17.759568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 08:23:17.760780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 08:23:17.760780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 08:23:17.760780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 08:23:17.760780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 08:23:17.760780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 08:23:17.760780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 08:23:17.760780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 08:23:17.760780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 08:23:17.760780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 08:23:17.760780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 08:23:17.760780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 08:23:17.760780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 08:23:17.760780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 08:23:17.760780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 08:23:17.760780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 08:23:17.760780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 08:23:17.762001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 08:23:17.762001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 08:23:17.762001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 08:23:17.762001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 08:23:17.762001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 08:23:17.762001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 08:23:17.762001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 08:23:17.762001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 08:23:17.762001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 08:23:17.762001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 08:23:17.762001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 08:23:17.762001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 08:23:17.762001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 08:23:17.762001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 08:23:17.762001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 663/1304] 10.222.0.57 () {56 vars in 1117 bytes} [Thu Jul 21 08:23:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 08:23:17.766707 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119def93-1887-4213-baf0-710a1e74f7f9 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:17.840746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:17.862953 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119def93-1887-4213-baf0-710a1e74f7f9 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:17.894292 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b6f4b-34f6-4bc2-8feb-fc59b38392bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:17.894964 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b6f4b-34f6-4bc2-8feb-fc59b38392bf None admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:17.895246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b6f4b-34f6-4bc2-8feb-fc59b38392bf None admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:17.895520 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b6f4b-34f6-4bc2-8feb-fc59b38392bf None admin] PATH_INFO: `/v3/services` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:17.896220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b6f4b-34f6-4bc2-8feb-fc59b38392bf None admin] RBAC: Adding query filter params (name=placement) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:23:17.896526 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b6f4b-34f6-4bc2-8feb-fc59b38392bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:17.898493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b6f4b-34f6-4bc2-8feb-fc59b38392bf None admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:17.903553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 642/1305] 10.222.0.57 () {56 vars in 1116 bytes} [Thu Jul 21 08:23:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:23:17.909315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95e505-07c4-496e-9b5c-e273098fe989 None admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:23:18.007912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95e505-07c4-496e-9b5c-e273098fe989 None admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:23:18.040479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03530502-997c-4e89-8ed7-873c04e8682d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:23:18.041124 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530502-997c-4e89-8ed7-873c04e8682d None admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:23:18.041403 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530502-997c-4e89-8ed7-873c04e8682d None admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:23:18.041714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03530502-997c-4e89-8ed7-873c04e8682d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:23:18.042432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03530502-997c-4e89-8ed7-873c04e8682d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:23:18.043796 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03530502-997c-4e89-8ed7-873c04e8682d None admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:23:18.118071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 664/1306] 10.222.0.57 () {60 vars in 1144 bytes} [Thu Jul 21 08:23:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:23:27.925643 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=30 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:23:28.113180 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:53.603453 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c412149-a915-49fe-8f7f-252d3832215b None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:53.605475 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c412149-a915-49fe-8f7f-252d3832215b None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:53.606071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c412149-a915-49fe-8f7f-252d3832215b None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:53.608027 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 643/1307] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:28:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:28:53.612944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db894d-3a4a-46d1-839c-5422713aac05 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:53.613372 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db894d-3a4a-46d1-839c-5422713aac05 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:53.613645 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db894d-3a4a-46d1-839c-5422713aac05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:53.688819 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-16db894d-3a4a-46d1-839c-5422713aac05 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:53.690343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-16db894d-3a4a-46d1-839c-5422713aac05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:53.847731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 665/1308] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:53.889439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab693a9-fdbe-4e9a-aa9b-c4e3d90de821 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:53.890096 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab693a9-fdbe-4e9a-aa9b-c4e3d90de821 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:53.890301 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab693a9-fdbe-4e9a-aa9b-c4e3d90de821 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:53.892803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 644/1309] 10.222.0.57 () {54 vars in 965 bytes} [Thu Jul 21 08:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:28:53.898203 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc9aa7-9414-4272-b01d-86d7701b519e None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:53.898516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc9aa7-9414-4272-b01d-86d7701b519e None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:53.898764 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc9aa7-9414-4272-b01d-86d7701b519e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:53.993258 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-27dc9aa7-9414-4272-b01d-86d7701b519e None None] MFA Rules not processed for user `a25749f3a7c84c50b860538d1b661901`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:53.995677 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-27dc9aa7-9414-4272-b01d-86d7701b519e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:54.026810 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:54.100912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 666/1310] 10.222.0.57 () {58 vars in 1062 bytes} [Thu Jul 21 08:28:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:28:54.110813 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab693a9-fdbe-4e9a-aa9b-c4e3d90de821 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:54.112479 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-0ab693a9-fdbe-4e9a-aa9b-c4e3d90de821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:54.234886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab693a9-fdbe-4e9a-aa9b-c4e3d90de821 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:54.310589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e25f3-0f1e-4b94-86a8-5fdd825180a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:54.311243 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e25f3-0f1e-4b94-86a8-5fdd825180a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:54.311525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e25f3-0f1e-4b94-86a8-5fdd825180a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:54.311796 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e25f3-0f1e-4b94-86a8-5fdd825180a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:54.313437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e07e25f3-0f1e-4b94-86a8-5fdd825180a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:54.369382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:54.429538 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e25f3-0f1e-4b94-86a8-5fdd825180a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:54.431101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e25f3-0f1e-4b94-86a8-5fdd825180a1 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:54.452787 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 645/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:56.785354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a43c9-96a9-4630-adf8-eca855848197 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:56.786539 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a43c9-96a9-4630-adf8-eca855848197 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:56.786539 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a43c9-96a9-4630-adf8-eca855848197 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:56.791827 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 667/1312] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:28:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:28:56.793250 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7d7c1-1a9e-4e75-90c4-9127ade5007c None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:56.793766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7d7c1-1a9e-4e75-90c4-9127ade5007c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:56.793858 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7d7c1-1a9e-4e75-90c4-9127ade5007c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:56.889649 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-bbf7d7c1-1a9e-4e75-90c4-9127ade5007c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:56.891188 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-bbf7d7c1-1a9e-4e75-90c4-9127ade5007c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:57.000730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 646/1313] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:28:57.040131 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a43c9-96a9-4630-adf8-eca855848197 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:28:57.042167 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-452a43c9-96a9-4630-adf8-eca855848197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:57.158409 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a43c9-96a9-4630-adf8-eca855848197 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:28:57.242675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:28:57.245390 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb17774-7d80-4c2d-a00c-43c96de2276f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:28:57.246076 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb17774-7d80-4c2d-a00c-43c96de2276f service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:57.246361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb17774-7d80-4c2d-a00c-43c96de2276f service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:57.246637 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb17774-7d80-4c2d-a00c-43c96de2276f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:57.248280 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-1eb17774-7d80-4c2d-a00c-43c96de2276f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:28:57.361989 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb17774-7d80-4c2d-a00c-43c96de2276f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:28:57.363440 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb17774-7d80-4c2d-a00c-43c96de2276f service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:28:57.381452 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 668/1314] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:28:59.906740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c2ee4-d69e-44b3-a8b6-ba545c47bea3 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:59.907297 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c2ee4-d69e-44b3-a8b6-ba545c47bea3 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:59.907297 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847c2ee4-d69e-44b3-a8b6-ba545c47bea3 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:59.908678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 647/1315] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:28:59.913905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dae67-63b5-4d9a-937a-6c1f832a7c72 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:28:59.914301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dae67-63b5-4d9a-937a-6c1f832a7c72 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:28:59.914481 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dae67-63b5-4d9a-937a-6c1f832a7c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:28:59.977021 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-388dae67-63b5-4d9a-937a-6c1f832a7c72 None None] MFA Rules not processed for user `69fe4d5dce224172895110b1387bdbed`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:28:59.978264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-388dae67-63b5-4d9a-937a-6c1f832a7c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:00.030442 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:00.073788 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 669/1316] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:28:59 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:00.113376 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c2ee4-d69e-44b3-a8b6-ba545c47bea3 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:00.115022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-847c2ee4-d69e-44b3-a8b6-ba545c47bea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:00.125425 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:00.218606 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847c2ee4-d69e-44b3-a8b6-ba545c47bea3 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:00.290524 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff7d27-e782-410c-bb5d-3ea171ef18e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:00.291098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff7d27-e782-410c-bb5d-3ea171ef18e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:00.291382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff7d27-e782-410c-bb5d-3ea171ef18e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:00.292243 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff7d27-e782-410c-bb5d-3ea171ef18e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:00.293933 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f5ff7d27-e782-410c-bb5d-3ea171ef18e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:00.353621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:00.398860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff7d27-e782-410c-bb5d-3ea171ef18e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:00.400300 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff7d27-e782-410c-bb5d-3ea171ef18e1 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:00.419441 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 648/1317] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:00 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:29:03.156677 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd09e02-f648-4897-a6d9-e80009603240 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:03.157198 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd09e02-f648-4897-a6d9-e80009603240 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:03.157300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd09e02-f648-4897-a6d9-e80009603240 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:03.158648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 670/1318] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:29:03.164012 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017cc46-7d1d-407f-b884-70b6c4263119 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:03.164444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017cc46-7d1d-407f-b884-70b6c4263119 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:03.164569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017cc46-7d1d-407f-b884-70b6c4263119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:03.230332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-4017cc46-7d1d-407f-b884-70b6c4263119 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:03.231538 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-4017cc46-7d1d-407f-b884-70b6c4263119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:03.325725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 649/1319] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:29:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:03.365515 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd09e02-f648-4897-a6d9-e80009603240 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:03.367071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-dfd09e02-f648-4897-a6d9-e80009603240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:03.467489 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd09e02-f648-4897-a6d9-e80009603240 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:03.541837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb489ab-3aab-421c-8698-28473300aec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:03.542487 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb489ab-3aab-421c-8698-28473300aec0 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:03.542774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb489ab-3aab-421c-8698-28473300aec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:03.543055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb489ab-3aab-421c-8698-28473300aec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:03.544746 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-dfb489ab-3aab-421c-8698-28473300aec0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:03.552270 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:03.658813 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb489ab-3aab-421c-8698-28473300aec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:03.660269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb489ab-3aab-421c-8698-28473300aec0 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:03.678652 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 671/1320] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:29:06.884975 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e61396-6300-4b0f-8060-71da585b982e None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:06.885560 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e61396-6300-4b0f-8060-71da585b982e None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:06.885560 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e61396-6300-4b0f-8060-71da585b982e None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:06.886931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 650/1321] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:29:06.892140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f7c2c-9227-4911-9f3c-ac5e1c4d64c8 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:06.892565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f7c2c-9227-4911-9f3c-ac5e1c4d64c8 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:06.892724 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f7c2c-9227-4911-9f3c-ac5e1c4d64c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:06.958396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-057f7c2c-9227-4911-9f3c-ac5e1c4d64c8 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:06.959518 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-057f7c2c-9227-4911-9f3c-ac5e1c4d64c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:07.016674 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:07.059705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 672/1322] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:07.096835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e61396-6300-4b0f-8060-71da585b982e None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:07.098618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a8e61396-6300-4b0f-8060-71da585b982e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:07.120841 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:07.213117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e61396-6300-4b0f-8060-71da585b982e None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:07.293146 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1e24f-4bc6-4d56-a290-1df3716f84a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:07.293831 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1e24f-4bc6-4d56-a290-1df3716f84a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:07.294117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1e24f-4bc6-4d56-a290-1df3716f84a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:07.294393 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1e24f-4bc6-4d56-a290-1df3716f84a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:07.296056 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-80a1e24f-4bc6-4d56-a290-1df3716f84a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:07.367098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:07.404911 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1e24f-4bc6-4d56-a290-1df3716f84a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:07.406389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a1e24f-4bc6-4d56-a290-1df3716f84a4 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:07.424609 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 651/1323] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:29:09.516067 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc609cdd-4afe-4aa2-85ee-11c594b35aa5 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:09.516586 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc609cdd-4afe-4aa2-85ee-11c594b35aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:09.516586 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc609cdd-4afe-4aa2-85ee-11c594b35aa5 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:09.517944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 673/1324] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:29:09.523095 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9663d-a8ec-4c66-9187-e50f1e379368 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:09.523523 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9663d-a8ec-4c66-9187-e50f1e379368 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:09.523793 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9663d-a8ec-4c66-9187-e50f1e379368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:09.586240 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-33f9663d-a8ec-4c66-9187-e50f1e379368 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:09.587460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-33f9663d-a8ec-4c66-9187-e50f1e379368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:09.685436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 652/1325] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:09.736395 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc0bac-41f5-4b55-88ab-337910cf9edb None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:09.736683 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc0bac-41f5-4b55-88ab-337910cf9edb None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:09.736963 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc0bac-41f5-4b55-88ab-337910cf9edb None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:09.738386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 674/1326] 10.222.0.57 () {54 vars in 965 bytes} [Thu Jul 21 08:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:29:09.744420 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab3b60-02bb-4b18-a828-0e15fd116236 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:09.745299 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab3b60-02bb-4b18-a828-0e15fd116236 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:09.745613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab3b60-02bb-4b18-a828-0e15fd116236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:09.775364 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:09.818783 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-0fab3b60-02bb-4b18-a828-0e15fd116236 None None] MFA Rules not processed for user `a25749f3a7c84c50b860538d1b661901`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:09.820383 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-0fab3b60-02bb-4b18-a828-0e15fd116236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:09.894778 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 653/1327] 10.222.0.57 () {58 vars in 1062 bytes} [Thu Jul 21 08:29:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:09.904133 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc0bac-41f5-4b55-88ab-337910cf9edb None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:09.905732 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-03fc0bac-41f5-4b55-88ab-337910cf9edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:10.019834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc0bac-41f5-4b55-88ab-337910cf9edb None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:10.094059 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cced95d-66de-4920-8ade-d8a288d68861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:10.094636 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cced95d-66de-4920-8ade-d8a288d68861 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:10.094917 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cced95d-66de-4920-8ade-d8a288d68861 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:10.095193 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cced95d-66de-4920-8ade-d8a288d68861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:10.096828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4cced95d-66de-4920-8ade-d8a288d68861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:10.119950 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:10.214610 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cced95d-66de-4920-8ade-d8a288d68861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:10.216060 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cced95d-66de-4920-8ade-d8a288d68861 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:10.234765 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 675/1328] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:29:12.560994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4273b-aeba-49ad-a693-d59494d77c64 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:12.561477 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4273b-aeba-49ad-a693-d59494d77c64 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:12.561597 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4273b-aeba-49ad-a693-d59494d77c64 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:12.562977 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 654/1329] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:29:12.568189 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cd1d3-6a13-40c4-9ac3-27d4126d6e42 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:12.568593 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cd1d3-6a13-40c4-9ac3-27d4126d6e42 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:12.568756 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cd1d3-6a13-40c4-9ac3-27d4126d6e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:12.632772 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-b73cd1d3-6a13-40c4-9ac3-27d4126d6e42 None None] MFA Rules not processed for user `69fe4d5dce224172895110b1387bdbed`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:12.634006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b73cd1d3-6a13-40c4-9ac3-27d4126d6e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:12.726898 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:12.752808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 676/1330] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:29:12 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:12.791567 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4273b-aeba-49ad-a693-d59494d77c64 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:12.793113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-41b4273b-aeba-49ad-a693-d59494d77c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:12.895576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4273b-aeba-49ad-a693-d59494d77c64 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:12.915661 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:12.969466 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e3790-f42f-41ef-b270-55ab4e9078a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:12.970147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e3790-f42f-41ef-b270-55ab4e9078a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:12.970430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e3790-f42f-41ef-b270-55ab4e9078a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:12.970703 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e3790-f42f-41ef-b270-55ab4e9078a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:12.972373 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-fb2e3790-f42f-41ef-b270-55ab4e9078a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:13.080786 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e3790-f42f-41ef-b270-55ab4e9078a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:13.082299 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e3790-f42f-41ef-b270-55ab4e9078a2 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:13.100870 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 655/1331] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:12 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:29:15.740055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72a561-6373-407d-a334-793ba3824dc9 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:15.740592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72a561-6373-407d-a334-793ba3824dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:15.740592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72a561-6373-407d-a334-793ba3824dc9 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:15.742119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 677/1332] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:29:15.747469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a231-12dd-4c3e-824a-cadc519bf258 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:15.747876 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a231-12dd-4c3e-824a-cadc519bf258 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:15.748025 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38a231-12dd-4c3e-824a-cadc519bf258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:15.810054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:15.812689 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-4f38a231-12dd-4c3e-824a-cadc519bf258 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:15.813919 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-4f38a231-12dd-4c3e-824a-cadc519bf258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:15.908985 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 656/1333] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:15.945082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72a561-6373-407d-a334-793ba3824dc9 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:15.946707 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ba72a561-6373-407d-a334-793ba3824dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:16.049589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72a561-6373-407d-a334-793ba3824dc9 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:16.122840 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857432d-af02-4d12-aa0e-f18754b21f7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:16.123484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857432d-af02-4d12-aa0e-f18754b21f7a service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:16.123769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857432d-af02-4d12-aa0e-f18754b21f7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:16.124048 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857432d-af02-4d12-aa0e-f18754b21f7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:16.125725 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-8857432d-af02-4d12-aa0e-f18754b21f7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:16.152124 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:16.232699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857432d-af02-4d12-aa0e-f18754b21f7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:16.234175 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857432d-af02-4d12-aa0e-f18754b21f7a service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:16.252206 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 678/1334] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:29:18.310011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c90bf9-de3e-4159-829d-a866070c84e6 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:18.310547 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c90bf9-de3e-4159-829d-a866070c84e6 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:18.310642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c90bf9-de3e-4159-829d-a866070c84e6 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:18.311948 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 657/1335] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:29:18.317198 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d865a5-8f44-4010-9cb3-4ec4e93d7c30 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:18.317616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d865a5-8f44-4010-9cb3-4ec4e93d7c30 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:18.317791 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d865a5-8f44-4010-9cb3-4ec4e93d7c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:18.380802 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-67d865a5-8f44-4010-9cb3-4ec4e93d7c30 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:18.382025 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-67d865a5-8f44-4010-9cb3-4ec4e93d7c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:18.454297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:18.476461 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 679/1336] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:18.517644 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c90bf9-de3e-4159-829d-a866070c84e6 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:18.519210 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-47c90bf9-de3e-4159-829d-a866070c84e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:18.622041 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c90bf9-de3e-4159-829d-a866070c84e6 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:18.649071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:18.694177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f45432-de5d-4002-9d2a-27438b8ced78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:18.694824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f45432-de5d-4002-9d2a-27438b8ced78 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:18.695106 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f45432-de5d-4002-9d2a-27438b8ced78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:18.695383 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f45432-de5d-4002-9d2a-27438b8ced78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:18.697030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-09f45432-de5d-4002-9d2a-27438b8ced78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:18.803809 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f45432-de5d-4002-9d2a-27438b8ced78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:18.805262 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f45432-de5d-4002-9d2a-27438b8ced78 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:18.823582 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 658/1337] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:29:21.410930 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70d317-0af6-4a1e-bc69-4bcd9767be36 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:21.411487 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70d317-0af6-4a1e-bc69-4bcd9767be36 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:21.411487 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70d317-0af6-4a1e-bc69-4bcd9767be36 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:21.412885 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 680/1338] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:29:21.418577 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a500ba-0826-443b-802d-81f6e88ac11e None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:21.418979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a500ba-0826-443b-802d-81f6e88ac11e None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:21.419193 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a500ba-0826-443b-802d-81f6e88ac11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:21.482509 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-48a500ba-0826-443b-802d-81f6e88ac11e None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:21.483665 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-48a500ba-0826-443b-802d-81f6e88ac11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:21.491737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:21.578606 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 659/1339] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:29:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:21.614885 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70d317-0af6-4a1e-bc69-4bcd9767be36 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:21.616411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-6b70d317-0af6-4a1e-bc69-4bcd9767be36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:21.719324 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70d317-0af6-4a1e-bc69-4bcd9767be36 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:21.792012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f919de7-b353-450a-8f7d-d7c5a2d97036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:21.792661 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f919de7-b353-450a-8f7d-d7c5a2d97036 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:21.792942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f919de7-b353-450a-8f7d-d7c5a2d97036 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:21.793216 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f919de7-b353-450a-8f7d-d7c5a2d97036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:21.794877 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-1f919de7-b353-450a-8f7d-d7c5a2d97036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:21.829709 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:21.902902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f919de7-b353-450a-8f7d-d7c5a2d97036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:21.904343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f919de7-b353-450a-8f7d-d7c5a2d97036 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:21.923067 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 681/1340] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:29:26.130094 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06755c5-9d8d-47b1-a990-9b28328ab117 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:26.130599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06755c5-9d8d-47b1-a990-9b28328ab117 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:26.130694 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06755c5-9d8d-47b1-a990-9b28328ab117 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:26.132034 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 660/1341] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:29:26.137486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58942f3c-39cd-4aad-8ba2-9d64a8c29025 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:26.138033 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58942f3c-39cd-4aad-8ba2-9d64a8c29025 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:26.138134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58942f3c-39cd-4aad-8ba2-9d64a8c29025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:26.211579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-58942f3c-39cd-4aad-8ba2-9d64a8c29025 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:26.212820 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-58942f3c-39cd-4aad-8ba2-9d64a8c29025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:26.299110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:26.310761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 682/1342] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:26.349220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06755c5-9d8d-47b1-a990-9b28328ab117 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:26.350790 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c06755c5-9d8d-47b1-a990-9b28328ab117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:26.454892 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06755c5-9d8d-47b1-a990-9b28328ab117 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:26.493584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:26.529169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2545d-d6fd-440b-8d5b-3b5096b6f3d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:26.529851 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2545d-d6fd-440b-8d5b-3b5096b6f3d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:26.530138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2545d-d6fd-440b-8d5b-3b5096b6f3d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:26.530414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2545d-d6fd-440b-8d5b-3b5096b6f3d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:26.533117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-0cb2545d-d6fd-440b-8d5b-3b5096b6f3d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:26.643181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2545d-d6fd-440b-8d5b-3b5096b6f3d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:26.644634 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2545d-d6fd-440b-8d5b-3b5096b6f3d3 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:26.662766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 661/1343] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:29:29.590402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9b8fc-873e-46e2-bff3-3ca90322990a None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:29.590934 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9b8fc-873e-46e2-bff3-3ca90322990a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:29.591061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9b8fc-873e-46e2-bff3-3ca90322990a None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:29.592343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 683/1344] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:29:29.597504 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0dd46-1c99-4195-a465-f09bfac93a49 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:29.597947 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0dd46-1c99-4195-a465-f09bfac93a49 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:29.598097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0dd46-1c99-4195-a465-f09bfac93a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:29.662068 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-7af0dd46-1c99-4195-a465-f09bfac93a49 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:29.663277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7af0dd46-1c99-4195-a465-f09bfac93a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:29.681015 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:29.764846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 662/1345] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:29:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:29.802350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9b8fc-873e-46e2-bff3-3ca90322990a None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:29.803871 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-43d9b8fc-873e-46e2-bff3-3ca90322990a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:29.908405 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9b8fc-873e-46e2-bff3-3ca90322990a None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:29.982213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94576981-6549-4192-9d92-14c59c459353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:29.982874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94576981-6549-4192-9d92-14c59c459353 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:29.983159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94576981-6549-4192-9d92-14c59c459353 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:29.983438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94576981-6549-4192-9d92-14c59c459353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:29.985071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-94576981-6549-4192-9d92-14c59c459353 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:30.028068 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:30.096534 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94576981-6549-4192-9d92-14c59c459353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:30.098068 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94576981-6549-4192-9d92-14c59c459353 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:30.118710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 684/1346] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:29:34.715790 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0ac6b-b9bf-4d2e-9937-694bf20fb14c None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:34.716266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0ac6b-b9bf-4d2e-9937-694bf20fb14c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:34.716350 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0ac6b-b9bf-4d2e-9937-694bf20fb14c None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:34.717820 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 663/1347] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:29:34.723363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb46541-6190-4f63-9ceb-98752891e2a0 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:34.723882 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb46541-6190-4f63-9ceb-98752891e2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:34.724060 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb46541-6190-4f63-9ceb-98752891e2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:34.794001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-ceb46541-6190-4f63-9ceb-98752891e2a0 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:34.795392 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ceb46541-6190-4f63-9ceb-98752891e2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:34.892644 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:34.895373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 685/1348] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:34.934761 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0ac6b-b9bf-4d2e-9937-694bf20fb14c None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:34.936297 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-81d0ac6b-b9bf-4d2e-9937-694bf20fb14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:35.041900 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0ac6b-b9bf-4d2e-9937-694bf20fb14c None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:35.088042 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:35.114037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a5cd6-22d4-456d-a806-2e0b161b0dbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:35.114783 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a5cd6-22d4-456d-a806-2e0b161b0dbf service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:35.115059 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a5cd6-22d4-456d-a806-2e0b161b0dbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:35.115330 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a5cd6-22d4-456d-a806-2e0b161b0dbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:35.116979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-701a5cd6-22d4-456d-a806-2e0b161b0dbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:35.222548 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a5cd6-22d4-456d-a806-2e0b161b0dbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:35.223973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a5cd6-22d4-456d-a806-2e0b161b0dbf service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:35.245771 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 664/1349] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:29:40.118403 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3c696-b2d1-47ec-8092-5aad3f554f55 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:40.119359 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3c696-b2d1-47ec-8092-5aad3f554f55 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:40.119861 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3c696-b2d1-47ec-8092-5aad3f554f55 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:40.122768 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 686/1350] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 08:29:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:29:40.128481 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93ee8b-a3b6-481a-b750-eaa73c9d3d52 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:40.129321 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93ee8b-a3b6-481a-b750-eaa73c9d3d52 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:40.129853 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93ee8b-a3b6-481a-b750-eaa73c9d3d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:40.247726 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-7c93ee8b-a3b6-481a-b750-eaa73c9d3d52 None None] MFA Rules not processed for user `4e38b7e84d6a43efbb4c1a52e2b3e681`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:40.248867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7c93ee8b-a3b6-481a-b750-eaa73c9d3d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:40.277918 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:40.391266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 665/1351] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 08:29:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:44.569807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20c37d-c257-4e18-8814-7fcc5ed25e21 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:44.570370 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20c37d-c257-4e18-8814-7fcc5ed25e21 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:44.570370 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20c37d-c257-4e18-8814-7fcc5ed25e21 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:44.571901 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 687/1352] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 08:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:29:44.577445 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efb9bd-57d3-4f49-9531-c5798c8deeae None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:44.577916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efb9bd-57d3-4f49-9531-c5798c8deeae None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:44.578215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efb9bd-57d3-4f49-9531-c5798c8deeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:44.656055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-b0efb9bd-57d3-4f49-9531-c5798c8deeae None None] MFA Rules not processed for user `4e38b7e84d6a43efbb4c1a52e2b3e681`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:44.657447 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b0efb9bd-57d3-4f49-9531-c5798c8deeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:44.734817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:44.779297 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 666/1353] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 08:29:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:46.219355 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b7295-3623-44da-bba5-0a3e90e417aa None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:46.219894 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b7295-3623-44da-bba5-0a3e90e417aa None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:46.220114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b7295-3623-44da-bba5-0a3e90e417aa None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:46.221599 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 688/1354] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 08:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:29:46.226639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae2ce8-77b1-4f31-9ad0-395f0bb250f6 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:46.227104 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae2ce8-77b1-4f31-9ad0-395f0bb250f6 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:46.227210 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae2ce8-77b1-4f31-9ad0-395f0bb250f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:46.303274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-57ae2ce8-77b1-4f31-9ad0-395f0bb250f6 None None] MFA Rules not processed for user `4e38b7e84d6a43efbb4c1a52e2b3e681`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:46.304470 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-57ae2ce8-77b1-4f31-9ad0-395f0bb250f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:46.413604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 667/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 08:29:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:29:49.760194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92ed93-cada-4826-8731-6178e5b659cd None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:49.760652 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92ed93-cada-4826-8731-6178e5b659cd None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:49.760652 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92ed93-cada-4826-8731-6178e5b659cd None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:49.763208 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 689/1356] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:29:49.769068 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514b7dc-ee41-483d-a13f-792cf447dfe5 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:49.769517 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514b7dc-ee41-483d-a13f-792cf447dfe5 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:49.769659 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514b7dc-ee41-483d-a13f-792cf447dfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:49.815169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:49.856373 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-0514b7dc-ee41-483d-a13f-792cf447dfe5 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:49.857965 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-0514b7dc-ee41-483d-a13f-792cf447dfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:49.955691 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 668/1357] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:50.010606 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc55e69-be6e-46f8-bf61-87a339fe82d8 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:50.010985 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc55e69-be6e-46f8-bf61-87a339fe82d8 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:50.011357 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc55e69-be6e-46f8-bf61-87a339fe82d8 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:50.012812 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 690/1358] 10.222.0.57 () {54 vars in 962 bytes} [Thu Jul 21 08:29:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:29:50.021187 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f15a1-7d50-4651-b096-79fdb6d1f362 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:50.021477 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f15a1-7d50-4651-b096-79fdb6d1f362 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:50.021780 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f15a1-7d50-4651-b096-79fdb6d1f362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:50.110006 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-c66f15a1-7d50-4651-b096-79fdb6d1f362 None None] MFA Rules not processed for user `b6670a010c034f7999c9445452c02473`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:50.111208 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c66f15a1-7d50-4651-b096-79fdb6d1f362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:50.162152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:50.232851 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 669/1359] 10.222.0.57 () {58 vars in 1059 bytes} [Thu Jul 21 08:29:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:50.240344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc55e69-be6e-46f8-bf61-87a339fe82d8 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:50.241872 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ecc55e69-be6e-46f8-bf61-87a339fe82d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:50.396720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc55e69-be6e-46f8-bf61-87a339fe82d8 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:50.472832 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:50.521654 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc6b6e-ad3c-4b4d-aa10-9804d15fb18f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:50.522270 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc6b6e-ad3c-4b4d-aa10-9804d15fb18f service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:50.522552 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc6b6e-ad3c-4b4d-aa10-9804d15fb18f service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:50.522831 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc6b6e-ad3c-4b4d-aa10-9804d15fb18f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:50.524572 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5bbc6b6e-ad3c-4b4d-aa10-9804d15fb18f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:50.620357 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc6b6e-ad3c-4b4d-aa10-9804d15fb18f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:50.622036 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc6b6e-ad3c-4b4d-aa10-9804d15fb18f service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:50.641597 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 691/1360] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:29:52.895622 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7741d-b669-4c91-8e76-c465d820e7d2 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:52.896150 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7741d-b669-4c91-8e76-c465d820e7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:52.896260 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7741d-b669-4c91-8e76-c465d820e7d2 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:52.897591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 670/1361] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:29:52.903248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0df3ab-0a13-430d-ba4f-5b34a72871a6 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:52.903740 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0df3ab-0a13-430d-ba4f-5b34a72871a6 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:52.903840 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0df3ab-0a13-430d-ba4f-5b34a72871a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:52.972384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-9a0df3ab-0a13-430d-ba4f-5b34a72871a6 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:52.973484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-9a0df3ab-0a13-430d-ba4f-5b34a72871a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:53.013312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:53.077883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 692/1362] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:53.124300 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7741d-b669-4c91-8e76-c465d820e7d2 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:53.125844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b8a7741d-b669-4c91-8e76-c465d820e7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:53.294825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7741d-b669-4c91-8e76-c465d820e7d2 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:53.304711 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:53.419994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e2761-efea-43d9-b789-92f61904eb88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:53.420661 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e2761-efea-43d9-b789-92f61904eb88 service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:53.420661 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e2761-efea-43d9-b789-92f61904eb88 service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:53.421370 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e2761-efea-43d9-b789-92f61904eb88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:53.422853 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-375e2761-efea-43d9-b789-92f61904eb88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:53.520909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e2761-efea-43d9-b789-92f61904eb88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:53.522572 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e2761-efea-43d9-b789-92f61904eb88 service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:53.542207 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 671/1363] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:29:56.027511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0fe94-4537-49a4-a5be-8b5e3d0895da None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:56.028173 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0fe94-4537-49a4-a5be-8b5e3d0895da None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:56.028173 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0fe94-4537-49a4-a5be-8b5e3d0895da None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:56.029782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 693/1364] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:29:56.035006 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d9c03-fbb4-433f-9bbf-717c88a513f7 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:56.035459 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d9c03-fbb4-433f-9bbf-717c88a513f7 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:56.035561 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d9c03-fbb4-433f-9bbf-717c88a513f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:56.057415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:56.116385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-a18d9c03-fbb4-433f-9bbf-717c88a513f7 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:56.117669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a18d9c03-fbb4-433f-9bbf-717c88a513f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:56.221091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 672/1365] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:56.272041 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82e18d-d938-4182-9f83-bef41698a6a4 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:56.272542 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82e18d-d938-4182-9f83-bef41698a6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:56.272980 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82e18d-d938-4182-9f83-bef41698a6a4 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:56.274816 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 694/1366] 10.222.0.57 () {54 vars in 962 bytes} [Thu Jul 21 08:29:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:29:56.279987 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d01482-fe6c-4b66-b70b-e29867772140 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:56.280224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d01482-fe6c-4b66-b70b-e29867772140 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:56.280504 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d01482-fe6c-4b66-b70b-e29867772140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:56.362726 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-06d01482-fe6c-4b66-b70b-e29867772140 None None] MFA Rules not processed for user `b6670a010c034f7999c9445452c02473`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:56.365034 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-06d01482-fe6c-4b66-b70b-e29867772140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:56.401268 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:56.485792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 673/1367] 10.222.0.57 () {58 vars in 1059 bytes} [Thu Jul 21 08:29:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:56.493709 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82e18d-d938-4182-9f83-bef41698a6a4 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:56.495254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2a82e18d-d938-4182-9f83-bef41698a6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:56.655105 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82e18d-d938-4182-9f83-bef41698a6a4 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:56.678461 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:56.786841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976a225-7a82-4d10-91f3-6b3ab4ade5c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:56.787494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976a225-7a82-4d10-91f3-6b3ab4ade5c1 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:56.787777 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976a225-7a82-4d10-91f3-6b3ab4ade5c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:56.788053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976a225-7a82-4d10-91f3-6b3ab4ade5c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:56.789731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-9976a225-7a82-4d10-91f3-6b3ab4ade5c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:56.882597 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976a225-7a82-4d10-91f3-6b3ab4ade5c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:56.884777 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976a225-7a82-4d10-91f3-6b3ab4ade5c1 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:56.904053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 695/1368] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:29:57.956232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5361208-852d-4be6-a1b2-4a6a85226955 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:57.956757 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5361208-852d-4be6-a1b2-4a6a85226955 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:57.956839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5361208-852d-4be6-a1b2-4a6a85226955 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:57.958182 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 674/1369] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:29:57.964098 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb1bf0-82ab-466b-8463-d1f8c8489974 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:57.964534 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb1bf0-82ab-466b-8463-d1f8c8489974 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:57.964716 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb1bf0-82ab-466b-8463-d1f8c8489974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:57.996260 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:58.030927 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-2efb1bf0-82ab-466b-8463-d1f8c8489974 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:58.032041 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2efb1bf0-82ab-466b-8463-d1f8c8489974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:58.134851 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 696/1370] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:58.480611 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90fdb5-74e0-47b6-9afc-6b83f640f47b None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:58.480611 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90fdb5-74e0-47b6-9afc-6b83f640f47b None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:58.480611 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90fdb5-74e0-47b6-9afc-6b83f640f47b None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:58.483189 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 675/1371] 10.222.0.57 () {54 vars in 964 bytes} [Thu Jul 21 08:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:29:58.486639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46245cab-5370-4ebb-a64f-599431adcf2c None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:58.486930 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46245cab-5370-4ebb-a64f-599431adcf2c None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:58.487208 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46245cab-5370-4ebb-a64f-599431adcf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:58.566432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-46245cab-5370-4ebb-a64f-599431adcf2c None None] MFA Rules not processed for user `aebefbc2dc0244d8a5ae7d88be6b63ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:58.567815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-46245cab-5370-4ebb-a64f-599431adcf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:58.616924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:58.649490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 697/1372] 10.222.0.57 () {58 vars in 1061 bytes} [Thu Jul 21 08:29:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:29:58.657720 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90fdb5-74e0-47b6-9afc-6b83f640f47b None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:58.659346 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ff90fdb5-74e0-47b6-9afc-6b83f640f47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:58.781261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90fdb5-74e0-47b6-9afc-6b83f640f47b None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:58.823279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:58.858784 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d6ea0-102c-49e2-9cb7-d481be4ca023 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:58.859430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6ea0-102c-49e2-9cb7-d481be4ca023 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:58.859730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6ea0-102c-49e2-9cb7-d481be4ca023 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:58.860010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d6ea0-102c-49e2-9cb7-d481be4ca023 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:58.861702 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-250d6ea0-102c-49e2-9cb7-d481be4ca023 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:58.977836 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d6ea0-102c-49e2-9cb7-d481be4ca023 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:58.980029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d6ea0-102c-49e2-9cb7-d481be4ca023 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:58.999506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 676/1373] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:29:59.128600 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c243545-a0d1-4270-9eb6-721af1fac33a None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:59.129056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c243545-a0d1-4270-9eb6-721af1fac33a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:59.129726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c243545-a0d1-4270-9eb6-721af1fac33a None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:59.131801 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 698/1374] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:29:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:29:59.137043 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106aad5-6a42-4e6d-8d35-432f565827aa None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:59.137248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106aad5-6a42-4e6d-8d35-432f565827aa None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:59.137584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106aad5-6a42-4e6d-8d35-432f565827aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:59.212100 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-8106aad5-6a42-4e6d-8d35-432f565827aa None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:29:59.213658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-8106aad5-6a42-4e6d-8d35-432f565827aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:59.239277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:59.319393 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 677/1375] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:29:59.365364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c243545-a0d1-4270-9eb6-721af1fac33a None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:29:59.367560 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-8c243545-a0d1-4270-9eb6-721af1fac33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:59.531124 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c243545-a0d1-4270-9eb6-721af1fac33a None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:29:59.582423 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:29:59.644162 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18108d44-333d-42f0-a528-b92d0d3979d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:29:59.644813 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18108d44-333d-42f0-a528-b92d0d3979d9 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:29:59.645099 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18108d44-333d-42f0-a528-b92d0d3979d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:29:59.645378 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18108d44-333d-42f0-a528-b92d0d3979d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:29:59.647060 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-18108d44-333d-42f0-a528-b92d0d3979d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:29:59.737648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18108d44-333d-42f0-a528-b92d0d3979d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:29:59.739381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18108d44-333d-42f0-a528-b92d0d3979d9 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:29:59.758027 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 699/1376] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:01.887296 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4934ecc-cd45-4531-9e36-baec4ccc355e None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:01.887817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4934ecc-cd45-4531-9e36-baec4ccc355e None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:01.887913 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4934ecc-cd45-4531-9e36-baec4ccc355e None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:01.889216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 678/1377] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:01.894413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e6a4c-9f0a-406f-afa6-daa714e1421e None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:01.894848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e6a4c-9f0a-406f-afa6-daa714e1421e None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:01.894973 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e6a4c-9f0a-406f-afa6-daa714e1421e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:01.959348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-ca9e6a4c-9f0a-406f-afa6-daa714e1421e None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:01.960546 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ca9e6a4c-9f0a-406f-afa6-daa714e1421e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:01.967814 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:02.088267 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 700/1378] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:02.133021 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4934ecc-cd45-4531-9e36-baec4ccc355e None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:02.135427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f4934ecc-cd45-4531-9e36-baec4ccc355e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:02.308846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4934ecc-cd45-4531-9e36-baec4ccc355e None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:02.313474 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:02.428962 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827e4f9-2062-4665-9ec0-625d8c666129 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:02.429638 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827e4f9-2062-4665-9ec0-625d8c666129 service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:02.429921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827e4f9-2062-4665-9ec0-625d8c666129 service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:02.430200 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827e4f9-2062-4665-9ec0-625d8c666129 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:02.432344 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-3827e4f9-2062-4665-9ec0-625d8c666129 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:02.547662 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827e4f9-2062-4665-9ec0-625d8c666129 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:02.549284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827e4f9-2062-4665-9ec0-625d8c666129 service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:02.573366 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 679/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:04.815640 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1709b-e353-45d8-91e5-64d5f0a7b129 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:04.816205 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1709b-e353-45d8-91e5-64d5f0a7b129 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:04.816205 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1709b-e353-45d8-91e5-64d5f0a7b129 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:04.818655 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 701/1380] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:30:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:04.823054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed3334-2720-4927-a178-17cf0dacb8af None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:04.823512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed3334-2720-4927-a178-17cf0dacb8af None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:04.823593 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed3334-2720-4927-a178-17cf0dacb8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:04.834285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:04.892405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-e6ed3334-2720-4927-a178-17cf0dacb8af None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:04.893615 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e6ed3334-2720-4927-a178-17cf0dacb8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:04.996644 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 680/1381] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:05.042284 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1709b-e353-45d8-91e5-64d5f0a7b129 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:05.043880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f1a1709b-e353-45d8-91e5-64d5f0a7b129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:05.191838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:05.204573 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1709b-e353-45d8-91e5-64d5f0a7b129 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:05.393229 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecec1980-7776-410a-9b04-81260afab510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:05.393229 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec1980-7776-410a-9b04-81260afab510 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:05.393229 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec1980-7776-410a-9b04-81260afab510 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:05.393229 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec1980-7776-410a-9b04-81260afab510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:05.393755 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ecec1980-7776-410a-9b04-81260afab510 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:05.440478 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec1980-7776-410a-9b04-81260afab510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:05.443104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecec1980-7776-410a-9b04-81260afab510 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:05.456609 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:05.465828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 702/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:07.703241 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e64e0-5ac1-4e62-8fd4-a882dc8b4529 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:07.704432 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e64e0-5ac1-4e62-8fd4-a882dc8b4529 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:07.704795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e64e0-5ac1-4e62-8fd4-a882dc8b4529 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:07.706668 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 681/1383] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:30:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:07.712591 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf274e9-7e1a-4a5c-8ebd-7fa98067957f None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:07.713035 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf274e9-7e1a-4a5c-8ebd-7fa98067957f None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:07.713216 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf274e9-7e1a-4a5c-8ebd-7fa98067957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:07.778534 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-4bf274e9-7e1a-4a5c-8ebd-7fa98067957f None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:07.779709 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4bf274e9-7e1a-4a5c-8ebd-7fa98067957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:07.881209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 703/1384] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:07.923888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e64e0-5ac1-4e62-8fd4-a882dc8b4529 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:07.925478 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-549e64e0-5ac1-4e62-8fd4-a882dc8b4529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:08.025137 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:08.098457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e64e0-5ac1-4e62-8fd4-a882dc8b4529 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:08.219823 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff66e79-6b6a-4293-b76a-ff197a275de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:08.220473 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff66e79-6b6a-4293-b76a-ff197a275de4 service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:08.220755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff66e79-6b6a-4293-b76a-ff197a275de4 service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:08.221031 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff66e79-6b6a-4293-b76a-ff197a275de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:08.222742 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-0ff66e79-6b6a-4293-b76a-ff197a275de4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:08.272814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:08.317517 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff66e79-6b6a-4293-b76a-ff197a275de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:08.319606 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff66e79-6b6a-4293-b76a-ff197a275de4 service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:08.341917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 682/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:10.505269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfcb17-db6e-4a89-affc-79e0503c333b None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:10.506022 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfcb17-db6e-4a89-affc-79e0503c333b None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:10.506022 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dfcb17-db6e-4a89-affc-79e0503c333b None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:10.507295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 704/1386] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:10.513260 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a69a0f-341e-479f-922b-b8dac3215845 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:10.513765 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a69a0f-341e-479f-922b-b8dac3215845 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:10.513864 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a69a0f-341e-479f-922b-b8dac3215845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:10.581234 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-b8a69a0f-341e-479f-922b-b8dac3215845 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:10.582577 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b8a69a0f-341e-479f-922b-b8dac3215845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:10.695264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 683/1387] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:10.750671 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfcb17-db6e-4a89-affc-79e0503c333b None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:10.752332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f1dfcb17-db6e-4a89-affc-79e0503c333b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:10.832932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:10.908841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dfcb17-db6e-4a89-affc-79e0503c333b None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:11.027653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59749d3e-bc03-40da-96d0-55c5cb7246d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:11.028287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59749d3e-bc03-40da-96d0-55c5cb7246d1 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:11.028582 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59749d3e-bc03-40da-96d0-55c5cb7246d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:11.028875 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59749d3e-bc03-40da-96d0-55c5cb7246d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:11.030924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-59749d3e-bc03-40da-96d0-55c5cb7246d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:11.074345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:11.128572 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59749d3e-bc03-40da-96d0-55c5cb7246d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:11.130247 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59749d3e-bc03-40da-96d0-55c5cb7246d1 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:11.148705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 705/1388] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:13.413979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8c60e-a2f5-4c36-a621-b051c019c93c None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:13.414496 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8c60e-a2f5-4c36-a621-b051c019c93c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:13.414496 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8c60e-a2f5-4c36-a621-b051c019c93c None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:13.416067 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 684/1389] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:13.421439 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ddb3c-218a-4852-ae34-094dd8fa9939 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:13.421900 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ddb3c-218a-4852-ae34-094dd8fa9939 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:13.422071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ddb3c-218a-4852-ae34-094dd8fa9939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:13.492956 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-b32ddb3c-218a-4852-ae34-094dd8fa9939 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:13.494312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b32ddb3c-218a-4852-ae34-094dd8fa9939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:13.593864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 706/1390] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:13.637735 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8c60e-a2f5-4c36-a621-b051c019c93c None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:13.639252 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c4f8c60e-a2f5-4c36-a621-b051c019c93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:13.676842 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:13.806656 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8c60e-a2f5-4c36-a621-b051c019c93c None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:13.923580 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:13.935911 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117b506-9e86-43b2-a5da-a4725d3088c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:13.936562 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117b506-9e86-43b2-a5da-a4725d3088c2 service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:13.936846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117b506-9e86-43b2-a5da-a4725d3088c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:13.937120 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117b506-9e86-43b2-a5da-a4725d3088c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:13.938808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f117b506-9e86-43b2-a5da-a4725d3088c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:14.044301 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117b506-9e86-43b2-a5da-a4725d3088c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:14.045997 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117b506-9e86-43b2-a5da-a4725d3088c2 service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:14.065289 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 685/1391] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:14.744138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130175d6-e09e-450a-9312-936b4b254b23 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:14.744693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130175d6-e09e-450a-9312-936b4b254b23 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:14.744693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130175d6-e09e-450a-9312-936b4b254b23 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:14.746172 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 707/1392] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:14.751520 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81dc91-fd37-4168-a198-bf3b48a3c7c0 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:14.751925 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81dc91-fd37-4168-a198-bf3b48a3c7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:14.752142 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81dc91-fd37-4168-a198-bf3b48a3c7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:14.816761 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-5c81dc91-fd37-4168-a198-bf3b48a3c7c0 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:14.817972 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-5c81dc91-fd37-4168-a198-bf3b48a3c7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:14.876374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:14.918384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 686/1393] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:14.975098 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875fd2d-c305-42c4-b705-af8ddc602c95 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:14.975389 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875fd2d-c305-42c4-b705-af8ddc602c95 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:14.975669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875fd2d-c305-42c4-b705-af8ddc602c95 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:14.977065 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 708/1394] 10.222.0.57 () {54 vars in 966 bytes} [Thu Jul 21 08:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:14.982543 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d57e09-11ba-41f3-b72b-4f3681ff8df6 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:14.982927 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d57e09-11ba-41f3-b72b-4f3681ff8df6 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:14.983212 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d57e09-11ba-41f3-b72b-4f3681ff8df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:15.057417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-04d57e09-11ba-41f3-b72b-4f3681ff8df6 None None] MFA Rules not processed for user `2b27a4861d6b4ddfaca1a97efdaf008d`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:15.058370 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-04d57e09-11ba-41f3-b72b-4f3681ff8df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:15.134649 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 687/1395] 10.222.0.57 () {58 vars in 1063 bytes} [Thu Jul 21 08:30:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:30:15.142110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875fd2d-c305-42c4-b705-af8ddc602c95 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:15.143637 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-d875fd2d-c305-42c4-b705-af8ddc602c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:15.157781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:15.249645 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875fd2d-c305-42c4-b705-af8ddc602c95 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:15.330162 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c6aad7-91b9-4a48-b5b1-ad741f827528 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b27a4861d6b4ddfaca1a97efdaf008d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:15.330746 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6aad7-91b9-4a48-b5b1-ad741f827528 service glance] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:15.331025 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6aad7-91b9-4a48-b5b1-ad741f827528 service glance] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:15.331295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c6aad7-91b9-4a48-b5b1-ad741f827528 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:15.332918 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-14c6aad7-91b9-4a48-b5b1-ad741f827528 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:15.400383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:15.442285 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6aad7-91b9-4a48-b5b1-ad741f827528 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:15.443734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c6aad7-91b9-4a48-b5b1-ad741f827528 service glance] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:15.462458 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 709/1396] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:16.256143 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ceccb-9f6b-4a82-b1da-677249669f37 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:16.256729 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ceccb-9f6b-4a82-b1da-677249669f37 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:16.256729 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ceccb-9f6b-4a82-b1da-677249669f37 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:16.258187 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 688/1397] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:16.264151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5c091-5a10-4a1f-be5a-0ef6fa73a851 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:16.264603 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5c091-5a10-4a1f-be5a-0ef6fa73a851 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:16.264718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5c091-5a10-4a1f-be5a-0ef6fa73a851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:16.329850 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-6ca5c091-5a10-4a1f-be5a-0ef6fa73a851 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:16.331052 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-6ca5c091-5a10-4a1f-be5a-0ef6fa73a851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:16.437366 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 710/1398] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:30:16.484583 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ceccb-9f6b-4a82-b1da-677249669f37 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:16.486879 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-172ceccb-9f6b-4a82-b1da-677249669f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:16.556211 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:16.631638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ae3b2-ee10-4d9f-92be-10871a05bd45 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:16.631926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ae3b2-ee10-4d9f-92be-10871a05bd45 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:16.632209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ae3b2-ee10-4d9f-92be-10871a05bd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:16.647966 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ceccb-9f6b-4a82-b1da-677249669f37 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:16.660487 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:16.709497 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-0c5ae3b2-ee10-4d9f-92be-10871a05bd45 None None] MFA Rules not processed for user `22750d44d710439da1d18a78419b1adf`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:16.710881 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-0c5ae3b2-ee10-4d9f-92be-10871a05bd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:16.789462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26e571-5185-434d-a658-0b7dea71c772 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:16.790749 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26e571-5185-434d-a658-0b7dea71c772 service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:16.791033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26e571-5185-434d-a658-0b7dea71c772 service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:16.791307 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce26e571-5185-434d-a658-0b7dea71c772 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:16.793015 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ce26e571-5185-434d-a658-0b7dea71c772 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:16.816312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 711/1399] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 08:30:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:30:16.818617 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:16.865050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab714bf-e048-41c0-a869-1bb348a25ba9 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:16.865727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab714bf-e048-41c0-a869-1bb348a25ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:16.866403 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab714bf-e048-41c0-a869-1bb348a25ba9 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:16.868212 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 712/1400] 10.222.0.57 () {54 vars in 943 bytes} [Thu Jul 21 08:30:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:30:16.875474 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece06333-8c13-4c91-ad65-a3736b16b37e None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:16.875838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece06333-8c13-4c91-ad65-a3736b16b37e None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:16.876299 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece06333-8c13-4c91-ad65-a3736b16b37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:16.897757 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26e571-5185-434d-a658-0b7dea71c772 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:16.899921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce26e571-5185-434d-a658-0b7dea71c772 service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:16.923203 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 689/1401] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:16.961443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-ece06333-8c13-4c91-ad65-a3736b16b37e None None] MFA Rules not processed for user `e349e5dfcd74406b922d3d1ce0fa5ef4`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:16.963248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ece06333-8c13-4c91-ad65-a3736b16b37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:17.016549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:17.072725 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 713/1402] 10.222.0.57 () {58 vars in 1040 bytes} [Thu Jul 21 08:30:16 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:30:17.082303 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26e571-5185-434d-a658-0b7dea71c772 service nova] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:17.083514 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ce26e571-5185-434d-a658-0b7dea71c772 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:17.181211 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce26e571-5185-434d-a658-0b7dea71c772 service nova] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:17.247580 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:17.297437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd871fb-a854-490c-a9aa-0aa225529e2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e349e5dfcd74406b922d3d1ce0fa5ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:17.298160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd871fb-a854-490c-a9aa-0aa225529e2c service swift] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:17.298393 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd871fb-a854-490c-a9aa-0aa225529e2c service swift] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:17.298665 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd871fb-a854-490c-a9aa-0aa225529e2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:17.300349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-fcd871fb-a854-490c-a9aa-0aa225529e2c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:17.384243 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd871fb-a854-490c-a9aa-0aa225529e2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:17.385924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd871fb-a854-490c-a9aa-0aa225529e2c service swift] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:17.394196 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 690/1403] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 08:30:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:30:19.166011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1b04c-b629-4de5-90b5-16266d88df4b None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.166568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1b04c-b629-4de5-90b5-16266d88df4b None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.166783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1b04c-b629-4de5-90b5-16266d88df4b None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.168197 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 714/1404] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:30:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:19.173514 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1663597-9e04-4ce8-ac82-2a9abc9c210b None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.174425 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1663597-9e04-4ce8-ac82-2a9abc9c210b None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.174796 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1663597-9e04-4ce8-ac82-2a9abc9c210b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.245615 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-d1663597-9e04-4ce8-ac82-2a9abc9c210b None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:19.247697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-d1663597-9e04-4ce8-ac82-2a9abc9c210b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:19.299702 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:19.374645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 691/1405] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:19.421099 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1b04c-b629-4de5-90b5-16266d88df4b None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:19.422597 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-72b1b04c-b629-4de5-90b5-16266d88df4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:19.581892 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1b04c-b629-4de5-90b5-16266d88df4b None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:19.615244 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:19.717904 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae754035-d6cc-45af-9d99-bc32bc865193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:19.718472 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae754035-d6cc-45af-9d99-bc32bc865193 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:19.718757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae754035-d6cc-45af-9d99-bc32bc865193 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:19.719033 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae754035-d6cc-45af-9d99-bc32bc865193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:19.720838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ae754035-d6cc-45af-9d99-bc32bc865193 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:19.820179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae754035-d6cc-45af-9d99-bc32bc865193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:19.822148 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae754035-d6cc-45af-9d99-bc32bc865193 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:19.842148 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 715/1406] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:22.106570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc212830-f887-4942-a3b8-3d58984d0a93 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:22.106570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc212830-f887-4942-a3b8-3d58984d0a93 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:22.106570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc212830-f887-4942-a3b8-3d58984d0a93 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:22.107748 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 692/1407] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:22.113993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1199b89-e282-4518-9d53-368c4d9e7354 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:22.114515 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1199b89-e282-4518-9d53-368c4d9e7354 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:22.114610 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1199b89-e282-4518-9d53-368c4d9e7354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:22.158869 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:22.185452 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-c1199b89-e282-4518-9d53-368c4d9e7354 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:22.186715 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-c1199b89-e282-4518-9d53-368c4d9e7354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:22.296471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 716/1408] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:22.346323 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc212830-f887-4942-a3b8-3d58984d0a93 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:22.347978 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-fc212830-f887-4942-a3b8-3d58984d0a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:22.516811 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc212830-f887-4942-a3b8-3d58984d0a93 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:22.551077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:22.649930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe4464-5ecb-48c8-9946-8863bc944744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:22.650576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe4464-5ecb-48c8-9946-8863bc944744 service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:22.650850 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe4464-5ecb-48c8-9946-8863bc944744 service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:22.651117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe4464-5ecb-48c8-9946-8863bc944744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:22.652793 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-99fe4464-5ecb-48c8-9946-8863bc944744 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:22.757383 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe4464-5ecb-48c8-9946-8863bc944744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:22.759373 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe4464-5ecb-48c8-9946-8863bc944744 service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:22.779301 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 693/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:30:32.294271 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=51 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:32.776723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=86 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:41.428347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414744d-5c2e-49a0-bc54-a65c10b54e54 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:41.428908 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414744d-5c2e-49a0-bc54-a65c10b54e54 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:41.428908 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414744d-5c2e-49a0-bc54-a65c10b54e54 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:41.430386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 717/1410] 10.222.0.57 () {54 vars in 918 bytes} [Thu Jul 21 08:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:41.435728 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f805dd-28e2-4d08-9102-55aa7ba7ed30 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:41.436128 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f805dd-28e2-4d08-9102-55aa7ba7ed30 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:41.436285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f805dd-28e2-4d08-9102-55aa7ba7ed30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:41.510704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-40f805dd-28e2-4d08-9102-55aa7ba7ed30 None None] MFA Rules not processed for user `4e38b7e84d6a43efbb4c1a52e2b3e681`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:41.511904 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-40f805dd-28e2-4d08-9102-55aa7ba7ed30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:41.615708 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 694/1411] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Jul 21 08:30:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:30:41.629841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2bb2d-8847-455c-baa3-03f4181a5f1e None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:41.630132 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2bb2d-8847-455c-baa3-03f4181a5f1e None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:41.630409 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2bb2d-8847-455c-baa3-03f4181a5f1e None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:41.631765 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 718/1412] 10.222.0.57 () {54 vars in 918 bytes} [Thu Jul 21 08:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:41.636690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359f4c1-c311-4451-af6e-ae2650c346f9 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:41.636979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359f4c1-c311-4451-af6e-ae2650c346f9 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:41.637258 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359f4c1-c311-4451-af6e-ae2650c346f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:41.706347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:41.709389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-c359f4c1-c311-4451-af6e-ae2650c346f9 None None] MFA Rules not processed for user `b6670a010c034f7999c9445452c02473`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:41.710627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c359f4c1-c311-4451-af6e-ae2650c346f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:41.827791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 695/1413] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Jul 21 08:30:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:44.316111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872210d8-7ecb-4dd2-a20f-c85641fb884a None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:44.316673 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872210d8-7ecb-4dd2-a20f-c85641fb884a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:44.316771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872210d8-7ecb-4dd2-a20f-c85641fb884a None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:44.318122 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 719/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:44.323448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f1280-4b86-451d-a31a-79b89be884b0 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:44.323857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f1280-4b86-451d-a31a-79b89be884b0 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:44.324001 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f1280-4b86-451d-a31a-79b89be884b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:44.387028 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-258f1280-4b86-451d-a31a-79b89be884b0 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:44.388217 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-258f1280-4b86-451d-a31a-79b89be884b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:44.441068 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:44.482998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 696/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:44.525988 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872210d8-7ecb-4dd2-a20f-c85641fb884a None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:44.527501 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-872210d8-7ecb-4dd2-a20f-c85641fb884a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:44.670552 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872210d8-7ecb-4dd2-a20f-c85641fb884a None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:44.740849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:44.780847 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6a21d-a74e-4b74-aeb1-f58f6b47919f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:44.781482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6a21d-a74e-4b74-aeb1-f58f6b47919f service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:44.781786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6a21d-a74e-4b74-aeb1-f58f6b47919f service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:44.782057 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6a21d-a74e-4b74-aeb1-f58f6b47919f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:44.783675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-a2a6a21d-a74e-4b74-aeb1-f58f6b47919f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:44.870679 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6a21d-a74e-4b74-aeb1-f58f6b47919f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:44.872266 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6a21d-a74e-4b74-aeb1-f58f6b47919f service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:44.889770 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 720/1416] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:45.788483 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114833f9-a40a-48d9-b62e-7ab050a1c1ca None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:45.788984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114833f9-a40a-48d9-b62e-7ab050a1c1ca None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:45.789094 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114833f9-a40a-48d9-b62e-7ab050a1c1ca None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:45.790450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 697/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:45.795455 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1131cc3-725f-428e-a69a-4993a4507307 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:45.795890 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1131cc3-725f-428e-a69a-4993a4507307 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:45.795997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1131cc3-725f-428e-a69a-4993a4507307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:45.874586 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-a1131cc3-725f-428e-a69a-4993a4507307 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:45.875790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-a1131cc3-725f-428e-a69a-4993a4507307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:45.902750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:45.971381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 721/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:46.122997 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114833f9-a40a-48d9-b62e-7ab050a1c1ca None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:46.124502 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-114833f9-a40a-48d9-b62e-7ab050a1c1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:46.269571 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114833f9-a40a-48d9-b62e-7ab050a1c1ca None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:46.308561 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:46.379387 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795db973-d481-4e6b-9053-0a78f53df592 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:46.380028 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795db973-d481-4e6b-9053-0a78f53df592 service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:46.380308 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795db973-d481-4e6b-9053-0a78f53df592 service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:46.380600 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795db973-d481-4e6b-9053-0a78f53df592 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:46.382245 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-795db973-d481-4e6b-9053-0a78f53df592 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:46.468784 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795db973-d481-4e6b-9053-0a78f53df592 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:46.470406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795db973-d481-4e6b-9053-0a78f53df592 service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:46.488672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 698/1419] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:47.367453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aaf03c-edc0-4607-9018-2179a45048ea None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:47.367993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aaf03c-edc0-4607-9018-2179a45048ea None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:47.368104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aaf03c-edc0-4607-9018-2179a45048ea None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:47.369415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 722/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:47.374646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad092cc-8f5f-4190-80e7-823b41cefd94 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:47.375094 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad092cc-8f5f-4190-80e7-823b41cefd94 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:47.375264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad092cc-8f5f-4190-80e7-823b41cefd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:47.429308 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:47.450446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-dad092cc-8f5f-4190-80e7-823b41cefd94 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:47.451810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-dad092cc-8f5f-4190-80e7-823b41cefd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:47.550773 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 699/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:47.718058 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aaf03c-edc0-4607-9018-2179a45048ea None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:47.719612 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-04aaf03c-edc0-4607-9018-2179a45048ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:47.867695 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aaf03c-edc0-4607-9018-2179a45048ea None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:47.879816 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:47.980761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725a889-2469-47ef-b950-b5780b013761 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:47.981409 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725a889-2469-47ef-b950-b5780b013761 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:47.981722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725a889-2469-47ef-b950-b5780b013761 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:47.982000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725a889-2469-47ef-b950-b5780b013761 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:47.983642 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2725a889-2469-47ef-b950-b5780b013761 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:48.070914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725a889-2469-47ef-b950-b5780b013761 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:48.072604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725a889-2469-47ef-b950-b5780b013761 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:48.091683 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 723/1422] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:48.956701 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabce0d8-684c-4657-a52b-d6079e121e58 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:48.957301 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabce0d8-684c-4657-a52b-d6079e121e58 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:48.957301 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabce0d8-684c-4657-a52b-d6079e121e58 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:48.958744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 700/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:48.964359 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46fd6d-7a5e-4ca0-ae48-30a407fbdfb8 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:48.964761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46fd6d-7a5e-4ca0-ae48-30a407fbdfb8 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:48.964925 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46fd6d-7a5e-4ca0-ae48-30a407fbdfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:48.983271 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:49.040842 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-3b46fd6d-7a5e-4ca0-ae48-30a407fbdfb8 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:49.042018 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-3b46fd6d-7a5e-4ca0-ae48-30a407fbdfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:49.138517 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 724/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:49.292147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabce0d8-684c-4657-a52b-d6079e121e58 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:49.293617 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-aabce0d8-684c-4657-a52b-d6079e121e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:49.400963 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:49.437248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabce0d8-684c-4657-a52b-d6079e121e58 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:49.548230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099933b-e42b-4f08-ab31-5665a0b6d6a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:49.548797 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099933b-e42b-4f08-ab31-5665a0b6d6a1 service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:49.549077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099933b-e42b-4f08-ab31-5665a0b6d6a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:49.549349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099933b-e42b-4f08-ab31-5665a0b6d6a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:49.551027 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f099933b-e42b-4f08-ab31-5665a0b6d6a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:49.625067 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:49.638933 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099933b-e42b-4f08-ab31-5665a0b6d6a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:49.640551 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099933b-e42b-4f08-ab31-5665a0b6d6a1 service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:49.659315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 701/1425] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:50.521403 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a45806-b60a-48e9-bcea-4ef5413da3a8 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:50.522015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a45806-b60a-48e9-bcea-4ef5413da3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:50.522015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a45806-b60a-48e9-bcea-4ef5413da3a8 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:50.523398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 725/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:50.529013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c333c83-c23b-4bdd-bdb1-753eb579fbe3 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:50.532960 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c333c83-c23b-4bdd-bdb1-753eb579fbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:50.532960 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c333c83-c23b-4bdd-bdb1-753eb579fbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:50.603881 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-3c333c83-c23b-4bdd-bdb1-753eb579fbe3 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:50.605356 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-3c333c83-c23b-4bdd-bdb1-753eb579fbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:50.700445 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 702/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:50.852507 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a45806-b60a-48e9-bcea-4ef5413da3a8 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:50.854897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e1a45806-b60a-48e9-bcea-4ef5413da3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:50.936293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:50.997936 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a45806-b60a-48e9-bcea-4ef5413da3a8 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:51.109104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6de9ab-3cea-4e12-861a-0524e2eb3849 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:51.109713 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6de9ab-3cea-4e12-861a-0524e2eb3849 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:51.110001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6de9ab-3cea-4e12-861a-0524e2eb3849 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:51.110282 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6de9ab-3cea-4e12-861a-0524e2eb3849 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:51.111925 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-6d6de9ab-3cea-4e12-861a-0524e2eb3849 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:51.160057 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:51.200519 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6de9ab-3cea-4e12-861a-0524e2eb3849 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:51.202174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6de9ab-3cea-4e12-861a-0524e2eb3849 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:51.220169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 726/1428] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:52.122327 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1a3e2-464b-4f1b-8546-07c86e6fff39 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:52.122841 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1a3e2-464b-4f1b-8546-07c86e6fff39 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:52.122841 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d1a3e2-464b-4f1b-8546-07c86e6fff39 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:52.124218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 703/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:52.129001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb829208-8d32-4a0d-a76e-750695eeef67 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:52.129382 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb829208-8d32-4a0d-a76e-750695eeef67 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:52.129580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb829208-8d32-4a0d-a76e-750695eeef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:52.203498 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-eb829208-8d32-4a0d-a76e-750695eeef67 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:52.204693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-eb829208-8d32-4a0d-a76e-750695eeef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:52.298730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 727/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:52.448102 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1a3e2-464b-4f1b-8546-07c86e6fff39 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:52.449676 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c2d1a3e2-464b-4f1b-8546-07c86e6fff39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:52.499202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:52.595202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d1a3e2-464b-4f1b-8546-07c86e6fff39 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:52.705346 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35472a10-f9c1-43a8-947f-0680b65af2d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:52.705941 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35472a10-f9c1-43a8-947f-0680b65af2d5 service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:52.706222 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35472a10-f9c1-43a8-947f-0680b65af2d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:52.706496 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35472a10-f9c1-43a8-947f-0680b65af2d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:52.708124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-35472a10-f9c1-43a8-947f-0680b65af2d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:52.715459 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:52.805590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35472a10-f9c1-43a8-947f-0680b65af2d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:52.807226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35472a10-f9c1-43a8-947f-0680b65af2d5 service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:52.825483 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 704/1431] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:30:53.675707 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cfd82-cc20-428c-ab2a-a9a956ac8423 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:53.676234 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cfd82-cc20-428c-ab2a-a9a956ac8423 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:53.676359 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cfd82-cc20-428c-ab2a-a9a956ac8423 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:53.677698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 728/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:53.682571 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79a391-9636-40c0-b1ae-abf5135a84f9 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:53.683014 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79a391-9636-40c0-b1ae-abf5135a84f9 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:53.683125 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79a391-9636-40c0-b1ae-abf5135a84f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:53.757827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-ea79a391-9636-40c0-b1ae-abf5135a84f9 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:53.759048 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ea79a391-9636-40c0-b1ae-abf5135a84f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:53.831166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:53.862808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 705/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:54.013913 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cfd82-cc20-428c-ab2a-a9a956ac8423 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:54.015343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-362cfd82-cc20-428c-ab2a-a9a956ac8423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:54.032453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:54.161722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cfd82-cc20-428c-ab2a-a9a956ac8423 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:54.249470 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:54.274547 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab98aa7-556c-4447-a8e1-9858cbb6a9d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:54.275132 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab98aa7-556c-4447-a8e1-9858cbb6a9d5 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:54.275414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab98aa7-556c-4447-a8e1-9858cbb6a9d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:54.275689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab98aa7-556c-4447-a8e1-9858cbb6a9d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:54.277321 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-3ab98aa7-556c-4447-a8e1-9858cbb6a9d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:54.364865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab98aa7-556c-4447-a8e1-9858cbb6a9d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:54.366493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab98aa7-556c-4447-a8e1-9858cbb6a9d5 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:54.384891 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 729/1434] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:55.240313 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1855a-e6a0-4def-b80f-7458e48b4df7 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:55.240909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1855a-e6a0-4def-b80f-7458e48b4df7 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:55.240909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1855a-e6a0-4def-b80f-7458e48b4df7 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:55.242311 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 706/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:55.247815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058144e7-acff-45c2-87fd-a61ab0085622 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:55.248194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058144e7-acff-45c2-87fd-a61ab0085622 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:55.248371 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058144e7-acff-45c2-87fd-a61ab0085622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:55.322456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-058144e7-acff-45c2-87fd-a61ab0085622 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:55.323660 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-058144e7-acff-45c2-87fd-a61ab0085622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:55.364962 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:55.418873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 730/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:55.572818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1855a-e6a0-4def-b80f-7458e48b4df7 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:55.574392 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-bcb1855a-e6a0-4def-b80f-7458e48b4df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:55.723037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1855a-e6a0-4def-b80f-7458e48b4df7 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:55.777413 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:55.834736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f8438-0766-4fd6-80f9-e530ea257531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:55.835305 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f8438-0766-4fd6-80f9-e530ea257531 service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:55.835584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f8438-0766-4fd6-80f9-e530ea257531 service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:55.835851 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f8438-0766-4fd6-80f9-e530ea257531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:55.837554 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-082f8438-0766-4fd6-80f9-e530ea257531 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:55.929968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f8438-0766-4fd6-80f9-e530ea257531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:55.932209 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f8438-0766-4fd6-80f9-e530ea257531 service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:55.949849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 707/1437] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:56.835790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5daae-0b25-40bd-83e2-b90b24d56751 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:56.836275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5daae-0b25-40bd-83e2-b90b24d56751 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:56.836371 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5daae-0b25-40bd-83e2-b90b24d56751 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:56.837774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 731/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:56.842659 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48e33e-1deb-4450-ac5f-94386db6ab9c None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:56.843115 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48e33e-1deb-4450-ac5f-94386db6ab9c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:56.843224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48e33e-1deb-4450-ac5f-94386db6ab9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:56.921203 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-7a48e33e-1deb-4450-ac5f-94386db6ab9c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:56.922679 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7a48e33e-1deb-4450-ac5f-94386db6ab9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:56.925033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:57.029839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 708/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:30:57.178476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5daae-0b25-40bd-83e2-b90b24d56751 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:57.179996 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-05c5daae-0b25-40bd-83e2-b90b24d56751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:57.324541 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5daae-0b25-40bd-83e2-b90b24d56751 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:57.351834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:57.436498 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f20133-aa20-4226-a0ea-ba92c9640ef2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:57.437154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f20133-aa20-4226-a0ea-ba92c9640ef2 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:57.437441 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f20133-aa20-4226-a0ea-ba92c9640ef2 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:57.437745 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f20133-aa20-4226-a0ea-ba92c9640ef2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:57.439392 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-11f20133-aa20-4226-a0ea-ba92c9640ef2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:57.526891 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f20133-aa20-4226-a0ea-ba92c9640ef2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:30:57.528490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f20133-aa20-4226-a0ea-ba92c9640ef2 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:30:57.546062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 732/1440] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:30:59.508355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846860c-62fd-4108-8c6f-41b7cefa5776 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:59.508917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846860c-62fd-4108-8c6f-41b7cefa5776 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:59.508917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6846860c-62fd-4108-8c6f-41b7cefa5776 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:59.510852 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 709/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:30:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:30:59.516005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90feb391-fb5f-4167-999b-8bbcff515ccc None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:59.516414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90feb391-fb5f-4167-999b-8bbcff515ccc None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:59.516568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90feb391-fb5f-4167-999b-8bbcff515ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:59.555715 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:59.581915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-90feb391-fb5f-4167-999b-8bbcff515ccc None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:30:59.583113 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-90feb391-fb5f-4167-999b-8bbcff515ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:59.678927 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 733/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:30:59.718587 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846860c-62fd-4108-8c6f-41b7cefa5776 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:30:59.720133 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-6846860c-62fd-4108-8c6f-41b7cefa5776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:30:59.823684 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6846860c-62fd-4108-8c6f-41b7cefa5776 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:30:59.855245 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:30:59.898702 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d79e09-ea82-4847-9ae2-acaf99bbd6a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:30:59.899343 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d79e09-ea82-4847-9ae2-acaf99bbd6a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:30:59.899627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d79e09-ea82-4847-9ae2-acaf99bbd6a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:30:59.899949 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d79e09-ea82-4847-9ae2-acaf99bbd6a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:30:59.901642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-18d79e09-ea82-4847-9ae2-acaf99bbd6a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:00.008055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d79e09-ea82-4847-9ae2-acaf99bbd6a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:00.010152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d79e09-ea82-4847-9ae2-acaf99bbd6a4 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:00.027757 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 710/1443] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:02.203266 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f7695-50b6-4284-ac13-ea8aa299bdd4 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:02.203826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f7695-50b6-4284-ac13-ea8aa299bdd4 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:02.203826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f7695-50b6-4284-ac13-ea8aa299bdd4 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:02.205236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 734/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:31:02.210448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df2814-0779-489a-9ba4-14f5879ca119 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:02.210847 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df2814-0779-489a-9ba4-14f5879ca119 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:02.211015 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df2814-0779-489a-9ba4-14f5879ca119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:02.274163 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-19df2814-0779-489a-9ba4-14f5879ca119 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:02.275878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-19df2814-0779-489a-9ba4-14f5879ca119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:02.288295 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:02.371928 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 711/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:02.411282 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f7695-50b6-4284-ac13-ea8aa299bdd4 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:02.412803 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2c5f7695-50b6-4284-ac13-ea8aa299bdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:02.514175 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f7695-50b6-4284-ac13-ea8aa299bdd4 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:02.526752 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:02.586391 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a0004-6b59-4cf4-9c2d-cdb166fd3e9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:02.587036 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a0004-6b59-4cf4-9c2d-cdb166fd3e9d service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:02.587898 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a0004-6b59-4cf4-9c2d-cdb166fd3e9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:02.588176 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a0004-6b59-4cf4-9c2d-cdb166fd3e9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:02.589891 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-077a0004-6b59-4cf4-9c2d-cdb166fd3e9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:02.698324 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a0004-6b59-4cf4-9c2d-cdb166fd3e9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:02.699764 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a0004-6b59-4cf4-9c2d-cdb166fd3e9d service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:02.717792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 735/1446] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:05.176384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c002419-4b9e-4248-9ef1-8eebb9232b51 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:05.176915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c002419-4b9e-4248-9ef1-8eebb9232b51 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:05.176915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c002419-4b9e-4248-9ef1-8eebb9232b51 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:05.178419 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 712/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:31:05.183600 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84693901-3fec-4837-99fa-cfdbd0cf8dac None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:05.184001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84693901-3fec-4837-99fa-cfdbd0cf8dac None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:05.184182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84693901-3fec-4837-99fa-cfdbd0cf8dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:05.231389 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:05.248816 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-84693901-3fec-4837-99fa-cfdbd0cf8dac None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:05.250108 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-84693901-3fec-4837-99fa-cfdbd0cf8dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:05.346786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 736/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:05.386760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c002419-4b9e-4248-9ef1-8eebb9232b51 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:05.388356 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-6c002419-4b9e-4248-9ef1-8eebb9232b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:05.490722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c002419-4b9e-4248-9ef1-8eebb9232b51 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:05.529921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:05.562903 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5576b5b4-ba00-4ac2-aa32-b75ab0f57aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:05.563540 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576b5b4-ba00-4ac2-aa32-b75ab0f57aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:05.563819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576b5b4-ba00-4ac2-aa32-b75ab0f57aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:05.564172 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5576b5b4-ba00-4ac2-aa32-b75ab0f57aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:05.565826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-5576b5b4-ba00-4ac2-aa32-b75ab0f57aa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:05.672414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576b5b4-ba00-4ac2-aa32-b75ab0f57aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:05.673884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5576b5b4-ba00-4ac2-aa32-b75ab0f57aa4 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:05.691452 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 713/1449] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:07.836105 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194a2f8-a900-4270-a069-33ae901d031d None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:07.836608 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194a2f8-a900-4270-a069-33ae901d031d None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:07.836722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194a2f8-a900-4270-a069-33ae901d031d None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:07.838115 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 737/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:31:07.843423 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cd55c-07fc-4d6e-bce0-5bf85c3ac2a9 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:07.843867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cd55c-07fc-4d6e-bce0-5bf85c3ac2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:07.843993 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cd55c-07fc-4d6e-bce0-5bf85c3ac2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:07.912105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-5e5cd55c-07fc-4d6e-bce0-5bf85c3ac2a9 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:07.913310 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-5e5cd55c-07fc-4d6e-bce0-5bf85c3ac2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:07.934307 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:08.009455 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 714/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:08.048541 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194a2f8-a900-4270-a069-33ae901d031d None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:08.050136 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-9194a2f8-a900-4270-a069-33ae901d031d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:08.153416 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194a2f8-a900-4270-a069-33ae901d031d None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:08.173922 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:08.226205 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe36311-3a2d-4bf0-9082-0492710c8901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:08.226845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe36311-3a2d-4bf0-9082-0492710c8901 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:08.227123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe36311-3a2d-4bf0-9082-0492710c8901 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:08.227394 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe36311-3a2d-4bf0-9082-0492710c8901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:08.229867 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-1fe36311-3a2d-4bf0-9082-0492710c8901 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:08.335184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe36311-3a2d-4bf0-9082-0492710c8901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:08.336542 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe36311-3a2d-4bf0-9082-0492710c8901 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:08.355243 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 738/1452] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:10.436384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b9e72-8973-411a-a034-92ceb08547ab None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:10.436960 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b9e72-8973-411a-a034-92ceb08547ab None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:10.436960 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b9e72-8973-411a-a034-92ceb08547ab None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:10.438385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 715/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:31:10.443563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa1138-d04c-4152-8591-21c3183a0cc2 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:10.443977 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa1138-d04c-4152-8591-21c3183a0cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:10.444160 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa1138-d04c-4152-8591-21c3183a0cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:10.506129 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:10.508791 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-17fa1138-d04c-4152-8591-21c3183a0cc2 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:10.510038 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-17fa1138-d04c-4152-8591-21c3183a0cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:10.606445 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 739/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:10.644606 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b9e72-8973-411a-a034-92ceb08547ab None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:10.646176 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7e9b9e72-8973-411a-a034-92ceb08547ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:10.750024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b9e72-8973-411a-a034-92ceb08547ab None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:10.798400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:10.823483 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adba31-a7e0-497a-9e19-6f6cd3126707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:10.824118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adba31-a7e0-497a-9e19-6f6cd3126707 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:10.824399 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adba31-a7e0-497a-9e19-6f6cd3126707 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:10.824673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adba31-a7e0-497a-9e19-6f6cd3126707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:10.826366 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f4adba31-a7e0-497a-9e19-6f6cd3126707 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:11.053341 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adba31-a7e0-497a-9e19-6f6cd3126707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:11.054790 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adba31-a7e0-497a-9e19-6f6cd3126707 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:11.072761 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 716/1455] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:13.160955 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b40cdf-b68f-49e0-96fa-6d0c2a94e468 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:13.161782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b40cdf-b68f-49e0-96fa-6d0c2a94e468 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:13.161948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b40cdf-b68f-49e0-96fa-6d0c2a94e468 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:13.163430 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 740/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:31:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:31:13.168814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df684466-f595-45e3-a2a4-dbcad162dc6d None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:13.169225 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df684466-f595-45e3-a2a4-dbcad162dc6d None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:13.169377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df684466-f595-45e3-a2a4-dbcad162dc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:13.232544 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-df684466-f595-45e3-a2a4-dbcad162dc6d None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:13.233777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-df684466-f595-45e3-a2a4-dbcad162dc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:13.263911 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:13.336253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 717/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:13.374971 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b40cdf-b68f-49e0-96fa-6d0c2a94e468 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:13.376591 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e8b40cdf-b68f-49e0-96fa-6d0c2a94e468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:13.480606 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b40cdf-b68f-49e0-96fa-6d0c2a94e468 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:13.508583 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:13.552608 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b1cf3-d8be-4fd1-9b73-9aea7ad3ebf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:13.553251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b1cf3-d8be-4fd1-9b73-9aea7ad3ebf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:13.553554 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b1cf3-d8be-4fd1-9b73-9aea7ad3ebf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:13.553834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b1cf3-d8be-4fd1-9b73-9aea7ad3ebf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:13.555468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ee2b1cf3-d8be-4fd1-9b73-9aea7ad3ebf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:13.663191 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b1cf3-d8be-4fd1-9b73-9aea7ad3ebf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:13.664681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b1cf3-d8be-4fd1-9b73-9aea7ad3ebf9 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:13.684772 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 741/1458] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:15.789432 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f13eb-7568-4266-939e-dff0124c24af None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:15.789932 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f13eb-7568-4266-939e-dff0124c24af None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:15.790063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f13eb-7568-4266-939e-dff0124c24af None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:15.791449 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 718/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:31:15.796747 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd671d5-7e3d-46b6-b258-fce901eb1e92 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:15.797148 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd671d5-7e3d-46b6-b258-fce901eb1e92 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:15.797311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd671d5-7e3d-46b6-b258-fce901eb1e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:15.861077 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-6bd671d5-7e3d-46b6-b258-fce901eb1e92 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:15.862333 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-6bd671d5-7e3d-46b6-b258-fce901eb1e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:15.871233 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:15.961497 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 742/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:15.999891 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f13eb-7568-4266-939e-dff0124c24af None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:16.001572 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ce0f13eb-7568-4266-939e-dff0124c24af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:16.102928 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f13eb-7568-4266-939e-dff0124c24af None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:16.158837 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:16.177065 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467990a-5f43-40da-9844-3792534ba6b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:16.177743 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467990a-5f43-40da-9844-3792534ba6b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:16.178028 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467990a-5f43-40da-9844-3792534ba6b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:16.178303 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467990a-5f43-40da-9844-3792534ba6b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:16.179950 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-0467990a-5f43-40da-9844-3792534ba6b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:16.288774 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467990a-5f43-40da-9844-3792534ba6b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:16.290767 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467990a-5f43-40da-9844-3792534ba6b3 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:16.308770 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 719/1461] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:18.384595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e55c0b-019b-4383-9504-369bd8477830 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:18.385159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e55c0b-019b-4383-9504-369bd8477830 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:18.385159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e55c0b-019b-4383-9504-369bd8477830 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:18.386617 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 743/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:31:18.391961 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5d561-745a-4dfc-86cc-ac5f146f483a None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:18.392385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5d561-745a-4dfc-86cc-ac5f146f483a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:18.392516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5d561-745a-4dfc-86cc-ac5f146f483a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:18.455195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-01f5d561-745a-4dfc-86cc-ac5f146f483a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:18.456392 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-01f5d561-745a-4dfc-86cc-ac5f146f483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:18.494379 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:18.551205 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 720/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:18.589015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e55c0b-019b-4383-9504-369bd8477830 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:18.590609 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-79e55c0b-019b-4383-9504-369bd8477830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:18.692968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e55c0b-019b-4383-9504-369bd8477830 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:18.730868 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:18.768407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d301a-50d7-4e03-a4ce-c7057f1785d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:18.769058 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d301a-50d7-4e03-a4ce-c7057f1785d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:18.769339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d301a-50d7-4e03-a4ce-c7057f1785d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:18.769655 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d301a-50d7-4e03-a4ce-c7057f1785d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:18.771303 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-873d301a-50d7-4e03-a4ce-c7057f1785d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:18.877596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d301a-50d7-4e03-a4ce-c7057f1785d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:18.879035 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d301a-50d7-4e03-a4ce-c7057f1785d4 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:18.897049 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 744/1464] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:20.950433 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489f732-8522-4c55-a71f-cd5e99311582 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:20.950994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489f732-8522-4c55-a71f-cd5e99311582 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:20.950994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489f732-8522-4c55-a71f-cd5e99311582 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:20.952389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 721/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:31:20.957742 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068eb80-67bf-47b0-98f1-a65337b3870a None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:20.958172 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068eb80-67bf-47b0-98f1-a65337b3870a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:20.958309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068eb80-67bf-47b0-98f1-a65337b3870a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:21.022243 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-e068eb80-67bf-47b0-98f1-a65337b3870a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:21.023453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e068eb80-67bf-47b0-98f1-a65337b3870a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:21.042097 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:21.118928 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 745/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:21.156423 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489f732-8522-4c55-a71f-cd5e99311582 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:21.158033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c489f732-8522-4c55-a71f-cd5e99311582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:21.257473 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489f732-8522-4c55-a71f-cd5e99311582 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:21.326960 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:21.333673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bedea-e282-42b3-b1ab-76cf4dfc2574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:21.334330 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bedea-e282-42b3-b1ab-76cf4dfc2574 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:21.334636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bedea-e282-42b3-b1ab-76cf4dfc2574 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:21.334913 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bedea-e282-42b3-b1ab-76cf4dfc2574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:21.337261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ad0bedea-e282-42b3-b1ab-76cf4dfc2574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:21.442947 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bedea-e282-42b3-b1ab-76cf4dfc2574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:21.444384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bedea-e282-42b3-b1ab-76cf4dfc2574 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:21.462964 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 722/1467] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:23.503793 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf96755-d591-444d-9990-d0fb0e5b3adb None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:23.504388 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf96755-d591-444d-9990-d0fb0e5b3adb None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:23.504388 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf96755-d591-444d-9990-d0fb0e5b3adb None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:23.505780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 746/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:31:23.510947 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df95a8-99d0-41ff-a283-6a545e1d9169 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:23.511392 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df95a8-99d0-41ff-a283-6a545e1d9169 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:23.511509 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df95a8-99d0-41ff-a283-6a545e1d9169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:23.575444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-d5df95a8-99d0-41ff-a283-6a545e1d9169 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:23.576567 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-d5df95a8-99d0-41ff-a283-6a545e1d9169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:23.623925 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:23.670809 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 723/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:23.707988 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf96755-d591-444d-9990-d0fb0e5b3adb None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:23.709489 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-dbf96755-d591-444d-9990-d0fb0e5b3adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:23.818292 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf96755-d591-444d-9990-d0fb0e5b3adb None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:23.865855 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:23.890506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050823b9-7509-492e-b804-45e6c62d910d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:23.891144 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050823b9-7509-492e-b804-45e6c62d910d service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:23.891421 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050823b9-7509-492e-b804-45e6c62d910d service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:23.891691 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050823b9-7509-492e-b804-45e6c62d910d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:23.893316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-050823b9-7509-492e-b804-45e6c62d910d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:24.001982 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050823b9-7509-492e-b804-45e6c62d910d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:24.003433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050823b9-7509-492e-b804-45e6c62d910d service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:24.021588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 747/1470] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:33.690812 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=22 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:34.019321 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=66 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:43.753733 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8cde7-c2c0-4110-9f78-7b86f149a84b None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:43.754295 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8cde7-c2c0-4110-9f78-7b86f149a84b None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:43.754420 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8cde7-c2c0-4110-9f78-7b86f149a84b None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:43.755746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 724/1471] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:31:43.761600 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23deab53-5e60-4c07-a539-1dcb5185be22 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:43.762038 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23deab53-5e60-4c07-a539-1dcb5185be22 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:43.762149 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23deab53-5e60-4c07-a539-1dcb5185be22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:43.824380 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-23deab53-5e60-4c07-a539-1dcb5185be22 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:43.825604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-23deab53-5e60-4c07-a539-1dcb5185be22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:43.919357 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 748/1472] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:44.003032 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152ea7a-7fd4-4fe8-9661-16383bc09a26 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:44.003319 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152ea7a-7fd4-4fe8-9661-16383bc09a26 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:44.003621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152ea7a-7fd4-4fe8-9661-16383bc09a26 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:44.005022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 725/1473] 10.222.0.57 () {54 vars in 966 bytes} [Thu Jul 21 08:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:31:44.010322 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e64c57-9e46-4398-877c-410082aca385 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:44.010615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e64c57-9e46-4398-877c-410082aca385 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:44.010891 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e64c57-9e46-4398-877c-410082aca385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:44.085066 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-85e64c57-9e46-4398-877c-410082aca385 None None] MFA Rules not processed for user `2b27a4861d6b4ddfaca1a97efdaf008d`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:44.086303 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-85e64c57-9e46-4398-877c-410082aca385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:44.111634 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:44.169447 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 749/1474] 10.222.0.57 () {58 vars in 1063 bytes} [Thu Jul 21 08:31:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:44.176868 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152ea7a-7fd4-4fe8-9661-16383bc09a26 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:44.178411 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-8152ea7a-7fd4-4fe8-9661-16383bc09a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:44.279478 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152ea7a-7fd4-4fe8-9661-16383bc09a26 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:44.350390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295ecc6-a27c-44c8-be81-f386de41efb6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b27a4861d6b4ddfaca1a97efdaf008d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:44.351025 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295ecc6-a27c-44c8-be81-f386de41efb6 service glance] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:44.351305 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295ecc6-a27c-44c8-be81-f386de41efb6 service glance] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:44.351575 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295ecc6-a27c-44c8-be81-f386de41efb6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:44.353749 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9295ecc6-a27c-44c8-be81-f386de41efb6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:44.406049 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:44.459446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295ecc6-a27c-44c8-be81-f386de41efb6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:44.460911 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295ecc6-a27c-44c8-be81-f386de41efb6 service glance] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:44.479609 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 726/1475] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:46.609308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1143c50-4dc5-412f-b873-4ca63bcdd437 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:46.609969 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1143c50-4dc5-412f-b873-4ca63bcdd437 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:46.609969 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1143c50-4dc5-412f-b873-4ca63bcdd437 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:46.611277 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 750/1476] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:31:46.616410 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb58954-6ea4-4b0e-85d8-f98b7f84320a None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:46.617010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb58954-6ea4-4b0e-85d8-f98b7f84320a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:46.617290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb58954-6ea4-4b0e-85d8-f98b7f84320a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:46.681884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-1fb58954-6ea4-4b0e-85d8-f98b7f84320a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:46.683094 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-1fb58954-6ea4-4b0e-85d8-f98b7f84320a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:46.781331 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 727/1477] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:46.804944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1143c50-4dc5-412f-b873-4ca63bcdd437 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:46.807133 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b1143c50-4dc5-412f-b873-4ca63bcdd437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:46.933212 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1143c50-4dc5-412f-b873-4ca63bcdd437 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:46.980628 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:47.025727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3769e-43dd-4729-bac0-574d7a8d610b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:47.026391 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3769e-43dd-4729-bac0-574d7a8d610b admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:47.026674 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3769e-43dd-4729-bac0-574d7a8d610b admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:47.026949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3769e-43dd-4729-bac0-574d7a8d610b admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:47.027674 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3769e-43dd-4729-bac0-574d7a8d610b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:47.029455 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: WARNING py.warnings [None req-85d3769e-43dd-4729-bac0-574d7a8d610b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:31:47.029455 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: warnings.warn(msg) Jul 21 08:31:47.029455 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: Jul 21 08:31:47.030640 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3769e-43dd-4729-bac0-574d7a8d610b admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:47.049756 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 751/1478] 10.222.0.57 () {56 vars in 1108 bytes} [Thu Jul 21 08:31:46 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:31:49.106463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686139b-7f9d-4165-8a85-94a7e0e940e0 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:49.107038 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686139b-7f9d-4165-8a85-94a7e0e940e0 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:49.107038 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686139b-7f9d-4165-8a85-94a7e0e940e0 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:49.108317 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 728/1479] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:31:49.113704 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42a0e1-2024-4dee-a547-6c77adaa9aa8 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:49.114182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42a0e1-2024-4dee-a547-6c77adaa9aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:49.114294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c42a0e1-2024-4dee-a547-6c77adaa9aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:49.178682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-3c42a0e1-2024-4dee-a547-6c77adaa9aa8 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:49.179895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-3c42a0e1-2024-4dee-a547-6c77adaa9aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:49.276770 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 752/1480] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:49.320303 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686139b-7f9d-4165-8a85-94a7e0e940e0 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:49.321955 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-3686139b-7f9d-4165-8a85-94a7e0e940e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:49.331548 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:49.463607 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686139b-7f9d-4165-8a85-94a7e0e940e0 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:49.541909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:49.573035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6f75f-d4a2-4778-8171-57050a3d0976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:49.573702 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6f75f-d4a2-4778-8171-57050a3d0976 service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:49.573978 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6f75f-d4a2-4778-8171-57050a3d0976 service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:49.574245 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6f75f-d4a2-4778-8171-57050a3d0976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:49.575910 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-57d6f75f-d4a2-4778-8171-57050a3d0976 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:49.663659 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6f75f-d4a2-4778-8171-57050a3d0976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:49.665296 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6f75f-d4a2-4778-8171-57050a3d0976 service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:49.682798 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 729/1481] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:51.899340 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3c1e0-d082-4934-bd85-1244b33b371e None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:51.899902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3c1e0-d082-4934-bd85-1244b33b371e None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:51.899902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3c1e0-d082-4934-bd85-1244b33b371e None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:51.901454 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 753/1482] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:31:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:31:51.906923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6a368-5502-4986-b591-1af33fbcf3dc None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:51.907345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6a368-5502-4986-b591-1af33fbcf3dc None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:51.907489 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6a368-5502-4986-b591-1af33fbcf3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:51.972368 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-b2a6a368-5502-4986-b591-1af33fbcf3dc None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:51.973613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b2a6a368-5502-4986-b591-1af33fbcf3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:52.020224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:52.069953 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 730/1483] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:52.108532 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3c1e0-d082-4934-bd85-1244b33b371e None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:52.110123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-8eb3c1e0-d082-4934-bd85-1244b33b371e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:52.139188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:52.218151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3c1e0-d082-4934-bd85-1244b33b371e None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:52.290561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103da06d-f979-4a90-8877-1c3e5a23ee8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:52.291132 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103da06d-f979-4a90-8877-1c3e5a23ee8a service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:52.291420 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103da06d-f979-4a90-8877-1c3e5a23ee8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:52.291690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103da06d-f979-4a90-8877-1c3e5a23ee8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:52.293303 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-103da06d-f979-4a90-8877-1c3e5a23ee8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:52.366966 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:52.401591 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103da06d-f979-4a90-8877-1c3e5a23ee8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:52.403038 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103da06d-f979-4a90-8877-1c3e5a23ee8a service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:52.421350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 754/1484] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:54.503586 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306590e-e91d-4927-8e07-6dfb45949041 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:54.504144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306590e-e91d-4927-8e07-6dfb45949041 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:54.504144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306590e-e91d-4927-8e07-6dfb45949041 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:54.505495 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 731/1485] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:31:54.511343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05bc4-bcb5-458b-98b4-2069349fea24 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:54.511343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05bc4-bcb5-458b-98b4-2069349fea24 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:54.511800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05bc4-bcb5-458b-98b4-2069349fea24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:54.574539 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-10f05bc4-bcb5-458b-98b4-2069349fea24 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:54.575730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-10f05bc4-bcb5-458b-98b4-2069349fea24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:54.669162 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 755/1486] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:31:54.706691 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306590e-e91d-4927-8e07-6dfb45949041 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:54.708209 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a306590e-e91d-4927-8e07-6dfb45949041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:54.809069 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306590e-e91d-4927-8e07-6dfb45949041 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:54.878112 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:54.879903 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b253f-63cb-449e-a6d0-83357055bec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:54.880538 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b253f-63cb-449e-a6d0-83357055bec7 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:54.880823 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b253f-63cb-449e-a6d0-83357055bec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:54.881094 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b253f-63cb-449e-a6d0-83357055bec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:54.882747 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-455b253f-63cb-449e-a6d0-83357055bec7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:54.989579 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b253f-63cb-449e-a6d0-83357055bec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:54.991026 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b253f-63cb-449e-a6d0-83357055bec7 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:55.009206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 732/1487] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:31:57.195848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf8789-36d9-4eb5-9ed6-c327b1799510 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:57.196437 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf8789-36d9-4eb5-9ed6-c327b1799510 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:57.196437 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf8789-36d9-4eb5-9ed6-c327b1799510 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:57.197829 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 756/1488] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:31:57.203253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5aeec9-33c9-489a-a3fc-d0f0c5b4a631 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:57.203685 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5aeec9-33c9-489a-a3fc-d0f0c5b4a631 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:57.203782 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5aeec9-33c9-489a-a3fc-d0f0c5b4a631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:57.266785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-3f5aeec9-33c9-489a-a3fc-d0f0c5b4a631 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:31:57.267973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-3f5aeec9-33c9-489a-a3fc-d0f0c5b4a631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:57.320565 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:57.363997 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 733/1489] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:31:57.404343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf8789-36d9-4eb5-9ed6-c327b1799510 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:31:57.405936 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-60cf8789-36d9-4eb5-9ed6-c327b1799510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:57.441934 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:57.508736 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf8789-36d9-4eb5-9ed6-c327b1799510 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:31:57.579899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c338ca-b4b4-478e-899f-412c2ae0c772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:31:57.580543 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c338ca-b4b4-478e-899f-412c2ae0c772 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:31:57.580830 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c338ca-b4b4-478e-899f-412c2ae0c772 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:31:57.581111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c338ca-b4b4-478e-899f-412c2ae0c772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:31:57.582784 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e4c338ca-b4b4-478e-899f-412c2ae0c772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:31:57.661590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:31:57.690637 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c338ca-b4b4-478e-899f-412c2ae0c772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:31:57.692249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c338ca-b4b4-478e-899f-412c2ae0c772 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:31:57.712735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 757/1490] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:00.153394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f0960-7513-4daf-b706-2614a696bf12 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:00.153999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f0960-7513-4daf-b706-2614a696bf12 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:00.153999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f0960-7513-4daf-b706-2614a696bf12 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:00.155412 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 734/1491] 10.222.0.57 () {54 vars in 926 bytes} [Thu Jul 21 08:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:32:00.160828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d51eb-23d9-42f3-8c15-1baa30e93855 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:00.161303 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d51eb-23d9-42f3-8c15-1baa30e93855 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:00.161419 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d51eb-23d9-42f3-8c15-1baa30e93855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:00.226349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-235d51eb-23d9-42f3-8c15-1baa30e93855 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:32:00.227605 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-235d51eb-23d9-42f3-8c15-1baa30e93855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:00.331326 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 758/1492] 10.222.0.57 () {58 vars in 1023 bytes} [Thu Jul 21 08:32:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:32:00.370866 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f0960-7513-4daf-b706-2614a696bf12 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:32:00.372408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-8a2f0960-7513-4daf-b706-2614a696bf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:00.475174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f0960-7513-4daf-b706-2614a696bf12 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:32:00.546698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6487a-ce8a-4f47-aa39-870b55c863cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:32:00.547332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6487a-ce8a-4f47-aa39-870b55c863cd service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:32:00.547641 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6487a-ce8a-4f47-aa39-870b55c863cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:32:00.547910 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6487a-ce8a-4f47-aa39-870b55c863cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:32:00.549547 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-79a6487a-ce8a-4f47-aa39-870b55c863cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:32:00.559883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:00.665346 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6487a-ce8a-4f47-aa39-870b55c863cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:32:00.666835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6487a-ce8a-4f47-aa39-870b55c863cd service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:32:00.685117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 735/1493] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:32:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:32:10.329473 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=82 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:32:10.682830 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=50 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:35.393963 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a643f-256d-46bd-8872-e9682a7a777c None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:35.394471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a643f-256d-46bd-8872-e9682a7a777c None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:35.394578 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a643f-256d-46bd-8872-e9682a7a777c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:35.466745 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-811a643f-256d-46bd-8872-e9682a7a777c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:35.467958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-811a643f-256d-46bd-8872-e9682a7a777c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:35.563788 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 759/1494] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:35.571712 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a403c-9bc5-425c-8a7d-951e9c38b63e None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:35.572188 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a403c-9bc5-425c-8a7d-951e9c38b63e None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:35.572296 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a403c-9bc5-425c-8a7d-951e9c38b63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:35.646369 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-540a403c-9bc5-425c-8a7d-951e9c38b63e None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:35.647591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-540a403c-9bc5-425c-8a7d-951e9c38b63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:35.745142 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 736/1495] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:35.750027 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a643f-256d-46bd-8872-e9682a7a777c None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:35.751250 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-811a643f-256d-46bd-8872-e9682a7a777c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:35.762733 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a643f-256d-46bd-8872-e9682a7a777c None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:35.823252 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:35.857675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dde81-9b1a-488e-bb61-faf09452319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:35.858394 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dde81-9b1a-488e-bb61-faf09452319f admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:35.858870 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dde81-9b1a-488e-bb61-faf09452319f admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:35.859316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7dde81-9b1a-488e-bb61-faf09452319f admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:35.860330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dde81-9b1a-488e-bb61-faf09452319f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:33:35.860668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dde81-9b1a-488e-bb61-faf09452319f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:35.861723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: WARNING py.warnings [None req-5c7dde81-9b1a-488e-bb61-faf09452319f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:33:35.861723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: warnings.warn(msg) Jul 21 08:33:35.861723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: Jul 21 08:33:35.862625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7dde81-9b1a-488e-bb61-faf09452319f admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:35.873990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 760/1496] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:33:35.882175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a403c-9bc5-425c-8a7d-951e9c38b63e None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:35.891672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a403c-9bc5-425c-8a7d-951e9c38b63e None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:35.951236 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:35.986993 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af95216-e88e-40b2-8d69-31d370ae130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:35.987654 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af95216-e88e-40b2-8d69-31d370ae130a admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:35.987937 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af95216-e88e-40b2-8d69-31d370ae130a admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:35.988215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af95216-e88e-40b2-8d69-31d370ae130a admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:35.988893 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af95216-e88e-40b2-8d69-31d370ae130a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:35.990825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: WARNING py.warnings [None req-9af95216-e88e-40b2-8d69-31d370ae130a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:33:35.990825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: warnings.warn(msg) Jul 21 08:33:35.990825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: Jul 21 08:33:35.992024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af95216-e88e-40b2-8d69-31d370ae130a admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:36.102145 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 737/1497] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:33:35 2022] POST /identity/v3/projects => generated 377 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:33:36.106566 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dde81-9b1a-488e-bb61-faf09452319f admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:36.108084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5c7dde81-9b1a-488e-bb61-faf09452319f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:36.144762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7dde81-9b1a-488e-bb61-faf09452319f admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:36.245153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673028e-a4c6-4068-99cd-3a28da615515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:36.245760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673028e-a4c6-4068-99cd-3a28da615515 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:36.246047 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673028e-a4c6-4068-99cd-3a28da615515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:36.246318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673028e-a4c6-4068-99cd-3a28da615515 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:36.246996 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673028e-a4c6-4068-99cd-3a28da615515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:36.248011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: WARNING py.warnings [None req-b673028e-a4c6-4068-99cd-3a28da615515 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:33:36.248011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: warnings.warn(msg) Jul 21 08:33:36.248011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: Jul 21 08:33:36.249257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673028e-a4c6-4068-99cd-3a28da615515 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:36.415433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 761/1498] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:33:36 2022] POST /identity/v3/users => generated 289 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:33:36.419734 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af95216-e88e-40b2-8d69-31d370ae130a admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:36.421236 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9af95216-e88e-40b2-8d69-31d370ae130a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:36.481743 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af95216-e88e-40b2-8d69-31d370ae130a admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:36.569267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:36.579636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff890153-d0ff-41cb-af89-103e064807e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:36.580517 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff890153-d0ff-41cb-af89-103e064807e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:36.580702 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff890153-d0ff-41cb-af89-103e064807e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:36.580990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff890153-d0ff-41cb-af89-103e064807e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:36.581740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff890153-d0ff-41cb-af89-103e064807e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:36.582749 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: WARNING py.warnings [None req-ff890153-d0ff-41cb-af89-103e064807e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:33:36.582749 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: warnings.warn(msg) Jul 21 08:33:36.582749 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: Jul 21 08:33:36.583613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff890153-d0ff-41cb-af89-103e064807e1 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:36.596504 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 738/1499] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:36.601329 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673028e-a4c6-4068-99cd-3a28da615515 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:36.602892 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b673028e-a4c6-4068-99cd-3a28da615515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:36.616619 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673028e-a4c6-4068-99cd-3a28da615515 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:36.642538 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:36.716103 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae30f2c-0fae-46f5-8420-0ffd21f96f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:36.716767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae30f2c-0fae-46f5-8420-0ffd21f96f04 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:36.717045 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae30f2c-0fae-46f5-8420-0ffd21f96f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:36.717317 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae30f2c-0fae-46f5-8420-0ffd21f96f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:36.718073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae30f2c-0fae-46f5-8420-0ffd21f96f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:36.719081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: WARNING py.warnings [None req-aae30f2c-0fae-46f5-8420-0ffd21f96f04 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:33:36.719081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: warnings.warn(msg) Jul 21 08:33:36.719081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: Jul 21 08:33:36.720031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae30f2c-0fae-46f5-8420-0ffd21f96f04 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:36.733332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 762/1500] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:33:36.737544 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff890153-d0ff-41cb-af89-103e064807e1 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:36.739087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ff890153-d0ff-41cb-af89-103e064807e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:36.772794 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff890153-d0ff-41cb-af89-103e064807e1 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:36.865077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83d51d-330f-4a83-86ac-830ba7acc0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:36.866460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83d51d-330f-4a83-86ac-830ba7acc0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:36.866738 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83d51d-330f-4a83-86ac-830ba7acc0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:36.867005 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83d51d-330f-4a83-86ac-830ba7acc0bc admin admin] PATH_INFO: `/v3/projects/1276a99275bb4e1eaf2ec9a59fd15da2/users/8ec27cf4b79848e1986150d90b6f23f6/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:36.888335 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83d51d-330f-4a83-86ac-830ba7acc0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1276a99275bb4e1eaf2ec9a59fd15da2, user_id=8ec27cf4b79848e1986150d90b6f23f6, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:36.889362 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: WARNING py.warnings [None req-bf83d51d-330f-4a83-86ac-830ba7acc0bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:33:36.889362 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: warnings.warn(msg) Jul 21 08:33:36.889362 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: Jul 21 08:33:36.891331 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83d51d-330f-4a83-86ac-830ba7acc0bc admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:36.996363 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 739/1501] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:33:36 2022] PUT /identity/v3/projects/1276a99275bb4e1eaf2ec9a59fd15da2/users/8ec27cf4b79848e1986150d90b6f23f6/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:37.008412 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e6ff9-6fc3-4678-8a98-ef705f256636 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:37.011283 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e6ff9-6fc3-4678-8a98-ef705f256636 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:37.011283 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e6ff9-6fc3-4678-8a98-ef705f256636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:37.063736 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-eb3e6ff9-6fc3-4678-8a98-ef705f256636 None None] MFA Rules not processed for user `8ec27cf4b79848e1986150d90b6f23f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:37.064922 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-eb3e6ff9-6fc3-4678-8a98-ef705f256636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:37.183622 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 763/1502] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:33:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:37.196808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543783f9-b41e-41ae-91d6-0de561f4978c None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:37.197102 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543783f9-b41e-41ae-91d6-0de561f4978c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:37.197386 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543783f9-b41e-41ae-91d6-0de561f4978c None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:37.198789 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 740/1503] 10.222.0.57 () {54 vars in 964 bytes} [Thu Jul 21 08:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:33:37.203468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8244c-fc3d-40eb-83cb-278e2b6edebc None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:37.203761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8244c-fc3d-40eb-83cb-278e2b6edebc None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:37.204070 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8244c-fc3d-40eb-83cb-278e2b6edebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:37.234795 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:37.280819 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-e4d8244c-fc3d-40eb-83cb-278e2b6edebc None None] MFA Rules not processed for user `aebefbc2dc0244d8a5ae7d88be6b63ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:37.282095 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e4d8244c-fc3d-40eb-83cb-278e2b6edebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:37.359530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 764/1504] 10.222.0.57 () {58 vars in 1061 bytes} [Thu Jul 21 08:33:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:37.367168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543783f9-b41e-41ae-91d6-0de561f4978c None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:37.368692 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-543783f9-b41e-41ae-91d6-0de561f4978c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:37.418326 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:37.470595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543783f9-b41e-41ae-91d6-0de561f4978c None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:37.545120 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8b57b-e46e-459a-b1f8-2d8d2d71e293 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:37.545788 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8b57b-e46e-459a-b1f8-2d8d2d71e293 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:37.546068 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8b57b-e46e-459a-b1f8-2d8d2d71e293 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:37.546340 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8b57b-e46e-459a-b1f8-2d8d2d71e293 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:37.547987 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-bdf8b57b-e46e-459a-b1f8-2d8d2d71e293 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:37.644475 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8b57b-e46e-459a-b1f8-2d8d2d71e293 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:37.645960 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8b57b-e46e-459a-b1f8-2d8d2d71e293 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:37.650086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:37.664220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 741/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:33:37.705867 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef56f3-4625-4659-b2ff-f7ebf98307fc None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:37.706281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef56f3-4625-4659-b2ff-f7ebf98307fc None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:37.706417 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef56f3-4625-4659-b2ff-f7ebf98307fc None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:37.707703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 765/1506] 10.222.0.57 () {52 vars in 829 bytes} [Thu Jul 21 08:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:33:37.713981 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8b57b-e46e-459a-b1f8-2d8d2d71e293 service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:37.715202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-bdf8b57b-e46e-459a-b1f8-2d8d2d71e293 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:37.812961 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8b57b-e46e-459a-b1f8-2d8d2d71e293 service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:37.904764 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d41ee-34e5-4ff0-9b5a-740c7a0ae102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:37.905652 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d41ee-34e5-4ff0-9b5a-740c7a0ae102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:37.905931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d41ee-34e5-4ff0-9b5a-740c7a0ae102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:37.906201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d41ee-34e5-4ff0-9b5a-740c7a0ae102 admin admin] PATH_INFO: `/v3/users/8ec27cf4b79848e1986150d90b6f23f6` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:37.917972 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d41ee-34e5-4ff0-9b5a-740c7a0ae102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec27cf4b79848e1986150d90b6f23f6)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:37.918985 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: WARNING py.warnings [None req-452d41ee-34e5-4ff0-9b5a-740c7a0ae102 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:33:37.918985 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: warnings.warn(msg) Jul 21 08:33:37.918985 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: Jul 21 08:33:37.920179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452d41ee-34e5-4ff0-9b5a-740c7a0ae102 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:37.929975 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:38.151196 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-452d41ee-34e5-4ff0-9b5a-740c7a0ae102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec27cf4b79848e1986150d90b6f23f6'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:38.168886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-452d41ee-34e5-4ff0-9b5a-740c7a0ae102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec27cf4b79848e1986150d90b6f23f6'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:38.181295 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-452d41ee-34e5-4ff0-9b5a-740c7a0ae102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec27cf4b79848e1986150d90b6f23f6'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:38.181876 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-452d41ee-34e5-4ff0-9b5a-740c7a0ae102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec27cf4b79848e1986150d90b6f23f6'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:38.182299 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-452d41ee-34e5-4ff0-9b5a-740c7a0ae102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec27cf4b79848e1986150d90b6f23f6'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:38.283711 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 742/1507] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:33:37 2022] DELETE /identity/v3/users/8ec27cf4b79848e1986150d90b6f23f6 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:38.288988 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45213f7-c6de-4fd8-b251-0d22f49a715c None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:38.291642 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45213f7-c6de-4fd8-b251-0d22f49a715c None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:38.291642 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45213f7-c6de-4fd8-b251-0d22f49a715c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:38.348085 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-d45213f7-c6de-4fd8-b251-0d22f49a715c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:33:38.349297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-d45213f7-c6de-4fd8-b251-0d22f49a715c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:38.422825 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:38.435153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 766/1508] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:33:38.445276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d41ee-34e5-4ff0-9b5a-740c7a0ae102 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:38.446533 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-452d41ee-34e5-4ff0-9b5a-740c7a0ae102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:38.544862 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d41ee-34e5-4ff0-9b5a-740c7a0ae102 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:38.601001 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:38.620588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066a22f-d736-4516-9393-dc934fc30963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:38.621255 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066a22f-d736-4516-9393-dc934fc30963 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:38.621560 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066a22f-d736-4516-9393-dc934fc30963 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:38.621823 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066a22f-d736-4516-9393-dc934fc30963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:38.623573 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9066a22f-d736-4516-9393-dc934fc30963 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:38.732439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066a22f-d736-4516-9393-dc934fc30963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:38.733835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066a22f-d736-4516-9393-dc934fc30963 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:38.751919 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 743/1509] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:33:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:33:39.232591 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45213f7-c6de-4fd8-b251-0d22f49a715c None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:33:39.233886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-d45213f7-c6de-4fd8-b251-0d22f49a715c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:33:39.245710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45213f7-c6de-4fd8-b251-0d22f49a715c None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:33:39.348355 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4fad8-650e-48c6-81cf-25eb7f2fee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:33:39.349138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4fad8-650e-48c6-81cf-25eb7f2fee61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:33:39.349420 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4fad8-650e-48c6-81cf-25eb7f2fee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:33:39.349730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4fad8-650e-48c6-81cf-25eb7f2fee61 admin admin] PATH_INFO: `/v3/projects/1276a99275bb4e1eaf2ec9a59fd15da2` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:33:39.360037 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4fad8-650e-48c6-81cf-25eb7f2fee61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1276a99275bb4e1eaf2ec9a59fd15da2)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:33:39.361061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: WARNING py.warnings [None req-efa4fad8-650e-48c6-81cf-25eb7f2fee61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:33:39.361061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: warnings.warn(msg) Jul 21 08:33:39.361061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: Jul 21 08:33:39.362302 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa4fad8-650e-48c6-81cf-25eb7f2fee61 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:33:39.479676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-efa4fad8-650e-48c6-81cf-25eb7f2fee61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1276a99275bb4e1eaf2ec9a59fd15da2', 'request_id': 'req-efa4fad8-650e-48c6-81cf-25eb7f2fee61'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:39.493370 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-efa4fad8-650e-48c6-81cf-25eb7f2fee61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1276a99275bb4e1eaf2ec9a59fd15da2', 'request_id': 'req-efa4fad8-650e-48c6-81cf-25eb7f2fee61'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:39.499436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-efa4fad8-650e-48c6-81cf-25eb7f2fee61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1276a99275bb4e1eaf2ec9a59fd15da2', 'request_id': 'req-efa4fad8-650e-48c6-81cf-25eb7f2fee61'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:39.601257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-efa4fad8-650e-48c6-81cf-25eb7f2fee61 admin admin] The token cache is being invalidate because project 1276a99275bb4e1eaf2ec9a59fd15da2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:33:39.601460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-efa4fad8-650e-48c6-81cf-25eb7f2fee61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:39.602031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-efa4fad8-650e-48c6-81cf-25eb7f2fee61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:33:39.603409 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 767/1510] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:33:39 2022] DELETE /identity/v3/projects/1276a99275bb4e1eaf2ec9a59fd15da2 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:33:48.749643 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=62 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:33:49.599132 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:21.223163 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832d9b0-bb05-4b5a-b32d-6ba24ed0038d None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:21.223796 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832d9b0-bb05-4b5a-b32d-6ba24ed0038d None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:21.223796 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832d9b0-bb05-4b5a-b32d-6ba24ed0038d None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:21.225093 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 744/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:35:21.230230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec34e16-3f34-49c0-a559-8ed80cbcfccd None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:21.230687 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec34e16-3f34-49c0-a559-8ed80cbcfccd None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:21.230802 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec34e16-3f34-49c0-a559-8ed80cbcfccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:21.437738 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-4ec34e16-3f34-49c0-a559-8ed80cbcfccd None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:35:21.439898 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4ec34e16-3f34-49c0-a559-8ed80cbcfccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:21.547639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 768/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:35:21.700734 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832d9b0-bb05-4b5a-b32d-6ba24ed0038d None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:21.702958 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-8832d9b0-bb05-4b5a-b32d-6ba24ed0038d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:21.823289 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832d9b0-bb05-4b5a-b32d-6ba24ed0038d None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:21.828650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c8063-fa74-4c4b-a734-f85530102f9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:21.829289 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c8063-fa74-4c4b-a734-f85530102f9a service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:21.829599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c8063-fa74-4c4b-a734-f85530102f9a service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:21.829878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c8063-fa74-4c4b-a734-f85530102f9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:21.838257 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c8063-fa74-4c4b-a734-f85530102f9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:21.840185 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c8063-fa74-4c4b-a734-f85530102f9a service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:21.850178 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 745/1513] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:22.683576 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e54d4-d2bb-46f5-ad58-a7a82fb2ce37 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:22.684146 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e54d4-d2bb-46f5-ad58-a7a82fb2ce37 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:22.684146 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e54d4-d2bb-46f5-ad58-a7a82fb2ce37 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:22.685589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 769/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:35:22.690805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12060677-5ecb-4b8f-9c70-5ade427ab648 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:22.691242 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12060677-5ecb-4b8f-9c70-5ade427ab648 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:22.691349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12060677-5ecb-4b8f-9c70-5ade427ab648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:22.709733 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-12060677-5ecb-4b8f-9c70-5ade427ab648 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:35:22.710922 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-12060677-5ecb-4b8f-9c70-5ade427ab648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:22.718753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 746/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:35:22.870126 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e54d4-d2bb-46f5-ad58-a7a82fb2ce37 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:22.885157 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e54d4-d2bb-46f5-ad58-a7a82fb2ce37 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:22.890613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5a60b-6322-426d-ac60-67cc6cb36dfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:22.891235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5a60b-6322-426d-ac60-67cc6cb36dfb service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:22.891511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5a60b-6322-426d-ac60-67cc6cb36dfb service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:22.891778 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5a60b-6322-426d-ac60-67cc6cb36dfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:22.900255 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d5a60b-6322-426d-ac60-67cc6cb36dfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:22.901946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d5a60b-6322-426d-ac60-67cc6cb36dfb service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:22.911084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 770/1516] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:23.049216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ff7d1-f104-4c14-9c5b-75adf81206e7 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:23.049500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ff7d1-f104-4c14-9c5b-75adf81206e7 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:23.049869 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ff7d1-f104-4c14-9c5b-75adf81206e7 None None] PATH_INFO: `/v3` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:23.051174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 747/1517] 10.222.0.52 () {54 vars in 925 bytes} [Thu Jul 21 08:35:23 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:35:23.059860 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee16ea-d2c7-430b-a267-eff7ebde89ce None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:23.060149 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee16ea-d2c7-430b-a267-eff7ebde89ce None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:23.060424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee16ea-d2c7-430b-a267-eff7ebde89ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:23.120546 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-71ee16ea-d2c7-430b-a267-eff7ebde89ce None None] MFA Rules not processed for user `4e38b7e84d6a43efbb4c1a52e2b3e681`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:35:23.121784 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-71ee16ea-d2c7-430b-a267-eff7ebde89ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:23.138114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:23.192220 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 771/1518] 10.222.0.52 () {58 vars in 1015 bytes} [Thu Jul 21 08:35:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:35:32.295010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa21a4f-8018-460a-9e55-8b864529b416 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:32.295566 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa21a4f-8018-460a-9e55-8b864529b416 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:32.295566 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa21a4f-8018-460a-9e55-8b864529b416 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:32.296836 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 748/1519] 10.222.0.57 () {54 vars in 961 bytes} [Thu Jul 21 08:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:35:32.302343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe69520-aea3-421d-9b97-d779489fce8f None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:32.302770 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe69520-aea3-421d-9b97-d779489fce8f None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:32.302870 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe69520-aea3-421d-9b97-d779489fce8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:32.321109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-9fe69520-aea3-421d-9b97-d779489fce8f None None] MFA Rules not processed for user `4e38b7e84d6a43efbb4c1a52e2b3e681`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:35:32.322383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-9fe69520-aea3-421d-9b97-d779489fce8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:32.331626 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 772/1520] 10.222.0.57 () {58 vars in 1058 bytes} [Thu Jul 21 08:35:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:35:32.339184 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa21a4f-8018-460a-9e55-8b864529b416 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:32.354866 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa21a4f-8018-460a-9e55-8b864529b416 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:32.359819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4675dd5-8d02-4f21-83a2-d0068392af12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38b7e84d6a43efbb4c1a52e2b3e681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:32.360457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4675dd5-8d02-4f21-83a2-d0068392af12 service placement] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:32.361332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4675dd5-8d02-4f21-83a2-d0068392af12 service placement] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:32.361641 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4675dd5-8d02-4f21-83a2-d0068392af12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:32.370107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4675dd5-8d02-4f21-83a2-d0068392af12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:32.371696 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4675dd5-8d02-4f21-83a2-d0068392af12 service placement] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:32.381980 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 749/1521] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:34.138935 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab8490-8992-40a3-b4a8-8f9d312cf0ab None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:34.139495 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab8490-8992-40a3-b4a8-8f9d312cf0ab None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:34.139495 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab8490-8992-40a3-b4a8-8f9d312cf0ab None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:34.140895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 773/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:35:34.145824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009502f-e41c-4a68-aebb-381b74cb4bb4 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:34.146257 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009502f-e41c-4a68-aebb-381b74cb4bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:34.146365 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009502f-e41c-4a68-aebb-381b74cb4bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:34.164309 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-0009502f-e41c-4a68-aebb-381b74cb4bb4 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:35:34.165492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-0009502f-e41c-4a68-aebb-381b74cb4bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:34.173951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 750/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:35:34.330009 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab8490-8992-40a3-b4a8-8f9d312cf0ab None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:34.344232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab8490-8992-40a3-b4a8-8f9d312cf0ab None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:34.349849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235b76a-aa60-417a-999d-6dd30ea587e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:34.350481 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235b76a-aa60-417a-999d-6dd30ea587e6 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:34.350768 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235b76a-aa60-417a-999d-6dd30ea587e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:34.351050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235b76a-aa60-417a-999d-6dd30ea587e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:34.359350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235b76a-aa60-417a-999d-6dd30ea587e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:34.361747 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235b76a-aa60-417a-999d-6dd30ea587e6 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:34.371193 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 774/1524] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:35.199590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67fbfe-2433-4203-9c6b-dfc6f4d473d5 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:35.200156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67fbfe-2433-4203-9c6b-dfc6f4d473d5 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:35.200156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67fbfe-2433-4203-9c6b-dfc6f4d473d5 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:35.201556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 751/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 08:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:35:35.206520 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712ea4a-463d-4e6d-a74f-e6e9cd598681 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:35.206950 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712ea4a-463d-4e6d-a74f-e6e9cd598681 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:35.207060 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712ea4a-463d-4e6d-a74f-e6e9cd598681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:35.224514 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-e712ea4a-463d-4e6d-a74f-e6e9cd598681 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:35:35.225817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e712ea4a-463d-4e6d-a74f-e6e9cd598681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:35.233865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 775/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 08:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:35:35.388489 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67fbfe-2433-4203-9c6b-dfc6f4d473d5 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:35.402601 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67fbfe-2433-4203-9c6b-dfc6f4d473d5 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:35.408560 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6a2e3-da79-4698-a1bb-1f5b6dae03d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:35.409264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6a2e3-da79-4698-a1bb-1f5b6dae03d6 service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:35.409576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6a2e3-da79-4698-a1bb-1f5b6dae03d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:35.409862 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6a2e3-da79-4698-a1bb-1f5b6dae03d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:35.418051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6a2e3-da79-4698-a1bb-1f5b6dae03d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:35.419636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6a2e3-da79-4698-a1bb-1f5b6dae03d6 service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:35.429629 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 752/1527] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:39.593410 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c3272-a436-436e-a25d-eb4728ee9263 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:39.593969 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c3272-a436-436e-a25d-eb4728ee9263 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:39.594093 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c3272-a436-436e-a25d-eb4728ee9263 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:39.595442 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 776/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:35:39.600541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f33d6-f22b-4510-b87e-2095702ead4d None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:39.600982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f33d6-f22b-4510-b87e-2095702ead4d None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:39.601103 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f33d6-f22b-4510-b87e-2095702ead4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:39.620014 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-9e2f33d6-f22b-4510-b87e-2095702ead4d None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:35:39.621216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9e2f33d6-f22b-4510-b87e-2095702ead4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:39.629740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 753/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:35:39.703421 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c3272-a436-436e-a25d-eb4728ee9263 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:39.705148 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-928c3272-a436-436e-a25d-eb4728ee9263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:39.783686 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c3272-a436-436e-a25d-eb4728ee9263 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:39.808326 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a262c864-1f33-426f-8644-a57ce2864344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:39.808988 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c864-1f33-426f-8644-a57ce2864344 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:39.809273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c864-1f33-426f-8644-a57ce2864344 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:39.809576 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a262c864-1f33-426f-8644-a57ce2864344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:39.820579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262c864-1f33-426f-8644-a57ce2864344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:39.822056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a262c864-1f33-426f-8644-a57ce2864344 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:39.832601 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 777/1530] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:41.858910 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057c860-ca3e-4e8c-b8f9-8e4a39c65c9d None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:41.862886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057c860-ca3e-4e8c-b8f9-8e4a39c65c9d None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:41.862886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057c860-ca3e-4e8c-b8f9-8e4a39c65c9d None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:41.862886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 754/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:35:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:35:41.866646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626814b-6a40-4648-94bb-588c48e60e8f None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:41.867094 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626814b-6a40-4648-94bb-588c48e60e8f None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:41.867246 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626814b-6a40-4648-94bb-588c48e60e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:41.885471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-d626814b-6a40-4648-94bb-588c48e60e8f None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:35:41.886696 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-d626814b-6a40-4648-94bb-588c48e60e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:41.894499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 778/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:35:41.931645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057c860-ca3e-4e8c-b8f9-8e4a39c65c9d None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:41.933332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-5057c860-ca3e-4e8c-b8f9-8e4a39c65c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:41.946802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057c860-ca3e-4e8c-b8f9-8e4a39c65c9d None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:41.950406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9133eb1a-0395-4544-a768-4a1a8c81a392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:41.951039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133eb1a-0395-4544-a768-4a1a8c81a392 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:41.951323 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133eb1a-0395-4544-a768-4a1a8c81a392 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:41.951601 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9133eb1a-0395-4544-a768-4a1a8c81a392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:41.960558 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133eb1a-0395-4544-a768-4a1a8c81a392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:41.962035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9133eb1a-0395-4544-a768-4a1a8c81a392 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:41.971351 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 755/1533] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:45.671447 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c17f7c-d0bc-4c72-b49d-d66d28503e6e None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:45.671982 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c17f7c-d0bc-4c72-b49d-d66d28503e6e None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:45.671982 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c17f7c-d0bc-4c72-b49d-d66d28503e6e None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:45.673870 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 779/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:35:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:35:45.679169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818d971-3f2c-4f54-be0b-151e2ba16c1b None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:45.679618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818d971-3f2c-4f54-be0b-151e2ba16c1b None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:45.679735 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818d971-3f2c-4f54-be0b-151e2ba16c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:45.698942 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-e818d971-3f2c-4f54-be0b-151e2ba16c1b None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:35:45.700147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e818d971-3f2c-4f54-be0b-151e2ba16c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:45.708029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 756/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:35:46.010299 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c17f7c-d0bc-4c72-b49d-d66d28503e6e None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:46.011991 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-a3c17f7c-d0bc-4c72-b49d-d66d28503e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:46.077191 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:46.090991 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c17f7c-d0bc-4c72-b49d-d66d28503e6e None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:46.094617 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143de64-3413-4436-8d6e-2b3388f29dd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:46.095260 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143de64-3413-4436-8d6e-2b3388f29dd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:46.095542 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143de64-3413-4436-8d6e-2b3388f29dd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:46.095833 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143de64-3413-4436-8d6e-2b3388f29dd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:46.104935 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143de64-3413-4436-8d6e-2b3388f29dd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:46.106402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143de64-3413-4436-8d6e-2b3388f29dd3 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:46.115704 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 780/1536] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:48.168066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ebef0-3d29-4e19-b5b6-0c6b7e161ec4 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:48.168618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ebef0-3d29-4e19-b5b6-0c6b7e161ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:48.168618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ebef0-3d29-4e19-b5b6-0c6b7e161ec4 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:48.170017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 757/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 08:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:35:48.175832 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff275-062a-41fd-bc41-d83a5f5a2d5a None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:48.176281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff275-062a-41fd-bc41-d83a5f5a2d5a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:48.176386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff275-062a-41fd-bc41-d83a5f5a2d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:48.193728 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-873ff275-062a-41fd-bc41-d83a5f5a2d5a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:35:48.194924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-873ff275-062a-41fd-bc41-d83a5f5a2d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:48.202816 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 781/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 08:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:35:48.504994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ebef0-3d29-4e19-b5b6-0c6b7e161ec4 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:35:48.506707 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a88ebef0-3d29-4e19-b5b6-0c6b7e161ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:35:48.520117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ebef0-3d29-4e19-b5b6-0c6b7e161ec4 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:35:48.523654 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b164f-575e-4aa3-b4cb-c62cd8c26373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:35:48.524289 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b164f-575e-4aa3-b4cb-c62cd8c26373 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:35:48.524572 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b164f-575e-4aa3-b4cb-c62cd8c26373 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:35:48.524846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b164f-575e-4aa3-b4cb-c62cd8c26373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:35:48.534357 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b164f-575e-4aa3-b4cb-c62cd8c26373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:35:48.535794 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6b164f-575e-4aa3-b4cb-c62cd8c26373 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:35:48.545122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 758/1539] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:35:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:35:58.188989 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=11 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:35:58.541101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=89 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:17.850177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f191584-4a3f-429d-b182-0821249c291b None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:17.850847 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f191584-4a3f-429d-b182-0821249c291b None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:17.850847 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f191584-4a3f-429d-b182-0821249c291b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:17.878663 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-6f191584-4a3f-429d-b182-0821249c291b None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:17.880688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-6f191584-4a3f-429d-b182-0821249c291b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:17.893917 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 782/1540] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:17.902941 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff4690-c8a6-4392-910a-bc11e75ec334 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:17.903502 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff4690-c8a6-4392-910a-bc11e75ec334 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:17.903502 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff4690-c8a6-4392-910a-bc11e75ec334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:17.935597 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-cfff4690-c8a6-4392-910a-bc11e75ec334 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:17.936817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-cfff4690-c8a6-4392-910a-bc11e75ec334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:17.950675 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 759/1541] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:17.955821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f191584-4a3f-429d-b182-0821249c291b None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:17.971763 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f191584-4a3f-429d-b182-0821249c291b None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:17.986981 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4e35a-c39e-41f6-9181-b9f8ef4ce467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:17.987667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4e35a-c39e-41f6-9181-b9f8ef4ce467 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:17.988291 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4e35a-c39e-41f6-9181-b9f8ef4ce467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:17.989454 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4e35a-c39e-41f6-9181-b9f8ef4ce467 admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:17.990814 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4e35a-c39e-41f6-9181-b9f8ef4ce467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:37:17.991529 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4e35a-c39e-41f6-9181-b9f8ef4ce467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:17.993819 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4e35a-c39e-41f6-9181-b9f8ef4ce467 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:18.013642 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 783/1542] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:37:18.022849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff4690-c8a6-4392-910a-bc11e75ec334 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:18.040426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff4690-c8a6-4392-910a-bc11e75ec334 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:18.051828 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446427a-5330-4827-9a63-147a8bc9e242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:18.052534 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446427a-5330-4827-9a63-147a8bc9e242 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.052818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446427a-5330-4827-9a63-147a8bc9e242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.053096 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446427a-5330-4827-9a63-147a8bc9e242 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.053851 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446427a-5330-4827-9a63-147a8bc9e242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:18.055859 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446427a-5330-4827-9a63-147a8bc9e242 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:18.127875 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ee841-7e32-4f42-9efb-e4f5c967dcd7 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.128157 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ee841-7e32-4f42-9efb-e4f5c967dcd7 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.128421 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ee841-7e32-4f42-9efb-e4f5c967dcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.153485 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-243ee841-7e32-4f42-9efb-e4f5c967dcd7 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:18.154759 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-243ee841-7e32-4f42-9efb-e4f5c967dcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:18.167315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 784/1543] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:37:18.177260 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386c769-16cf-4635-8e2f-6fe27bc812d5 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.177931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386c769-16cf-4635-8e2f-6fe27bc812d5 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.178239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9386c769-16cf-4635-8e2f-6fe27bc812d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.192536 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 760/1544] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:18 2022] POST /identity/v3/projects => generated 389 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:18.197649 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446427a-5330-4827-9a63-147a8bc9e242 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:18.202172 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-9386c769-16cf-4635-8e2f-6fe27bc812d5 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:18.203358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-9386c769-16cf-4635-8e2f-6fe27bc812d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:18.295607 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 785/1545] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:18.300092 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386c769-16cf-4635-8e2f-6fe27bc812d5 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:18.309485 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9386c769-16cf-4635-8e2f-6fe27bc812d5 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:18.322241 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a1802-eec2-460c-b23e-aee47ab51ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:18.322924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a1802-eec2-460c-b23e-aee47ab51ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.323219 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a1802-eec2-460c-b23e-aee47ab51ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.323479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a1802-eec2-460c-b23e-aee47ab51ba2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.324214 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a1802-eec2-460c-b23e-aee47ab51ba2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:37:18.324523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a1802-eec2-460c-b23e-aee47ab51ba2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:18.326309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a1802-eec2-460c-b23e-aee47ab51ba2 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:18.336417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446427a-5330-4827-9a63-147a8bc9e242 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:18.344171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 786/1546] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:37:18.352617 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219ea2d-7527-4bb8-87b2-0a83c127ff4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:18.353147 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a1802-eec2-460c-b23e-aee47ab51ba2 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:18.353354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219ea2d-7527-4bb8-87b2-0a83c127ff4b admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.353875 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219ea2d-7527-4bb8-87b2-0a83c127ff4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.354158 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219ea2d-7527-4bb8-87b2-0a83c127ff4b admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.354870 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219ea2d-7527-4bb8-87b2-0a83c127ff4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:18.356052 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: WARNING py.warnings [None req-b219ea2d-7527-4bb8-87b2-0a83c127ff4b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:37:18.356052 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: warnings.warn(msg) Jul 21 08:37:18.356052 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: Jul 21 08:37:18.357268 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219ea2d-7527-4bb8-87b2-0a83c127ff4b admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:18.374690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a1802-eec2-460c-b23e-aee47ab51ba2 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:18.386039 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8080e-63b1-4892-ace1-3c061e0f5d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:18.386718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8080e-63b1-4892-ace1-3c061e0f5d3d admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.387002 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8080e-63b1-4892-ace1-3c061e0f5d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.387282 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8080e-63b1-4892-ace1-3c061e0f5d3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.387979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8080e-63b1-4892-ace1-3c061e0f5d3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:18.389011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: WARNING py.warnings [None req-5bb8080e-63b1-4892-ace1-3c061e0f5d3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:37:18.389011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: warnings.warn(msg) Jul 21 08:37:18.389011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: Jul 21 08:37:18.390283 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8080e-63b1-4892-ace1-3c061e0f5d3d admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:18.513611 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 761/1547] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:18 2022] POST /identity/v3/users => generated 295 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:37:18.514940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dfb1f-f13d-4b2e-ac03-78066f9c7df2 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.515241 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dfb1f-f13d-4b2e-ac03-78066f9c7df2 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.515523 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1dfb1f-f13d-4b2e-ac03-78066f9c7df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.534586 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-cc1dfb1f-f13d-4b2e-ac03-78066f9c7df2 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:18.536723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-cc1dfb1f-f13d-4b2e-ac03-78066f9c7df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:18.545218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 762/1548] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:18.551758 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7211c1-fbde-4665-bcb1-272ed8178359 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.552608 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7211c1-fbde-4665-bcb1-272ed8178359 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.553300 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7211c1-fbde-4665-bcb1-272ed8178359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.575008 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 787/1549] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:18 2022] POST /identity/v3/projects => generated 393 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:18.576668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbae4b-130f-4a28-84e9-4d0b6e0b9571 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.576961 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-7a7211c1-fbde-4665-bcb1-272ed8178359 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:18.577150 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbae4b-130f-4a28-84e9-4d0b6e0b9571 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.577310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbae4b-130f-4a28-84e9-4d0b6e0b9571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.578202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7a7211c1-fbde-4665-bcb1-272ed8178359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:18.596875 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-96cbae4b-130f-4a28-84e9-4d0b6e0b9571 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:18.605843 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-96cbae4b-130f-4a28-84e9-4d0b6e0b9571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:18.645872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 763/1550] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:18.647203 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071b21b-1067-42e6-85ea-1780401fc3a7 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.647469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071b21b-1067-42e6-85ea-1780401fc3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.647851 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071b21b-1067-42e6-85ea-1780401fc3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.659735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 788/1551] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:18.673691 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbae4b-130f-4a28-84e9-4d0b6e0b9571 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:18.673847 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-3071b21b-1067-42e6-85ea-1780401fc3a7 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:18.673847 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-3071b21b-1067-42e6-85ea-1780401fc3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:18.674051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbae4b-130f-4a28-84e9-4d0b6e0b9571 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:18.674787 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 764/1552] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:18.676009 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b02dfe-8bf0-4cc6-acc9-d96948c51e2f None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.676423 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b02dfe-8bf0-4cc6-acc9-d96948c51e2f None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.676698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b02dfe-8bf0-4cc6-acc9-d96948c51e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.685797 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf96fa-69db-4385-bf3c-e57f122f5198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:18.686791 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf96fa-69db-4385-bf3c-e57f122f5198 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.687098 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf96fa-69db-4385-bf3c-e57f122f5198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.687432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf96fa-69db-4385-bf3c-e57f122f5198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.688172 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf96fa-69db-4385-bf3c-e57f122f5198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:18.689811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf96fa-69db-4385-bf3c-e57f122f5198 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:18.695050 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-44b02dfe-8bf0-4cc6-acc9-d96948c51e2f None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:18.696245 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-44b02dfe-8bf0-4cc6-acc9-d96948c51e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:18.700789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 789/1553] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:18.703195 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec6edd-75ff-4f32-9c99-21c8ae8286da None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.703195 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec6edd-75ff-4f32-9c99-21c8ae8286da None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.703195 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec6edd-75ff-4f32-9c99-21c8ae8286da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.706064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 765/1554] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:18.707315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e5ff0-d8de-44d9-8dad-c266c9add4b0 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.708163 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e5ff0-d8de-44d9-8dad-c266c9add4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.708441 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e5ff0-d8de-44d9-8dad-c266c9add4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.725177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-d6ec6edd-75ff-4f32-9c99-21c8ae8286da None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:18.725625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-831e5ff0-d8de-44d9-8dad-c266c9add4b0 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:18.742469 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-d6ec6edd-75ff-4f32-9c99-21c8ae8286da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:18.742627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-831e5ff0-d8de-44d9-8dad-c266c9add4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:18.742733 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 790/1555] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:18.742838 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 766/1556] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:18.742927 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec6edd-75ff-4f32-9c99-21c8ae8286da None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:18.743027 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47ac82-c52c-439e-b9c1-ffb2a8f81b96 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.743027 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47ac82-c52c-439e-b9c1-ffb2a8f81b96 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.743027 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47ac82-c52c-439e-b9c1-ffb2a8f81b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.753832 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec6edd-75ff-4f32-9c99-21c8ae8286da None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:18.759194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8f9ca-af64-4a91-8a16-66bf2e8fd609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:18.759861 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8f9ca-af64-4a91-8a16-66bf2e8fd609 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.760143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8f9ca-af64-4a91-8a16-66bf2e8fd609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.760414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8f9ca-af64-4a91-8a16-66bf2e8fd609 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.761099 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8f9ca-af64-4a91-8a16-66bf2e8fd609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:18.763155 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be8f9ca-af64-4a91-8a16-66bf2e8fd609 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:18.764663 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-1c47ac82-c52c-439e-b9c1-ffb2a8f81b96 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:18.765890 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-1c47ac82-c52c-439e-b9c1-ffb2a8f81b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:18.774583 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 767/1557] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:18.776037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252bdde-7af0-48ee-ba56-77dacebdcf83 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.776327 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252bdde-7af0-48ee-ba56-77dacebdcf83 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.776609 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252bdde-7af0-48ee-ba56-77dacebdcf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.794165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-c252bdde-7af0-48ee-ba56-77dacebdcf83 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:18.795383 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c252bdde-7af0-48ee-ba56-77dacebdcf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:18.803499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 768/1558] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:18.804724 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af7d57-8d19-487c-8dda-478c0279c63f None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.805013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af7d57-8d19-487c-8dda-478c0279c63f None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.805289 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af7d57-8d19-487c-8dda-478c0279c63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.823654 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-e8af7d57-8d19-487c-8dda-478c0279c63f None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:18.824820 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e8af7d57-8d19-487c-8dda-478c0279c63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:18.833610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 769/1559] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:18.837317 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af7d57-8d19-487c-8dda-478c0279c63f None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:18.844070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af7d57-8d19-487c-8dda-478c0279c63f None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:18.848391 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 791/1560] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:18 2022] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:18.856035 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8f9ca-af64-4a91-8a16-66bf2e8fd609 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:18.856633 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ab983-9077-45d9-90a6-8a269c8837bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:18.856633 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ab983-9077-45d9-90a6-8a269c8837bd admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.856633 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ab983-9077-45d9-90a6-8a269c8837bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.856633 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ab983-9077-45d9-90a6-8a269c8837bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.857052 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ab983-9077-45d9-90a6-8a269c8837bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:18.857052 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ab983-9077-45d9-90a6-8a269c8837bd admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:18.857052 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:18.857308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:18.859229 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be8f9ca-af64-4a91-8a16-66bf2e8fd609 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:18.863855 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73f141-4488-4a35-8b01-4d6aa583c8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:18.864511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73f141-4488-4a35-8b01-4d6aa583c8cd admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.864774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73f141-4488-4a35-8b01-4d6aa583c8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.865046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73f141-4488-4a35-8b01-4d6aa583c8cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.865464 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 770/1561] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:18.865931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73f141-4488-4a35-8b01-4d6aa583c8cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:37:18.866236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73f141-4488-4a35-8b01-4d6aa583c8cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:18.866726 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191021b5-0fc0-4600-85ec-1ce2a0413532 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.867018 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191021b5-0fc0-4600-85ec-1ce2a0413532 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.867417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191021b5-0fc0-4600-85ec-1ce2a0413532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.867823 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73f141-4488-4a35-8b01-4d6aa583c8cd admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:18.880759 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 792/1562] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:37:18.886190 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6188d7c-2da7-46a9-bfe3-214bdb269f55 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.886190 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6188d7c-2da7-46a9-bfe3-214bdb269f55 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.886190 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6188d7c-2da7-46a9-bfe3-214bdb269f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.886477 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-191021b5-0fc0-4600-85ec-1ce2a0413532 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:18.886717 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-191021b5-0fc0-4600-85ec-1ce2a0413532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:18.896008 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 771/1563] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:18.896865 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191021b5-0fc0-4600-85ec-1ce2a0413532 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:18.900213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-c6188d7c-2da7-46a9-bfe3-214bdb269f55 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:18.901393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-c6188d7c-2da7-46a9-bfe3-214bdb269f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:18.906925 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191021b5-0fc0-4600-85ec-1ce2a0413532 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:18.912070 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 793/1564] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:18.912070 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6188d7c-2da7-46a9-bfe3-214bdb269f55 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:18.912298 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0dd26-3902-4673-b997-1b58cb905d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:18.912298 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0dd26-3902-4673-b997-1b58cb905d9a admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.912520 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0dd26-3902-4673-b997-1b58cb905d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.912796 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0dd26-3902-4673-b997-1b58cb905d9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.913519 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0dd26-3902-4673-b997-1b58cb905d9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:37:18.913856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0dd26-3902-4673-b997-1b58cb905d9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:18.914875 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: WARNING py.warnings [None req-31b0dd26-3902-4673-b997-1b58cb905d9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:37:18.914875 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: warnings.warn(msg) Jul 21 08:37:18.914875 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: Jul 21 08:37:18.915771 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b0dd26-3902-4673-b997-1b58cb905d9a admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:18.920188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6188d7c-2da7-46a9-bfe3-214bdb269f55 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:18.924774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39334c09-a865-44d1-91ba-6baf742a81f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:18.925411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39334c09-a865-44d1-91ba-6baf742a81f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.925722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39334c09-a865-44d1-91ba-6baf742a81f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.925993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39334c09-a865-44d1-91ba-6baf742a81f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.926767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39334c09-a865-44d1-91ba-6baf742a81f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:37:18.927087 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39334c09-a865-44d1-91ba-6baf742a81f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:18.927918 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 772/1565] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:37:18.928668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39334c09-a865-44d1-91ba-6baf742a81f8 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:18.928861 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0dd26-3902-4673-b997-1b58cb905d9a admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:18.940418 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0dd26-3902-4673-b997-1b58cb905d9a admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:18.941143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 794/1566] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:37:18.942265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39334c09-a865-44d1-91ba-6baf742a81f8 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:18.945924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed594397-ed89-4fa5-a107-91d90d7ee89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:18.946575 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed594397-ed89-4fa5-a107-91d90d7ee89f admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.946984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed594397-ed89-4fa5-a107-91d90d7ee89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.947130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed594397-ed89-4fa5-a107-91d90d7ee89f admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.947856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed594397-ed89-4fa5-a107-91d90d7ee89f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:37:18.948285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed594397-ed89-4fa5-a107-91d90d7ee89f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:18.950021 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed594397-ed89-4fa5-a107-91d90d7ee89f admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:18.952235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39334c09-a865-44d1-91ba-6baf742a81f8 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:18.958294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945a0bd-4735-4bb7-9d75-ef2b52353053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:18.958973 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945a0bd-4735-4bb7-9d75-ef2b52353053 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.959256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945a0bd-4735-4bb7-9d75-ef2b52353053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.959563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945a0bd-4735-4bb7-9d75-ef2b52353053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.960423 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945a0bd-4735-4bb7-9d75-ef2b52353053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:18.962025 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945a0bd-4735-4bb7-9d75-ef2b52353053 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:18.962824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 773/1567] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:37:18.963671 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed594397-ed89-4fa5-a107-91d90d7ee89f admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:18.975347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 795/1568] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:18.975347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945a0bd-4735-4bb7-9d75-ef2b52353053 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:18.975687 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed594397-ed89-4fa5-a107-91d90d7ee89f admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:18.979174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7990d99-b166-4a81-8a9f-037a866281c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:18.981013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7990d99-b166-4a81-8a9f-037a866281c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.981013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7990d99-b166-4a81-8a9f-037a866281c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.981013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7990d99-b166-4a81-8a9f-037a866281c3 admin admin] PATH_INFO: `/v3/projects/e70d3c63003440bc9ed504fcef81f783/users/a8e20ceefdcd48c88cf35ecf0bcd736b/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.983216 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945a0bd-4735-4bb7-9d75-ef2b52353053 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:18.987890 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d175f2d-3a61-4d8d-a9c5-225d73987c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:18.989039 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d175f2d-3a61-4d8d-a9c5-225d73987c3c admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:18.989330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d175f2d-3a61-4d8d-a9c5-225d73987c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:18.989686 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d175f2d-3a61-4d8d-a9c5-225d73987c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:18.990406 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d175f2d-3a61-4d8d-a9c5-225d73987c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:18.992343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d175f2d-3a61-4d8d-a9c5-225d73987c3c admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:18.995730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7990d99-b166-4a81-8a9f-037a866281c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70d3c63003440bc9ed504fcef81f783, user_id=a8e20ceefdcd48c88cf35ecf0bcd736b, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:18.998415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7990d99-b166-4a81-8a9f-037a866281c3 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:19.073738 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 774/1569] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:18 2022] PUT /identity/v3/projects/e70d3c63003440bc9ed504fcef81f783/users/a8e20ceefdcd48c88cf35ecf0bcd736b/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:19.074676 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7990d99-b166-4a81-8a9f-037a866281c3 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:19.098385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 796/1570] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:18 2022] POST /identity/v3/projects => generated 405 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:19.098385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d175f2d-3a61-4d8d-a9c5-225d73987c3c admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:19.141320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7990d99-b166-4a81-8a9f-037a866281c3 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:19.160614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d175f2d-3a61-4d8d-a9c5-225d73987c3c admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:19.165341 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a567e0-3bca-4a4f-b9b4-c05350fe9f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:19.166052 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a567e0-3bca-4a4f-b9b4-c05350fe9f87 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:19.168923 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a567e0-3bca-4a4f-b9b4-c05350fe9f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:19.168923 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a567e0-3bca-4a4f-b9b4-c05350fe9f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:19.168923 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a567e0-3bca-4a4f-b9b4-c05350fe9f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:37:19.168923 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a567e0-3bca-4a4f-b9b4-c05350fe9f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:19.169285 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a567e0-3bca-4a4f-b9b4-c05350fe9f87 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:19.180997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 797/1571] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:37:19.181874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a567e0-3bca-4a4f-b9b4-c05350fe9f87 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:19.192435 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a567e0-3bca-4a4f-b9b4-c05350fe9f87 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:19.197042 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6d2b5-5015-49d4-952a-828874c98c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:19.197795 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6d2b5-5015-49d4-952a-828874c98c8a admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:19.198093 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6d2b5-5015-49d4-952a-828874c98c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:19.198384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6d2b5-5015-49d4-952a-828874c98c8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:19.199053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6d2b5-5015-49d4-952a-828874c98c8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:19.200911 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6d2b5-5015-49d4-952a-828874c98c8a admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:19.205900 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fea21-1ab0-4bdf-b2c9-3130faa8617c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:19.206564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fea21-1ab0-4bdf-b2c9-3130faa8617c admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:19.206852 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fea21-1ab0-4bdf-b2c9-3130faa8617c admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:19.207131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fea21-1ab0-4bdf-b2c9-3130faa8617c admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:19.207862 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fea21-1ab0-4bdf-b2c9-3130faa8617c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:37:19.208222 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fea21-1ab0-4bdf-b2c9-3130faa8617c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:19.209798 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fea21-1ab0-4bdf-b2c9-3130faa8617c admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:19.221293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 775/1572] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:37:19.222110 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fea21-1ab0-4bdf-b2c9-3130faa8617c admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:19.231839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fea21-1ab0-4bdf-b2c9-3130faa8617c admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:19.236433 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f19290-eda0-40b0-8421-418b1ee7daf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:19.237054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f19290-eda0-40b0-8421-418b1ee7daf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:19.237403 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f19290-eda0-40b0-8421-418b1ee7daf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:19.237718 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f19290-eda0-40b0-8421-418b1ee7daf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:19.238396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f19290-eda0-40b0-8421-418b1ee7daf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:19.240779 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f19290-eda0-40b0-8421-418b1ee7daf2 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:19.296782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 798/1573] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:19 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:19.297818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6d2b5-5015-49d4-952a-828874c98c8a admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:19.329051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 776/1574] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:19 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:19.329051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f19290-eda0-40b0-8421-418b1ee7daf2 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:19.346499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:19.363986 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6d2b5-5015-49d4-952a-828874c98c8a admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:19.376338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:19.390237 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f19290-eda0-40b0-8421-418b1ee7daf2 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:19.395891 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebf92f-a4ba-4df4-9e3f-9d96b0f313e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:19.396607 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebf92f-a4ba-4df4-9e3f-9d96b0f313e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:19.396951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebf92f-a4ba-4df4-9e3f-9d96b0f313e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:19.397236 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebf92f-a4ba-4df4-9e3f-9d96b0f313e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:19.397998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebf92f-a4ba-4df4-9e3f-9d96b0f313e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:19.399663 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebf92f-a4ba-4df4-9e3f-9d96b0f313e8 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:19.409406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 777/1575] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:19.409406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56076ba-9dc4-4c12-8e01-8d45a21f33cc None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:19.409406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56076ba-9dc4-4c12-8e01-8d45a21f33cc None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:19.409406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56076ba-9dc4-4c12-8e01-8d45a21f33cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:19.424120 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771eafed-34b3-4e6c-b035-36e05f614dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:19.424784 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eafed-34b3-4e6c-b035-36e05f614dba admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:19.425112 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eafed-34b3-4e6c-b035-36e05f614dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:19.425407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771eafed-34b3-4e6c-b035-36e05f614dba admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:19.426703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771eafed-34b3-4e6c-b035-36e05f614dba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:19.429476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771eafed-34b3-4e6c-b035-36e05f614dba admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:19.430157 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-a56076ba-9dc4-4c12-8e01-8d45a21f33cc None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:19.431362 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a56076ba-9dc4-4c12-8e01-8d45a21f33cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:19.439537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 778/1576] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:19.440011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56076ba-9dc4-4c12-8e01-8d45a21f33cc None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:19.449389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56076ba-9dc4-4c12-8e01-8d45a21f33cc None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:19.454100 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7906660-748a-4292-9991-827ce47be19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:19.454753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7906660-748a-4292-9991-827ce47be19e admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:19.455036 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7906660-748a-4292-9991-827ce47be19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:19.455312 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7906660-748a-4292-9991-827ce47be19e admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:19.455994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7906660-748a-4292-9991-827ce47be19e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:19.458055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7906660-748a-4292-9991-827ce47be19e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:19.529011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 799/1577] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:19 2022] POST /identity/v3/projects => generated 405 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:19.529860 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771eafed-34b3-4e6c-b035-36e05f614dba admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:19.564593 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 779/1578] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:19 2022] POST /identity/v3/users => generated 303 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:19.566274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7906660-748a-4292-9991-827ce47be19e admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:19.574884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7906660-748a-4292-9991-827ce47be19e admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:19.606525 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771eafed-34b3-4e6c-b035-36e05f614dba admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:19.611297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96a481-c218-4f1e-8648-aa0f270be19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:19.611970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96a481-c218-4f1e-8648-aa0f270be19b admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:19.612290 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96a481-c218-4f1e-8648-aa0f270be19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:19.612572 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96a481-c218-4f1e-8648-aa0f270be19b admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:19.613257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96a481-c218-4f1e-8648-aa0f270be19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:19.615784 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96a481-c218-4f1e-8648-aa0f270be19b admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:19.637292 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a114361-0464-4424-be75-c2f411bef301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:19.638000 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a114361-0464-4424-be75-c2f411bef301 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:19.638302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a114361-0464-4424-be75-c2f411bef301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:19.638620 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a114361-0464-4424-be75-c2f411bef301 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:19.639391 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a114361-0464-4424-be75-c2f411bef301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:19.641418 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a114361-0464-4424-be75-c2f411bef301 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:19.730251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 780/1579] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:19 2022] POST /identity/v3/projects => generated 363 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:19.730784 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 800/1580] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:19 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:19.730952 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a114361-0464-4424-be75-c2f411bef301 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:19.731782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96a481-c218-4f1e-8648-aa0f270be19b admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:19.796777 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96a481-c218-4f1e-8648-aa0f270be19b admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:19.797433 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a114361-0464-4424-be75-c2f411bef301 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:19.801412 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c0f84-fe59-4ed1-9f95-198d8e03b2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:19.802194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c0f84-fe59-4ed1-9f95-198d8e03b2e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:19.802339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ffa26-7e17-4d30-a1d9-73b2c34d1be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:19.802467 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c0f84-fe59-4ed1-9f95-198d8e03b2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:19.802789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c0f84-fe59-4ed1-9f95-198d8e03b2e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:19.803120 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ffa26-7e17-4d30-a1d9-73b2c34d1be9 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:19.803407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ffa26-7e17-4d30-a1d9-73b2c34d1be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:19.803502 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c0f84-fe59-4ed1-9f95-198d8e03b2e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:19.803708 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ffa26-7e17-4d30-a1d9-73b2c34d1be9 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:19.804402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ffa26-7e17-4d30-a1d9-73b2c34d1be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:19.805395 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87c0f84-fe59-4ed1-9f95-198d8e03b2e2 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:19.806361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ffa26-7e17-4d30-a1d9-73b2c34d1be9 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:19.940777 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 801/1581] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:19 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:19.941648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c0f84-fe59-4ed1-9f95-198d8e03b2e2 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:19.950988 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87c0f84-fe59-4ed1-9f95-198d8e03b2e2 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:19.955699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53937257-061e-46cd-a567-1c0c2769a1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:19.956559 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53937257-061e-46cd-a567-1c0c2769a1d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:19.956843 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53937257-061e-46cd-a567-1c0c2769a1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:19.957124 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53937257-061e-46cd-a567-1c0c2769a1d8 admin admin] PATH_INFO: `/v3/projects/3808138b7b69440c88602c8ad2e5642c/users/017d2074ad8742ca8bd156593c591b5b/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:19.972397 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53937257-061e-46cd-a567-1c0c2769a1d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3808138b7b69440c88602c8ad2e5642c, user_id=017d2074ad8742ca8bd156593c591b5b, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:19.978201 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: WARNING py.warnings [None req-53937257-061e-46cd-a567-1c0c2769a1d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:37:19.978201 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: warnings.warn(msg) Jul 21 08:37:19.978201 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: Jul 21 08:37:19.978490 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 781/1582] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:19 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:19.978490 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ffa26-7e17-4d30-a1d9-73b2c34d1be9 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:19.979362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53937257-061e-46cd-a567-1c0c2769a1d8 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:19.979919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:19.982706 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:20.031887 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ffa26-7e17-4d30-a1d9-73b2c34d1be9 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:20.036161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f0e3b-6d02-4fb7-8097-2b693aa8a781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:20.036925 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f0e3b-6d02-4fb7-8097-2b693aa8a781 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.037212 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f0e3b-6d02-4fb7-8097-2b693aa8a781 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.037518 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f0e3b-6d02-4fb7-8097-2b693aa8a781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.046467 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f0e3b-6d02-4fb7-8097-2b693aa8a781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:20.047890 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f0e3b-6d02-4fb7-8097-2b693aa8a781 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:20.057212 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 782/1583] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:20.058071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f0e3b-6d02-4fb7-8097-2b693aa8a781 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:20.067073 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f0e3b-6d02-4fb7-8097-2b693aa8a781 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:20.071845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba25a0-ed0a-467e-9190-8e1789fb3a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:20.072467 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba25a0-ed0a-467e-9190-8e1789fb3a30 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.073559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba25a0-ed0a-467e-9190-8e1789fb3a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.073559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba25a0-ed0a-467e-9190-8e1789fb3a30 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.073736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba25a0-ed0a-467e-9190-8e1789fb3a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:20.075626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba25a0-ed0a-467e-9190-8e1789fb3a30 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:20.101394 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 802/1584] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:19 2022] PUT /identity/v3/projects/3808138b7b69440c88602c8ad2e5642c/users/017d2074ad8742ca8bd156593c591b5b/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:20.106035 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53937257-061e-46cd-a567-1c0c2769a1d8 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:20.162011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53937257-061e-46cd-a567-1c0c2769a1d8 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:20.166645 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae502e32-65a3-420f-9899-bcefecc3323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:20.167311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae502e32-65a3-420f-9899-bcefecc3323d admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.167596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae502e32-65a3-420f-9899-bcefecc3323d admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.167878 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae502e32-65a3-420f-9899-bcefecc3323d admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.168596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae502e32-65a3-420f-9899-bcefecc3323d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:20.174243 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae502e32-65a3-420f-9899-bcefecc3323d admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:20.187081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 803/1585] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:20.187081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae502e32-65a3-420f-9899-bcefecc3323d admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:20.197819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 783/1586] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:20 2022] POST /identity/v3/users => generated 303 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:20.197819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba25a0-ed0a-467e-9190-8e1789fb3a30 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:20.198071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae502e32-65a3-420f-9899-bcefecc3323d admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:20.200963 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffc416-9a42-46c4-b6a4-baf6abd37ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:20.202667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffc416-9a42-46c4-b6a4-baf6abd37ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.202667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffc416-9a42-46c4-b6a4-baf6abd37ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.203009 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffc416-9a42-46c4-b6a4-baf6abd37ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.203804 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffc416-9a42-46c4-b6a4-baf6abd37ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:20.206317 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba25a0-ed0a-467e-9190-8e1789fb3a30 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:20.210821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffc416-9a42-46c4-b6a4-baf6abd37ae2 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:20.214322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6d6fd-ac35-4df8-81ce-1ca1a66cef55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:20.215175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6d6fd-ac35-4df8-81ce-1ca1a66cef55 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.215524 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6d6fd-ac35-4df8-81ce-1ca1a66cef55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.216200 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6d6fd-ac35-4df8-81ce-1ca1a66cef55 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.217027 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6d6fd-ac35-4df8-81ce-1ca1a66cef55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:20.219219 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6d6fd-ac35-4df8-81ce-1ca1a66cef55 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:20.339415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 804/1587] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:20 2022] POST /identity/v3/users => generated 282 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:20.339666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 784/1588] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:20 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:20.339773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffc416-9a42-46c4-b6a4-baf6abd37ae2 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:20.339901 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6d6fd-ac35-4df8-81ce-1ca1a66cef55 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:20.348508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6d6fd-ac35-4df8-81ce-1ca1a66cef55 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:20.350057 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffc416-9a42-46c4-b6a4-baf6abd37ae2 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:20.353840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00563df-93f6-4d5d-a907-f54fc4883133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:20.354499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00563df-93f6-4d5d-a907-f54fc4883133 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.354779 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00563df-93f6-4d5d-a907-f54fc4883133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.355054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00563df-93f6-4d5d-a907-f54fc4883133 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.355152 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a60120-03b9-4b92-8f82-e3bb0c056154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:20.355781 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00563df-93f6-4d5d-a907-f54fc4883133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:20.355896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a60120-03b9-4b92-8f82-e3bb0c056154 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.356066 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a60120-03b9-4b92-8f82-e3bb0c056154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.356347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a60120-03b9-4b92-8f82-e3bb0c056154 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.357174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a60120-03b9-4b92-8f82-e3bb0c056154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:20.357445 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00563df-93f6-4d5d-a907-f54fc4883133 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:20.359003 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a60120-03b9-4b92-8f82-e3bb0c056154 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:20.368015 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 785/1589] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:20.369309 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a68184-64e9-4b38-b781-8d3c522cc7a1 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.369630 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a68184-64e9-4b38-b781-8d3c522cc7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.369899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a68184-64e9-4b38-b781-8d3c522cc7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.372818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 805/1590] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:20.372818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a60120-03b9-4b92-8f82-e3bb0c056154 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:20.385050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a60120-03b9-4b92-8f82-e3bb0c056154 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:20.392518 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88f521-594b-447c-b53b-404eff1b5005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:20.393280 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88f521-594b-447c-b53b-404eff1b5005 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.393601 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88f521-594b-447c-b53b-404eff1b5005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.393886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f88f521-594b-447c-b53b-404eff1b5005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.394703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88f521-594b-447c-b53b-404eff1b5005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:20.396259 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-88a68184-64e9-4b38-b781-8d3c522cc7a1 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:20.398276 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f88f521-594b-447c-b53b-404eff1b5005 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:20.403359 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-88a68184-64e9-4b38-b781-8d3c522cc7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:20.410629 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 806/1591] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:20.411160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 786/1592] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:20.414728 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88f521-594b-447c-b53b-404eff1b5005 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:20.419371 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a68184-64e9-4b38-b781-8d3c522cc7a1 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:20.430412 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a68184-64e9-4b38-b781-8d3c522cc7a1 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:20.430971 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f88f521-594b-447c-b53b-404eff1b5005 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:20.435315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be56bf2-d8ff-43d9-8259-e63a88a816eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:20.437552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be56bf2-d8ff-43d9-8259-e63a88a816eb admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.437552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be56bf2-d8ff-43d9-8259-e63a88a816eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.437552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be56bf2-d8ff-43d9-8259-e63a88a816eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.437922 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bf2bd-c3b8-441d-9199-73a62ca78adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:20.438055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be56bf2-d8ff-43d9-8259-e63a88a816eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:20.438148 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bf2bd-c3b8-441d-9199-73a62ca78adb admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.438148 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bf2bd-c3b8-441d-9199-73a62ca78adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.438356 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bf2bd-c3b8-441d-9199-73a62ca78adb admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.439082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bf2bd-c3b8-441d-9199-73a62ca78adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:20.439775 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be56bf2-d8ff-43d9-8259-e63a88a816eb admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:20.440980 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bf2bd-c3b8-441d-9199-73a62ca78adb admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:20.452049 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 787/1593] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:20.453149 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be56bf2-d8ff-43d9-8259-e63a88a816eb admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:20.456395 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 807/1594] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:20.457322 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bf2bd-c3b8-441d-9199-73a62ca78adb admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:20.474268 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be56bf2-d8ff-43d9-8259-e63a88a816eb admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:20.478013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4b106-c994-4527-8ed6-dc665724b65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:20.479529 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4b106-c994-4527-8ed6-dc665724b65f admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.480078 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4b106-c994-4527-8ed6-dc665724b65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.480456 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4b106-c994-4527-8ed6-dc665724b65f admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.481385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4b106-c994-4527-8ed6-dc665724b65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:20.482667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bf2bd-c3b8-441d-9199-73a62ca78adb admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:20.483641 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4b106-c994-4527-8ed6-dc665724b65f admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:20.489926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47b416-1a97-4937-b8b3-be6d1f38676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:20.491101 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47b416-1a97-4937-b8b3-be6d1f38676d admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.491379 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47b416-1a97-4937-b8b3-be6d1f38676d admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.491665 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47b416-1a97-4937-b8b3-be6d1f38676d admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.492758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47b416-1a97-4937-b8b3-be6d1f38676d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:20.494229 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47b416-1a97-4937-b8b3-be6d1f38676d admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:20.499823 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 788/1595] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:20.499823 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4b106-c994-4527-8ed6-dc665724b65f admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:20.508442 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 808/1596] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:20.509363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47b416-1a97-4937-b8b3-be6d1f38676d admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:20.511214 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4b106-c994-4527-8ed6-dc665724b65f admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:20.515921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d35e17-76cb-4970-ba94-de044451df93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:20.516601 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d35e17-76cb-4970-ba94-de044451df93 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.516911 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d35e17-76cb-4970-ba94-de044451df93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.517185 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d35e17-76cb-4970-ba94-de044451df93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.517945 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d35e17-76cb-4970-ba94-de044451df93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:20.519524 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d35e17-76cb-4970-ba94-de044451df93 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:20.519648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47b416-1a97-4937-b8b3-be6d1f38676d admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:20.524212 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa6428-57ff-4f1b-a19e-1fd9404d344e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:20.525092 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa6428-57ff-4f1b-a19e-1fd9404d344e admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.525376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa6428-57ff-4f1b-a19e-1fd9404d344e admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.526071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa6428-57ff-4f1b-a19e-1fd9404d344e admin admin] PATH_INFO: `/v3/projects/e1835845a32d4355be9895f1e4e0fa8a/users/6060b292e6a941839c8e8bc608662394/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.530963 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 789/1597] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:20.531913 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d35e17-76cb-4970-ba94-de044451df93 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:20.542084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa6428-57ff-4f1b-a19e-1fd9404d344e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1835845a32d4355be9895f1e4e0fa8a, user_id=6060b292e6a941839c8e8bc608662394, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:20.544803 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa6428-57ff-4f1b-a19e-1fd9404d344e admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:20.587166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d35e17-76cb-4970-ba94-de044451df93 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:20.591193 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69fc14-0e60-492a-9a6a-7531bfd1a4fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:20.591870 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69fc14-0e60-492a-9a6a-7531bfd1a4fb service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.592154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69fc14-0e60-492a-9a6a-7531bfd1a4fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.592434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69fc14-0e60-492a-9a6a-7531bfd1a4fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.602312 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69fc14-0e60-492a-9a6a-7531bfd1a4fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:20.605662 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c69fc14-0e60-492a-9a6a-7531bfd1a4fb service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:20.615259 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 790/1598] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:20.616108 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69fc14-0e60-492a-9a6a-7531bfd1a4fb service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:20.625947 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c69fc14-0e60-492a-9a6a-7531bfd1a4fb service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:20.639245 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 809/1599] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:20 2022] PUT /identity/v3/projects/e1835845a32d4355be9895f1e4e0fa8a/users/6060b292e6a941839c8e8bc608662394/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:20.640896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa6428-57ff-4f1b-a19e-1fd9404d344e admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:20.649474 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:20.692688 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130d332-5b10-4260-b5b2-35577a69af32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:20.693365 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130d332-5b10-4260-b5b2-35577a69af32 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.694013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130d332-5b10-4260-b5b2-35577a69af32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.694304 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130d332-5b10-4260-b5b2-35577a69af32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.695051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130d332-5b10-4260-b5b2-35577a69af32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:20.696676 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130d332-5b10-4260-b5b2-35577a69af32 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:20.711725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 791/1600] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:20.711725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130d332-5b10-4260-b5b2-35577a69af32 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:20.720193 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130d332-5b10-4260-b5b2-35577a69af32 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:20.721838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa6428-57ff-4f1b-a19e-1fd9404d344e admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:20.725822 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6e001-3712-4071-9c25-868b06dbb68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:20.726551 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6e001-3712-4071-9c25-868b06dbb68a admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.726838 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6e001-3712-4071-9c25-868b06dbb68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.727115 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6e001-3712-4071-9c25-868b06dbb68a admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.727883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6e001-3712-4071-9c25-868b06dbb68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:20.729770 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6e001-3712-4071-9c25-868b06dbb68a admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:20.732838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef607c-16e4-4d22-9081-79cb4f1b64b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:20.732838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef607c-16e4-4d22-9081-79cb4f1b64b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.732838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef607c-16e4-4d22-9081-79cb4f1b64b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.732838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef607c-16e4-4d22-9081-79cb4f1b64b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.733237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef607c-16e4-4d22-9081-79cb4f1b64b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:20.734867 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef607c-16e4-4d22-9081-79cb4f1b64b1 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:20.741589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 792/1601] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:20.744357 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:20.746372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6e001-3712-4071-9c25-868b06dbb68a admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:20.751986 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 810/1602] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:20.751986 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef607c-16e4-4d22-9081-79cb4f1b64b1 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:20.764449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef607c-16e4-4d22-9081-79cb4f1b64b1 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:20.767520 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6e001-3712-4071-9c25-868b06dbb68a admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:20.767692 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6189df5e-5fe9-4315-8fd9-2b62c70d9a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:20.768610 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189df5e-5fe9-4315-8fd9-2b62c70d9a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.768984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189df5e-5fe9-4315-8fd9-2b62c70d9a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.769338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6189df5e-5fe9-4315-8fd9-2b62c70d9a63 admin admin] PATH_INFO: `/v3/projects/8b153628177048a397b79d65addb4be5/users/fb4b22bc322c419bab3445f7dfb186fb/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.773857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb635e68-8d6f-4a87-aa9e-4c1c1764f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:20.774835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb635e68-8d6f-4a87-aa9e-4c1c1764f7dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.775194 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb635e68-8d6f-4a87-aa9e-4c1c1764f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.775730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb635e68-8d6f-4a87-aa9e-4c1c1764f7dd admin admin] PATH_INFO: `/v3/projects/3fe4ce072c504ca283f1168657dbff73/users/e8da794aec2f4d80a79e7c16a611f6f8/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.794434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb635e68-8d6f-4a87-aa9e-4c1c1764f7dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fe4ce072c504ca283f1168657dbff73, user_id=e8da794aec2f4d80a79e7c16a611f6f8, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:20.797156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb635e68-8d6f-4a87-aa9e-4c1c1764f7dd admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:20.799517 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189df5e-5fe9-4315-8fd9-2b62c70d9a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b153628177048a397b79d65addb4be5, user_id=fb4b22bc322c419bab3445f7dfb186fb, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:20.802219 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6189df5e-5fe9-4315-8fd9-2b62c70d9a63 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:20.953829 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 811/1603] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:20 2022] PUT /identity/v3/projects/8b153628177048a397b79d65addb4be5/users/fb4b22bc322c419bab3445f7dfb186fb/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:20.956735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a7d1c-1c65-45bc-ae49-115a603c518d None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:20.956735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a7d1c-1c65-45bc-ae49-115a603c518d None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:20.956735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a7d1c-1c65-45bc-ae49-115a603c518d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:20.963558 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 793/1604] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:20 2022] PUT /identity/v3/projects/3fe4ce072c504ca283f1168657dbff73/users/e8da794aec2f4d80a79e7c16a611f6f8/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:20.964389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb635e68-8d6f-4a87-aa9e-4c1c1764f7dd admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:20.974984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-c80a7d1c-1c65-45bc-ae49-115a603c518d None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:20.976238 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-c80a7d1c-1c65-45bc-ae49-115a603c518d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:21.042209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 812/1605] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:21.043257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a7d1c-1c65-45bc-ae49-115a603c518d None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:21.043480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb635e68-8d6f-4a87-aa9e-4c1c1764f7dd admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:21.052850 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e75a2b-9649-4b36-9eff-31f66082cb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:21.053908 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e75a2b-9649-4b36-9eff-31f66082cb9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:21.054297 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e75a2b-9649-4b36-9eff-31f66082cb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:21.054678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e75a2b-9649-4b36-9eff-31f66082cb9c admin admin] PATH_INFO: `/v3/projects/f38c88fd9df84a948ec755b5ecb36ebc/users/57f6be4191d847abb2eed6f04b8035ee/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:21.055468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a7d1c-1c65-45bc-ae49-115a603c518d None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:21.060673 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae115d6-f760-4d8e-a7f8-37a5cda01751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:21.062510 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae115d6-f760-4d8e-a7f8-37a5cda01751 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:21.062510 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae115d6-f760-4d8e-a7f8-37a5cda01751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:21.062510 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae115d6-f760-4d8e-a7f8-37a5cda01751 admin admin] PATH_INFO: `/v3/projects/ede66d1b4685482e9494d25ce007be99/users/3741ffa715ab41e39470458052c1d1a3/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:21.072712 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e75a2b-9649-4b36-9eff-31f66082cb9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f38c88fd9df84a948ec755b5ecb36ebc, user_id=57f6be4191d847abb2eed6f04b8035ee, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:21.076622 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e75a2b-9649-4b36-9eff-31f66082cb9c admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:21.078197 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae115d6-f760-4d8e-a7f8-37a5cda01751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede66d1b4685482e9494d25ce007be99, user_id=3741ffa715ab41e39470458052c1d1a3, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:21.080984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae115d6-f760-4d8e-a7f8-37a5cda01751 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:21.175797 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 794/1606] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:20 2022] PUT /identity/v3/projects/f38c88fd9df84a948ec755b5ecb36ebc/users/57f6be4191d847abb2eed6f04b8035ee/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:21.176656 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e75a2b-9649-4b36-9eff-31f66082cb9c admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:21.207237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 813/1607] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:21 2022] PUT /identity/v3/projects/ede66d1b4685482e9494d25ce007be99/users/3741ffa715ab41e39470458052c1d1a3/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:21.207535 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8b989-ec7d-4d6e-ba8c-372a611fa32a None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:21.207737 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8b989-ec7d-4d6e-ba8c-372a611fa32a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:21.208009 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8b989-ec7d-4d6e-ba8c-372a611fa32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:21.251609 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e75a2b-9649-4b36-9eff-31f66082cb9c admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:21.251808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-52f8b989-ec7d-4d6e-ba8c-372a611fa32a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:21.252911 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-52f8b989-ec7d-4d6e-ba8c-372a611fa32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:21.264547 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:21.311354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6604c-dada-43b8-bbd0-59a0b6de2f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:21.312273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6604c-dada-43b8-bbd0-59a0b6de2f25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:21.312556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6604c-dada-43b8-bbd0-59a0b6de2f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:21.312857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6604c-dada-43b8-bbd0-59a0b6de2f25 admin admin] PATH_INFO: `/v3/projects/2fcded6e9bad4991b001c44cfd5407cd/users/71ed167cf8454a2bb8c149b160a4ba3f/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:21.318207 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 814/1608] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:21.319504 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa6d41-22ea-477e-bd5c-1969445b5a10 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:21.319792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa6d41-22ea-477e-bd5c-1969445b5a10 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:21.320068 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa6d41-22ea-477e-bd5c-1969445b5a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:21.327214 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6604c-dada-43b8-bbd0-59a0b6de2f25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fcded6e9bad4991b001c44cfd5407cd, user_id=71ed167cf8454a2bb8c149b160a4ba3f, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:21.329933 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6604c-dada-43b8-bbd0-59a0b6de2f25 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:21.342492 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-8afa6d41-22ea-477e-bd5c-1969445b5a10 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:21.343685 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-8afa6d41-22ea-477e-bd5c-1969445b5a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:21.351969 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 815/1609] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:21.352729 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa6d41-22ea-477e-bd5c-1969445b5a10 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:21.406322 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:21.406322 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa6d41-22ea-477e-bd5c-1969445b5a10 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:21.410002 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edf07b-fc0e-41c2-bd97-d2c5b560f319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:21.411719 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf07b-fc0e-41c2-bd97-d2c5b560f319 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:21.412002 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf07b-fc0e-41c2-bd97-d2c5b560f319 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:21.412279 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf07b-fc0e-41c2-bd97-d2c5b560f319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:21.421413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edf07b-fc0e-41c2-bd97-d2c5b560f319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:21.422871 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edf07b-fc0e-41c2-bd97-d2c5b560f319 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:21.432587 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 816/1610] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:21.433688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd03359-4fae-4cea-84cd-c81a687a7900 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:21.434078 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd03359-4fae-4cea-84cd-c81a687a7900 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:21.441391 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd03359-4fae-4cea-84cd-c81a687a7900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:21.446412 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 795/1611] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:21 2022] PUT /identity/v3/projects/2fcded6e9bad4991b001c44cfd5407cd/users/71ed167cf8454a2bb8c149b160a4ba3f/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:21.447534 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac24519-9220-41b7-b9b3-9fd3a10a6e68 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:21.450253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac24519-9220-41b7-b9b3-9fd3a10a6e68 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:21.450637 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac24519-9220-41b7-b9b3-9fd3a10a6e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:21.473722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-cbd03359-4fae-4cea-84cd-c81a687a7900 None None] MFA Rules not processed for user `57f6be4191d847abb2eed6f04b8035ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:21.475567 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-cbd03359-4fae-4cea-84cd-c81a687a7900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:21.485563 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-0ac24519-9220-41b7-b9b3-9fd3a10a6e68 None None] MFA Rules not processed for user `3741ffa715ab41e39470458052c1d1a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:21.487180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-0ac24519-9220-41b7-b9b3-9fd3a10a6e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:21.562635 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 817/1612] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:21.563496 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd03359-4fae-4cea-84cd-c81a687a7900 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:21.604000 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 796/1613] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:21.605006 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac24519-9220-41b7-b9b3-9fd3a10a6e68 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:21.670172 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd03359-4fae-4cea-84cd-c81a687a7900 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:21.680942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05def2f-b81a-40aa-a704-c694e75c0f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:21.681852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05def2f-b81a-40aa-a704-c694e75c0f06 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:21.682290 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05def2f-b81a-40aa-a704-c694e75c0f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:21.682828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05def2f-b81a-40aa-a704-c694e75c0f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:21.702324 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac24519-9220-41b7-b9b3-9fd3a10a6e68 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:21.707744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c9337-1a60-4796-a204-d5da4687780e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:21.708540 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c9337-1a60-4796-a204-d5da4687780e service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:21.709112 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c9337-1a60-4796-a204-d5da4687780e service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:21.709488 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8c9337-1a60-4796-a204-d5da4687780e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:21.757949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05def2f-b81a-40aa-a704-c694e75c0f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:21.759437 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05def2f-b81a-40aa-a704-c694e75c0f06 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:21.770854 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:21.772157 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 818/1614] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:21.773492 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12514729-3807-4049-943a-9da577d6577e None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:21.773827 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12514729-3807-4049-943a-9da577d6577e None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:21.774095 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12514729-3807-4049-943a-9da577d6577e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:21.810263 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c9337-1a60-4796-a204-d5da4687780e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:21.810438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-12514729-3807-4049-943a-9da577d6577e None None] MFA Rules not processed for user `71ed167cf8454a2bb8c149b160a4ba3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:21.811667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-12514729-3807-4049-943a-9da577d6577e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:21.811804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8c9337-1a60-4796-a204-d5da4687780e service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:21.823210 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 797/1615] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:21.824216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c9337-1a60-4796-a204-d5da4687780e service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:21.831868 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:21.834491 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8c9337-1a60-4796-a204-d5da4687780e service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:21.848771 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e75e5-2496-44a6-b344-2caafaaf9fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:21.850039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e75e5-2496-44a6-b344-2caafaaf9fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:21.850466 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e75e5-2496-44a6-b344-2caafaaf9fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:21.850861 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e75e5-2496-44a6-b344-2caafaaf9fb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:21.851621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e75e5-2496-44a6-b344-2caafaaf9fb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:21.854298 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e75e5-2496-44a6-b344-2caafaaf9fb9 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:21.915129 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 819/1616] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:21 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:21.918347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c7e36-3cea-4c7b-bd4f-46ba65b82686 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:21.918735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c7e36-3cea-4c7b-bd4f-46ba65b82686 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:21.919521 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c7e36-3cea-4c7b-bd4f-46ba65b82686 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:21.928926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 820/1617] 10.222.0.57 () {54 vars in 962 bytes} [Thu Jul 21 08:37:21 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:37:21.929855 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c7e36-3cea-4c7b-bd4f-46ba65b82686 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:21.949731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c7e36-3cea-4c7b-bd4f-46ba65b82686 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:21.959495 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee17b4-b438-488b-860b-954310d68a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:21.960427 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee17b4-b438-488b-860b-954310d68a8e admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:21.960890 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee17b4-b438-488b-860b-954310d68a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:21.961441 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee17b4-b438-488b-860b-954310d68a8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:21.962852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee17b4-b438-488b-860b-954310d68a8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:21.965775 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee17b4-b438-488b-860b-954310d68a8e admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:21.994734 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 798/1618] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:21 2022] POST /identity/v3/projects => generated 365 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:21.996432 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b9b01-55c5-42bf-acc4-73e34ae281a9 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:21.996731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b9b01-55c5-42bf-acc4-73e34ae281a9 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:21.997018 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b9b01-55c5-42bf-acc4-73e34ae281a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:22.088914 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-506b9b01-55c5-42bf-acc4-73e34ae281a9 None None] MFA Rules not processed for user `b6670a010c034f7999c9445452c02473`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:22.089573 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 821/1619] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:21 2022] POST /identity/v3/projects => generated 405 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:22.089999 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee17b4-b438-488b-860b-954310d68a8e admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:22.090443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-506b9b01-55c5-42bf-acc4-73e34ae281a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:22.191777 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee17b4-b438-488b-860b-954310d68a8e admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:22.200861 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ff46d-8a39-43fc-94c2-4c21906f4da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:22.205438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 799/1620] 10.222.0.57 () {58 vars in 1059 bytes} [Thu Jul 21 08:37:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:22.205592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ff46d-8a39-43fc-94c2-4c21906f4da7 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:22.205592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ff46d-8a39-43fc-94c2-4c21906f4da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:22.205592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ff46d-8a39-43fc-94c2-4c21906f4da7 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:22.205592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ff46d-8a39-43fc-94c2-4c21906f4da7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:22.209313 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ff46d-8a39-43fc-94c2-4c21906f4da7 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:22.211644 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b9b01-55c5-42bf-acc4-73e34ae281a9 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:22.222280 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b9b01-55c5-42bf-acc4-73e34ae281a9 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:22.236469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9e77c-d50b-437d-ac38-a5035a130041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:22.236469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9e77c-d50b-437d-ac38-a5035a130041 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:22.236469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9e77c-d50b-437d-ac38-a5035a130041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:22.236469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9e77c-d50b-437d-ac38-a5035a130041 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:22.237040 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9e77c-d50b-437d-ac38-a5035a130041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:22.237040 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9e77c-d50b-437d-ac38-a5035a130041 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:22.355371 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 822/1621] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:22 2022] POST /identity/v3/users => generated 289 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:22.356350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ff46d-8a39-43fc-94c2-4c21906f4da7 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:22.366996 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 800/1622] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:22 2022] POST /identity/v3/users => generated 309 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:22.370108 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9e77c-d50b-437d-ac38-a5035a130041 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:22.386017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9e77c-d50b-437d-ac38-a5035a130041 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:22.390729 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276071f-0f2e-4f9c-ac20-6562487c8dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:22.391714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276071f-0f2e-4f9c-ac20-6562487c8dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:22.392186 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276071f-0f2e-4f9c-ac20-6562487c8dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:22.392310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ff46d-8a39-43fc-94c2-4c21906f4da7 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:22.392748 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276071f-0f2e-4f9c-ac20-6562487c8dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:22.393721 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276071f-0f2e-4f9c-ac20-6562487c8dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:22.396137 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276071f-0f2e-4f9c-ac20-6562487c8dd9 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:22.400575 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f4770-3f8e-45d3-b0e6-6d45ed5a25c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:22.401452 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f4770-3f8e-45d3-b0e6-6d45ed5a25c7 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:22.401856 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f4770-3f8e-45d3-b0e6-6d45ed5a25c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:22.402402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f4770-3f8e-45d3-b0e6-6d45ed5a25c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:22.412346 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 801/1623] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:22.414076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276071f-0f2e-4f9c-ac20-6562487c8dd9 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:22.428618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276071f-0f2e-4f9c-ac20-6562487c8dd9 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:22.435609 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc249b10-9478-4eb0-bc4e-c2e9549b95a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:22.442994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc249b10-9478-4eb0-bc4e-c2e9549b95a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:22.442994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc249b10-9478-4eb0-bc4e-c2e9549b95a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:22.442994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc249b10-9478-4eb0-bc4e-c2e9549b95a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:22.442994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc249b10-9478-4eb0-bc4e-c2e9549b95a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:22.442994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc249b10-9478-4eb0-bc4e-c2e9549b95a6 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:22.456265 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 802/1624] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:22.457941 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc249b10-9478-4eb0-bc4e-c2e9549b95a6 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:22.474072 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc249b10-9478-4eb0-bc4e-c2e9549b95a6 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:22.481423 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765645e-f7b0-4e92-a277-23b455fc455e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:22.482946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765645e-f7b0-4e92-a277-23b455fc455e admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:22.483489 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765645e-f7b0-4e92-a277-23b455fc455e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:22.484029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765645e-f7b0-4e92-a277-23b455fc455e admin admin] PATH_INFO: `/v3/projects/efd0e82a36ef4973993d4b602b7dcb8a/users/8b9712a20dee41f189fc26f8ed21dd1f/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:22.500811 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765645e-f7b0-4e92-a277-23b455fc455e admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd0e82a36ef4973993d4b602b7dcb8a, user_id=8b9712a20dee41f189fc26f8ed21dd1f, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:22.503514 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765645e-f7b0-4e92-a277-23b455fc455e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:22.512419 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f4770-3f8e-45d3-b0e6-6d45ed5a25c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:22.515064 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f4770-3f8e-45d3-b0e6-6d45ed5a25c7 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:22.529878 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 823/1625] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:22.531313 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f4770-3f8e-45d3-b0e6-6d45ed5a25c7 service nova] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:22.549988 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f4770-3f8e-45d3-b0e6-6d45ed5a25c7 service nova] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:22.557396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b68171-081b-40a3-a6b4-e4f9a2d613a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:22.558490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b68171-081b-40a3-a6b4-e4f9a2d613a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:22.558974 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b68171-081b-40a3-a6b4-e4f9a2d613a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:22.559354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b68171-081b-40a3-a6b4-e4f9a2d613a9 admin admin] PATH_INFO: `/v3/projects/649223240c944b1092491ec5571b3ed9/users/5fa7ae1a800042f894c2e1394666f60b/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:22.582986 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b68171-081b-40a3-a6b4-e4f9a2d613a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=649223240c944b1092491ec5571b3ed9, user_id=5fa7ae1a800042f894c2e1394666f60b, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:22.599552 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b68171-081b-40a3-a6b4-e4f9a2d613a9 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:22.622925 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 803/1626] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:22 2022] PUT /identity/v3/projects/efd0e82a36ef4973993d4b602b7dcb8a/users/8b9712a20dee41f189fc26f8ed21dd1f/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:22.626892 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765645e-f7b0-4e92-a277-23b455fc455e admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:22.723883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765645e-f7b0-4e92-a277-23b455fc455e admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:22.729639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1ecf3-9f6c-4409-ae76-5171be9d69f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:22.730341 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1ecf3-9f6c-4409-ae76-5171be9d69f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:22.730682 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1ecf3-9f6c-4409-ae76-5171be9d69f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:22.730971 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1ecf3-9f6c-4409-ae76-5171be9d69f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:22.732525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1ecf3-9f6c-4409-ae76-5171be9d69f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:22.734974 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1ecf3-9f6c-4409-ae76-5171be9d69f8 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:22.741257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:22.748620 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 824/1627] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:22 2022] PUT /identity/v3/projects/649223240c944b1092491ec5571b3ed9/users/5fa7ae1a800042f894c2e1394666f60b/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:22.758438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b68171-081b-40a3-a6b4-e4f9a2d613a9 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:22.761492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 804/1628] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:22.765644 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1ecf3-9f6c-4409-ae76-5171be9d69f8 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:22.794593 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1ecf3-9f6c-4409-ae76-5171be9d69f8 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:22.886666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b68171-081b-40a3-a6b4-e4f9a2d613a9 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:22.892290 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5868070-aa5e-4b87-9ce6-dbcac6416f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:22.893120 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5868070-aa5e-4b87-9ce6-dbcac6416f06 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:22.901311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5868070-aa5e-4b87-9ce6-dbcac6416f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:22.906706 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5868070-aa5e-4b87-9ce6-dbcac6416f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:22.909269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5868070-aa5e-4b87-9ce6-dbcac6416f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:22.913899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5868070-aa5e-4b87-9ce6-dbcac6416f06 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:22.927504 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:22.929469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf262e7e-db0e-4af8-9292-b06fab61901a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:22.931096 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf262e7e-db0e-4af8-9292-b06fab61901a admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:22.932130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf262e7e-db0e-4af8-9292-b06fab61901a admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:22.932130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf262e7e-db0e-4af8-9292-b06fab61901a admin admin] PATH_INFO: `/v3/projects/efd0e82a36ef4973993d4b602b7dcb8a/users/8b9712a20dee41f189fc26f8ed21dd1f/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:22.934642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf262e7e-db0e-4af8-9292-b06fab61901a admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd0e82a36ef4973993d4b602b7dcb8a, user_id=8b9712a20dee41f189fc26f8ed21dd1f, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:22.938602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf262e7e-db0e-4af8-9292-b06fab61901a admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:22.938805 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 825/1629] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:22.940459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cf322-c6b5-412d-a80a-4375c80c8e8b None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:22.942613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cf322-c6b5-412d-a80a-4375c80c8e8b None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:22.943396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cf322-c6b5-412d-a80a-4375c80c8e8b None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:22.946494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 826/1630] 10.222.0.57 () {54 vars in 912 bytes} [Thu Jul 21 08:37:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:37:22.948634 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cf322-c6b5-412d-a80a-4375c80c8e8b None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:22.976900 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 805/1631] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:22 2022] PUT /identity/v3/projects/efd0e82a36ef4973993d4b602b7dcb8a/users/8b9712a20dee41f189fc26f8ed21dd1f/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:22.986979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331281b5-85ed-48ee-8f93-cb19e3ec789b None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:22.986979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331281b5-85ed-48ee-8f93-cb19e3ec789b None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:22.986979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331281b5-85ed-48ee-8f93-cb19e3ec789b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:23.013551 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-331281b5-85ed-48ee-8f93-cb19e3ec789b None None] MFA Rules not processed for user `b6670a010c034f7999c9445452c02473`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:23.014816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-331281b5-85ed-48ee-8f93-cb19e3ec789b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:23.101200 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 806/1632] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 08:37:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:23.102623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186ba14-349e-4e3d-bb81-25158597721d None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:23.102917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186ba14-349e-4e3d-bb81-25158597721d None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:23.103230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186ba14-349e-4e3d-bb81-25158597721d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:23.123903 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cf322-c6b5-412d-a80a-4375c80c8e8b None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:23.135378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-c186ba14-349e-4e3d-bb81-25158597721d None None] MFA Rules not processed for user `8b9712a20dee41f189fc26f8ed21dd1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:23.136610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c186ba14-349e-4e3d-bb81-25158597721d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:23.138703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea1499-86c7-436c-a968-38f861341075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:23.140125 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea1499-86c7-436c-a968-38f861341075 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:23.140672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea1499-86c7-436c-a968-38f861341075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:23.141067 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea1499-86c7-436c-a968-38f861341075 admin admin] PATH_INFO: `/v3/projects/649223240c944b1092491ec5571b3ed9/users/5fa7ae1a800042f894c2e1394666f60b/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:23.145216 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea1499-86c7-436c-a968-38f861341075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=649223240c944b1092491ec5571b3ed9, user_id=5fa7ae1a800042f894c2e1394666f60b, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:23.148968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bea1499-86c7-436c-a968-38f861341075 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:23.163926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 827/1633] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:22 2022] PUT /identity/v3/projects/649223240c944b1092491ec5571b3ed9/users/5fa7ae1a800042f894c2e1394666f60b/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:23.165166 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea1499-86c7-436c-a968-38f861341075 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:23.260964 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 807/1634] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:23 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:23.261176 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea1499-86c7-436c-a968-38f861341075 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:23.261278 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c29ba6-afaa-4633-a7a8-9907b4c4fd4f None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:23.261278 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c29ba6-afaa-4633-a7a8-9907b4c4fd4f None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:23.263810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c29ba6-afaa-4633-a7a8-9907b4c4fd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:23.273224 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75d78e-2e56-4ec7-af95-687b42246981 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:23.274198 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75d78e-2e56-4ec7-af95-687b42246981 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:23.274490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75d78e-2e56-4ec7-af95-687b42246981 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:23.274773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75d78e-2e56-4ec7-af95-687b42246981 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:23.334246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-a4c29ba6-afaa-4633-a7a8-9907b4c4fd4f None None] MFA Rules not processed for user `5fa7ae1a800042f894c2e1394666f60b`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:23.336214 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a4c29ba6-afaa-4633-a7a8-9907b4c4fd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:23.465767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75d78e-2e56-4ec7-af95-687b42246981 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:23.468617 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75d78e-2e56-4ec7-af95-687b42246981 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:23.499014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 828/1635] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:23.500181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75d78e-2e56-4ec7-af95-687b42246981 service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:23.514274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 808/1636] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:23 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:23.516598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75d78e-2e56-4ec7-af95-687b42246981 service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:23.521432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5282bd6-d7de-4ac3-9738-df4bc9d3c13f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:23.522259 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5282bd6-d7de-4ac3-9738-df4bc9d3c13f service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:23.522553 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5282bd6-d7de-4ac3-9738-df4bc9d3c13f service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:23.522833 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5282bd6-d7de-4ac3-9738-df4bc9d3c13f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:23.744383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5282bd6-d7de-4ac3-9738-df4bc9d3c13f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:23.744383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5282bd6-d7de-4ac3-9738-df4bc9d3c13f service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:23.744383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 829/1637] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:23 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:23.958177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c29ba6-afaa-4633-a7a8-9907b4c4fd4f None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:23.971025 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c29ba6-afaa-4633-a7a8-9907b4c4fd4f None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:23.984024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eccd4a-5e1a-4722-a4e4-e7f2e6db5bcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:23.984692 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eccd4a-5e1a-4722-a4e4-e7f2e6db5bcc service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:23.985059 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eccd4a-5e1a-4722-a4e4-e7f2e6db5bcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:23.985352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eccd4a-5e1a-4722-a4e4-e7f2e6db5bcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:24.008470 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eccd4a-5e1a-4722-a4e4-e7f2e6db5bcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:24.011154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eccd4a-5e1a-4722-a4e4-e7f2e6db5bcc service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:24.045225 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 809/1638] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:23 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:24.084475 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:24.206500 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbf975-adea-4313-99ee-0b57a67d1ced None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:24.208737 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbf975-adea-4313-99ee-0b57a67d1ced None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:24.209251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbf975-adea-4313-99ee-0b57a67d1ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:24.287464 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-e6bbf975-adea-4313-99ee-0b57a67d1ced None None] MFA Rules not processed for user `6060b292e6a941839c8e8bc608662394`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:24.289958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e6bbf975-adea-4313-99ee-0b57a67d1ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:24.398918 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:24.449705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 830/1639] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:24.450940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eccd4a-5e1a-4722-a4e4-e7f2e6db5bcc service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:24.573705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbf975-adea-4313-99ee-0b57a67d1ced None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:24.594774 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eccd4a-5e1a-4722-a4e4-e7f2e6db5bcc service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:24.601044 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fea687-121e-4b2c-8874-0db2330a0c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:24.602044 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fea687-121e-4b2c-8874-0db2330a0c57 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:24.602672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fea687-121e-4b2c-8874-0db2330a0c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:24.602786 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fea687-121e-4b2c-8874-0db2330a0c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:24.604398 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fea687-121e-4b2c-8874-0db2330a0c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:24.606888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fea687-121e-4b2c-8874-0db2330a0c57 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:24.706930 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbf975-adea-4313-99ee-0b57a67d1ced None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:24.715354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a965ef0-c82d-40e2-a826-80d5c118258f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:24.716392 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a965ef0-c82d-40e2-a826-80d5c118258f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:24.716904 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a965ef0-c82d-40e2-a826-80d5c118258f admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:24.717263 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a965ef0-c82d-40e2-a826-80d5c118258f admin admin] PATH_INFO: `/v3/users/71ed167cf8454a2bb8c149b160a4ba3f` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:24.722452 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a965ef0-c82d-40e2-a826-80d5c118258f admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ed167cf8454a2bb8c149b160a4ba3f)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:24.727359 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: WARNING py.warnings [None req-5a965ef0-c82d-40e2-a826-80d5c118258f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:37:24.727359 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: warnings.warn(msg) Jul 21 08:37:24.727359 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: Jul 21 08:37:24.732595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a965ef0-c82d-40e2-a826-80d5c118258f admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:25.063792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 810/1640] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:24 2022] POST /identity/v3/projects => generated 403 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:25.063792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fea687-121e-4b2c-8874-0db2330a0c57 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:25.063792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fea687-121e-4b2c-8874-0db2330a0c57 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:25.063792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de72cd-ccc9-4d2b-9476-0f63aef0762d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:25.091260 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de72cd-ccc9-4d2b-9476-0f63aef0762d admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:25.091260 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de72cd-ccc9-4d2b-9476-0f63aef0762d admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:25.091260 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de72cd-ccc9-4d2b-9476-0f63aef0762d admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:25.091260 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de72cd-ccc9-4d2b-9476-0f63aef0762d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:25.091260 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de72cd-ccc9-4d2b-9476-0f63aef0762d admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:25.168822 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 811/1641] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:24 2022] POST /identity/v3/users => generated 308 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:25.176506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de72cd-ccc9-4d2b-9476-0f63aef0762d admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:25.188856 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5a965ef0-c82d-40e2-a826-80d5c118258f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ed167cf8454a2bb8c149b160a4ba3f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:25.206590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de72cd-ccc9-4d2b-9476-0f63aef0762d admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:25.226203 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cd66a-918c-451c-b066-e83c496fa54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:25.226950 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cd66a-918c-451c-b066-e83c496fa54e admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:25.227238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cd66a-918c-451c-b066-e83c496fa54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:25.227518 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cd66a-918c-451c-b066-e83c496fa54e admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:25.230609 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cd66a-918c-451c-b066-e83c496fa54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:25.235240 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cd66a-918c-451c-b066-e83c496fa54e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:25.242639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5a965ef0-c82d-40e2-a826-80d5c118258f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ed167cf8454a2bb8c149b160a4ba3f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:25.267461 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 812/1642] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:25.276035 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5a965ef0-c82d-40e2-a826-80d5c118258f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ed167cf8454a2bb8c149b160a4ba3f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:25.278776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5a965ef0-c82d-40e2-a826-80d5c118258f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ed167cf8454a2bb8c149b160a4ba3f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:25.279575 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5a965ef0-c82d-40e2-a826-80d5c118258f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ed167cf8454a2bb8c149b160a4ba3f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:25.281795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cd66a-918c-451c-b066-e83c496fa54e admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:25.300094 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-fb6cd66a-918c-451c-b066-e83c496fa54e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:25.361322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cd66a-918c-451c-b066-e83c496fa54e admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:25.376332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8c51d-57d4-4e64-a0d7-a039d907e886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:25.377463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8c51d-57d4-4e64-a0d7-a039d907e886 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:25.380773 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8c51d-57d4-4e64-a0d7-a039d907e886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:25.381341 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8c51d-57d4-4e64-a0d7-a039d907e886 admin admin] PATH_INFO: `/v3/projects/a2f7f7934f1e4e28abdd5b52339eecb8/users/b580fccab33d4b899afc3e1b547bf8bd/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:25.411969 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8c51d-57d4-4e64-a0d7-a039d907e886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f7f7934f1e4e28abdd5b52339eecb8, user_id=b580fccab33d4b899afc3e1b547bf8bd, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:25.419904 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 831/1643] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:37:24 2022] DELETE /identity/v3/users/71ed167cf8454a2bb8c149b160a4ba3f => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:25.420117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8c51d-57d4-4e64-a0d7-a039d907e886 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:25.422514 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195716e-cdfd-4fc6-b9fc-542a7b9e8883 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:25.422988 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195716e-cdfd-4fc6-b9fc-542a7b9e8883 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:25.423980 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195716e-cdfd-4fc6-b9fc-542a7b9e8883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:25.472023 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-5195716e-cdfd-4fc6-b9fc-542a7b9e8883 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:25.473558 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5195716e-cdfd-4fc6-b9fc-542a7b9e8883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:25.521442 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 813/1644] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:25 2022] PUT /identity/v3/projects/a2f7f7934f1e4e28abdd5b52339eecb8/users/b580fccab33d4b899afc3e1b547bf8bd/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:25.522672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8c51d-57d4-4e64-a0d7-a039d907e886 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:25.621424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 832/1645] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:37:25.644649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195716e-cdfd-4fc6-b9fc-542a7b9e8883 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:25.650508 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5195716e-cdfd-4fc6-b9fc-542a7b9e8883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:25.788245 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195716e-cdfd-4fc6-b9fc-542a7b9e8883 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:25.798250 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8c51d-57d4-4e64-a0d7-a039d907e886 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:25.819406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ef021-67fc-4619-947e-5f2abce5931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:25.841623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ef021-67fc-4619-947e-5f2abce5931f admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:25.841623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ef021-67fc-4619-947e-5f2abce5931f admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:25.841623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ef021-67fc-4619-947e-5f2abce5931f admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:25.841623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ef021-67fc-4619-947e-5f2abce5931f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:25.841623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ef021-67fc-4619-947e-5f2abce5931f admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:25.862643 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 814/1646] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:25.863813 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ef021-67fc-4619-947e-5f2abce5931f admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:25.891592 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ef021-67fc-4619-947e-5f2abce5931f admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:25.902125 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd78df-cca5-4305-966d-7d9edb26e59b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:25.902792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd78df-cca5-4305-966d-7d9edb26e59b service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:25.903071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd78df-cca5-4305-966d-7d9edb26e59b service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:25.903342 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd78df-cca5-4305-966d-7d9edb26e59b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:25.910005 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2478b8c0-ab8a-4d1d-8487-593d01b62ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:25.911473 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478b8c0-ab8a-4d1d-8487-593d01b62ee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:25.911753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478b8c0-ab8a-4d1d-8487-593d01b62ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:25.912029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2478b8c0-ab8a-4d1d-8487-593d01b62ee9 admin admin] PATH_INFO: `/v3/projects/a2f7f7934f1e4e28abdd5b52339eecb8/users/b580fccab33d4b899afc3e1b547bf8bd/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:25.915292 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd78df-cca5-4305-966d-7d9edb26e59b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:25.915507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478b8c0-ab8a-4d1d-8487-593d01b62ee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f7f7934f1e4e28abdd5b52339eecb8, user_id=b580fccab33d4b899afc3e1b547bf8bd, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:25.916804 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd78df-cca5-4305-966d-7d9edb26e59b service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:25.918214 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2478b8c0-ab8a-4d1d-8487-593d01b62ee9 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:25.930500 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 833/1647] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:25.942998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 815/1648] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:25 2022] PUT /identity/v3/projects/a2f7f7934f1e4e28abdd5b52339eecb8/users/b580fccab33d4b899afc3e1b547bf8bd/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:25.993436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:26.046389 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223acf0-a690-4957-b7c4-41a03040bf5b None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:26.047279 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223acf0-a690-4957-b7c4-41a03040bf5b None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:26.047813 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223acf0-a690-4957-b7c4-41a03040bf5b None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:26.050134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 834/1649] 10.222.0.57 () {54 vars in 962 bytes} [Thu Jul 21 08:37:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:37:26.060790 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d9a44-443d-4b32-924e-6cad831ecc1e None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:26.061879 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d9a44-443d-4b32-924e-6cad831ecc1e None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:26.062591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d9a44-443d-4b32-924e-6cad831ecc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:26.107261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-614d9a44-443d-4b32-924e-6cad831ecc1e None None] MFA Rules not processed for user `b6670a010c034f7999c9445452c02473`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:26.109057 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-614d9a44-443d-4b32-924e-6cad831ecc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:26.245537 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223acf0-a690-4957-b7c4-41a03040bf5b None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:26.247497 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-6223acf0-a690-4957-b7c4-41a03040bf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:26.299099 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 816/1650] 10.222.0.57 () {58 vars in 1059 bytes} [Thu Jul 21 08:37:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:26.301958 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:26.307161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4eda7-9249-4e3d-9594-0b6b1a8586aa None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:26.310404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4eda7-9249-4e3d-9594-0b6b1a8586aa None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:26.310404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4eda7-9249-4e3d-9594-0b6b1a8586aa None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:26.310404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 817/1651] 10.222.0.57 () {54 vars in 912 bytes} [Thu Jul 21 08:37:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:37:26.318055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4231623-848f-4c67-b4ba-538b9abdea4a None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:26.319071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4231623-848f-4c67-b4ba-538b9abdea4a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:26.319565 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4231623-848f-4c67-b4ba-538b9abdea4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:26.347372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-c4231623-848f-4c67-b4ba-538b9abdea4a None None] MFA Rules not processed for user `b6670a010c034f7999c9445452c02473`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:26.349299 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c4231623-848f-4c67-b4ba-538b9abdea4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:26.373111 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 818/1652] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 08:37:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:37:26.388964 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4231623-848f-4c67-b4ba-538b9abdea4a None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:26.390909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c4231623-848f-4c67-b4ba-538b9abdea4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:26.391417 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223acf0-a690-4957-b7c4-41a03040bf5b None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:26.397222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7c860-a6a2-4ccd-97d9-a25efab36ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:26.398385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7c860-a6a2-4ccd-97d9-a25efab36ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:26.398682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7c860-a6a2-4ccd-97d9-a25efab36ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:26.398956 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7c860-a6a2-4ccd-97d9-a25efab36ab7 admin admin] PATH_INFO: `/v3/users/57f6be4191d847abb2eed6f04b8035ee` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:26.400295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7c860-a6a2-4ccd-97d9-a25efab36ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57f6be4191d847abb2eed6f04b8035ee)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:26.402830 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7c860-a6a2-4ccd-97d9-a25efab36ab7 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:26.502543 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4231623-848f-4c67-b4ba-538b9abdea4a None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:26.524680 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad80b4-70fa-4077-9699-c7b834868989 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:26.528698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad80b4-70fa-4077-9699-c7b834868989 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:26.528698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad80b4-70fa-4077-9699-c7b834868989 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:26.528698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad80b4-70fa-4077-9699-c7b834868989 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:26.568896 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad80b4-70fa-4077-9699-c7b834868989 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:26.572559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad80b4-70fa-4077-9699-c7b834868989 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:26.602056 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 819/1653] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:37:26.683415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-79a7c860-a6a2-4ccd-97d9-a25efab36ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57f6be4191d847abb2eed6f04b8035ee'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:26.735010 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-79a7c860-a6a2-4ccd-97d9-a25efab36ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57f6be4191d847abb2eed6f04b8035ee'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:26.753356 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:26.764565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-79a7c860-a6a2-4ccd-97d9-a25efab36ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57f6be4191d847abb2eed6f04b8035ee'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:26.764565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-79a7c860-a6a2-4ccd-97d9-a25efab36ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57f6be4191d847abb2eed6f04b8035ee'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:26.764565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-79a7c860-a6a2-4ccd-97d9-a25efab36ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57f6be4191d847abb2eed6f04b8035ee'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:26.909934 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 835/1654] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:37:26 2022] DELETE /identity/v3/users/57f6be4191d847abb2eed6f04b8035ee => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:26.915208 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c2a18-4a37-451b-bf8d-e01fc0d3b93d None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:26.915500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c2a18-4a37-451b-bf8d-e01fc0d3b93d None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:26.915775 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c2a18-4a37-451b-bf8d-e01fc0d3b93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:26.952802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-e42c2a18-4a37-451b-bf8d-e01fc0d3b93d None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:26.954076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e42c2a18-4a37-451b-bf8d-e01fc0d3b93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:27.112910 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 820/1655] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:27.157153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7c860-a6a2-4ccd-97d9-a25efab36ab7 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:27.161964 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-79a7c860-a6a2-4ccd-97d9-a25efab36ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:27.172690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c2a18-4a37-451b-bf8d-e01fc0d3b93d None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:27.174285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e42c2a18-4a37-451b-bf8d-e01fc0d3b93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:27.195245 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c2a18-4a37-451b-bf8d-e01fc0d3b93d None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:27.210191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5eafb-6e8d-41b2-a66a-d0f2466519bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:27.211523 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5eafb-6e8d-41b2-a66a-d0f2466519bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:27.212038 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5eafb-6e8d-41b2-a66a-d0f2466519bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:27.212605 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5eafb-6e8d-41b2-a66a-d0f2466519bf admin admin] PATH_INFO: `/v3/projects/2fcded6e9bad4991b001c44cfd5407cd` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:27.216240 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5eafb-6e8d-41b2-a66a-d0f2466519bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fcded6e9bad4991b001c44cfd5407cd)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:27.218123 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: WARNING py.warnings [None req-f3b5eafb-6e8d-41b2-a66a-d0f2466519bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 08:37:27.218123 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: warnings.warn(msg) Jul 21 08:37:27.218123 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: Jul 21 08:37:27.219335 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b5eafb-6e8d-41b2-a66a-d0f2466519bf admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:27.313878 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7c860-a6a2-4ccd-97d9-a25efab36ab7 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:27.325870 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20307f-af85-43b7-b28d-503fbe16b921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:27.326807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20307f-af85-43b7-b28d-503fbe16b921 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:27.327246 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20307f-af85-43b7-b28d-503fbe16b921 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:27.328356 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20307f-af85-43b7-b28d-503fbe16b921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:27.352750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20307f-af85-43b7-b28d-503fbe16b921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:27.355895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20307f-af85-43b7-b28d-503fbe16b921 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:27.391869 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 836/1656] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:27.430330 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f3b5eafb-6e8d-41b2-a66a-d0f2466519bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fcded6e9bad4991b001c44cfd5407cd', 'request_id': 'req-f3b5eafb-6e8d-41b2-a66a-d0f2466519bf'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:27.446509 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f3b5eafb-6e8d-41b2-a66a-d0f2466519bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fcded6e9bad4991b001c44cfd5407cd', 'request_id': 'req-f3b5eafb-6e8d-41b2-a66a-d0f2466519bf'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:27.570140 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f3b5eafb-6e8d-41b2-a66a-d0f2466519bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fcded6e9bad4991b001c44cfd5407cd', 'request_id': 'req-f3b5eafb-6e8d-41b2-a66a-d0f2466519bf'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:27.602889 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f3b5eafb-6e8d-41b2-a66a-d0f2466519bf admin admin] The token cache is being invalidate because project 2fcded6e9bad4991b001c44cfd5407cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:37:27.603197 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f3b5eafb-6e8d-41b2-a66a-d0f2466519bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:27.606040 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f3b5eafb-6e8d-41b2-a66a-d0f2466519bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:27.615453 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 821/1657] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:37:27 2022] DELETE /identity/v3/projects/2fcded6e9bad4991b001c44cfd5407cd => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:37:27.616598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20307f-af85-43b7-b28d-503fbe16b921 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:27.633205 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20307f-af85-43b7-b28d-503fbe16b921 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:27.735534 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ecf7b-e70b-44e5-ace0-41e69e173d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:27.737671 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ecf7b-e70b-44e5-ace0-41e69e173d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:27.739071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ecf7b-e70b-44e5-ace0-41e69e173d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:27.749435 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ecf7b-e70b-44e5-ace0-41e69e173d1c admin admin] PATH_INFO: `/v3/users/5fa7ae1a800042f894c2e1394666f60b` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:27.759084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ecf7b-e70b-44e5-ace0-41e69e173d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fa7ae1a800042f894c2e1394666f60b)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:27.763851 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ecf7b-e70b-44e5-ace0-41e69e173d1c admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:27.924337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:28.100130 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3b8ecf7b-e70b-44e5-ace0-41e69e173d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fa7ae1a800042f894c2e1394666f60b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:28.139288 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3b8ecf7b-e70b-44e5-ace0-41e69e173d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fa7ae1a800042f894c2e1394666f60b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:28.186247 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3b8ecf7b-e70b-44e5-ace0-41e69e173d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fa7ae1a800042f894c2e1394666f60b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:28.186247 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3b8ecf7b-e70b-44e5-ace0-41e69e173d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fa7ae1a800042f894c2e1394666f60b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:28.186247 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3b8ecf7b-e70b-44e5-ace0-41e69e173d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fa7ae1a800042f894c2e1394666f60b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:28.324613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 837/1658] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:37:27 2022] DELETE /identity/v3/users/5fa7ae1a800042f894c2e1394666f60b => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:29.135760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:29.648565 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5eafb-6e8d-41b2-a66a-d0f2466519bf admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:29.653610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f3b5eafb-6e8d-41b2-a66a-d0f2466519bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:29.663666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ecf7b-e70b-44e5-ace0-41e69e173d1c admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:29.665123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-3b8ecf7b-e70b-44e5-ace0-41e69e173d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:29.695066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5eafb-6e8d-41b2-a66a-d0f2466519bf admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:29.761495 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:29.848512 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ecf7b-e70b-44e5-ace0-41e69e173d1c admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:29.862723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43325877-24d7-496f-a90f-d5f97fbbd555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:29.863753 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43325877-24d7-496f-a90f-d5f97fbbd555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:29.864211 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43325877-24d7-496f-a90f-d5f97fbbd555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:29.864741 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43325877-24d7-496f-a90f-d5f97fbbd555 admin admin] PATH_INFO: `/v3/projects/649223240c944b1092491ec5571b3ed9` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:29.866345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43325877-24d7-496f-a90f-d5f97fbbd555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=649223240c944b1092491ec5571b3ed9)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:29.867386 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10810aff-e2e4-459d-8dd6-772ddb822a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:29.871112 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10810aff-e2e4-459d-8dd6-772ddb822a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:29.871112 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10810aff-e2e4-459d-8dd6-772ddb822a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:29.871112 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10810aff-e2e4-459d-8dd6-772ddb822a8e admin admin] PATH_INFO: `/v3/users/3741ffa715ab41e39470458052c1d1a3` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:29.874447 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43325877-24d7-496f-a90f-d5f97fbbd555 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:29.877814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10810aff-e2e4-459d-8dd6-772ddb822a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3741ffa715ab41e39470458052c1d1a3)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:29.884391 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10810aff-e2e4-459d-8dd6-772ddb822a8e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:30.027236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-43325877-24d7-496f-a90f-d5f97fbbd555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '649223240c944b1092491ec5571b3ed9', 'request_id': 'req-43325877-24d7-496f-a90f-d5f97fbbd555'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:30.034213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-43325877-24d7-496f-a90f-d5f97fbbd555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '649223240c944b1092491ec5571b3ed9', 'request_id': 'req-43325877-24d7-496f-a90f-d5f97fbbd555'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:30.051100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-43325877-24d7-496f-a90f-d5f97fbbd555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '649223240c944b1092491ec5571b3ed9', 'request_id': 'req-43325877-24d7-496f-a90f-d5f97fbbd555'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:30.155682 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-10810aff-e2e4-459d-8dd6-772ddb822a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3741ffa715ab41e39470458052c1d1a3'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:30.166269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-43325877-24d7-496f-a90f-d5f97fbbd555 admin admin] The token cache is being invalidate because project 649223240c944b1092491ec5571b3ed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:37:30.166572 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-43325877-24d7-496f-a90f-d5f97fbbd555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:30.176173 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-43325877-24d7-496f-a90f-d5f97fbbd555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:30.180046 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-10810aff-e2e4-459d-8dd6-772ddb822a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3741ffa715ab41e39470458052c1d1a3'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:30.188781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 838/1659] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:37:29 2022] DELETE /identity/v3/projects/649223240c944b1092491ec5571b3ed9 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:30.195556 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a249d31-8d6c-4d54-82c9-a3c999ff963c None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:30.196183 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a249d31-8d6c-4d54-82c9-a3c999ff963c None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:30.196942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a249d31-8d6c-4d54-82c9-a3c999ff963c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:30.199384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-10810aff-e2e4-459d-8dd6-772ddb822a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3741ffa715ab41e39470458052c1d1a3'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:30.202680 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-10810aff-e2e4-459d-8dd6-772ddb822a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3741ffa715ab41e39470458052c1d1a3'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:30.204791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-10810aff-e2e4-459d-8dd6-772ddb822a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3741ffa715ab41e39470458052c1d1a3'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:30.267069 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-6a249d31-8d6c-4d54-82c9-a3c999ff963c None None] MFA Rules not processed for user `b580fccab33d4b899afc3e1b547bf8bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:30.267069 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-6a249d31-8d6c-4d54-82c9-a3c999ff963c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:30.287508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 822/1660] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:37:29 2022] DELETE /identity/v3/users/3741ffa715ab41e39470458052c1d1a3 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:30.290071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10810aff-e2e4-459d-8dd6-772ddb822a8e admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:30.290071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-10810aff-e2e4-459d-8dd6-772ddb822a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:30.471821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 839/1661] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:30 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:30.473899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74b2a9-6439-453e-98f8-58d7b9337e95 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:30.474201 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74b2a9-6439-453e-98f8-58d7b9337e95 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:30.474482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74b2a9-6439-453e-98f8-58d7b9337e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:30.521657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-6d74b2a9-6439-453e-98f8-58d7b9337e95 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:30.523238 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-6d74b2a9-6439-453e-98f8-58d7b9337e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:30.636052 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10810aff-e2e4-459d-8dd6-772ddb822a8e admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:30.657845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7c885-9659-4f62-9945-78d3aca714c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:30.658932 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7c885-9659-4f62-9945-78d3aca714c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:30.659257 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7c885-9659-4f62-9945-78d3aca714c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:30.659685 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7c885-9659-4f62-9945-78d3aca714c8 admin admin] PATH_INFO: `/v3/projects/f38c88fd9df84a948ec755b5ecb36ebc` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:30.663334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7c885-9659-4f62-9945-78d3aca714c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f38c88fd9df84a948ec755b5ecb36ebc)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:30.667184 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7c885-9659-4f62-9945-78d3aca714c8 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:30.703965 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 840/1662] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:30.708174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0c047-728e-4bd2-bfed-f6b22b964e20 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:30.708470 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0c047-728e-4bd2-bfed-f6b22b964e20 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:30.709738 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0c047-728e-4bd2-bfed-f6b22b964e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:30.750479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-e3e0c047-728e-4bd2-bfed-f6b22b964e20 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:30.752146 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e3e0c047-728e-4bd2-bfed-f6b22b964e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:30.772412 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 841/1663] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:30.774385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a400f-685e-46fe-97e7-d254f2173090 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:30.775067 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a400f-685e-46fe-97e7-d254f2173090 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:30.775521 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561a400f-685e-46fe-97e7-d254f2173090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:30.796328 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:30.804174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-561a400f-685e-46fe-97e7-d254f2173090 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:30.805771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-561a400f-685e-46fe-97e7-d254f2173090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:30.815256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 842/1664] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:30.820120 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a400f-685e-46fe-97e7-d254f2173090 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:30.846183 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561a400f-685e-46fe-97e7-d254f2173090 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:30.853198 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f375a8-4b3c-4a78-8635-a1b42401ae2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:30.855053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f375a8-4b3c-4a78-8635-a1b42401ae2c admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:30.855496 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f375a8-4b3c-4a78-8635-a1b42401ae2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:30.855923 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f375a8-4b3c-4a78-8635-a1b42401ae2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:30.856801 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f375a8-4b3c-4a78-8635-a1b42401ae2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:37:30.857818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f375a8-4b3c-4a78-8635-a1b42401ae2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:30.861204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f375a8-4b3c-4a78-8635-a1b42401ae2c admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:30.880610 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 843/1665] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:37:30.881236 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-96e7c885-9659-4f62-9945-78d3aca714c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f38c88fd9df84a948ec755b5ecb36ebc', 'request_id': 'req-96e7c885-9659-4f62-9945-78d3aca714c8'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:30.881920 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f375a8-4b3c-4a78-8635-a1b42401ae2c admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:30.884726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-66f375a8-4b3c-4a78-8635-a1b42401ae2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:30.888099 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-96e7c885-9659-4f62-9945-78d3aca714c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f38c88fd9df84a948ec755b5ecb36ebc', 'request_id': 'req-96e7c885-9659-4f62-9945-78d3aca714c8'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:30.954025 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f375a8-4b3c-4a78-8635-a1b42401ae2c admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:30.956496 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-96e7c885-9659-4f62-9945-78d3aca714c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f38c88fd9df84a948ec755b5ecb36ebc', 'request_id': 'req-96e7c885-9659-4f62-9945-78d3aca714c8'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:30.983034 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:30.988839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-96e7c885-9659-4f62-9945-78d3aca714c8 admin admin] The token cache is being invalidate because project f38c88fd9df84a948ec755b5ecb36ebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:37:30.989148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-96e7c885-9659-4f62-9945-78d3aca714c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:30.989987 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-96e7c885-9659-4f62-9945-78d3aca714c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:30.991647 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 823/1666] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:37:30 2022] DELETE /identity/v3/projects/f38c88fd9df84a948ec755b5ecb36ebc => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:30.999257 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7c885-9659-4f62-9945-78d3aca714c8 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:31.001755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-96e7c885-9659-4f62-9945-78d3aca714c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:31.111798 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebff77-ce1b-4744-b9c4-1f28504fe897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:31.112527 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebff77-ce1b-4744-b9c4-1f28504fe897 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:31.112815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebff77-ce1b-4744-b9c4-1f28504fe897 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:31.113155 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebff77-ce1b-4744-b9c4-1f28504fe897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:31.116122 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-77ebff77-ce1b-4744-b9c4-1f28504fe897 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:31.192790 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7c885-9659-4f62-9945-78d3aca714c8 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:31.211844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0bf14-bd77-4230-a130-14f9921bcd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:31.212688 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0bf14-bd77-4230-a130-14f9921bcd00 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:31.212970 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0bf14-bd77-4230-a130-14f9921bcd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:31.213243 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0bf14-bd77-4230-a130-14f9921bcd00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:31.214014 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0bf14-bd77-4230-a130-14f9921bcd00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:31.215927 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0bf14-bd77-4230-a130-14f9921bcd00 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:31.257244 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ebff77-ce1b-4744-b9c4-1f28504fe897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:31.258838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ebff77-ce1b-4744-b9c4-1f28504fe897 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:31.275607 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 844/1667] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:31.276578 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebff77-ce1b-4744-b9c4-1f28504fe897 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:31.278442 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-77ebff77-ce1b-4744-b9c4-1f28504fe897 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:31.292188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebff77-ce1b-4744-b9c4-1f28504fe897 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:31.297985 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238902b-d083-4f00-988d-7ca4492bb875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:31.299120 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238902b-d083-4f00-988d-7ca4492bb875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:31.299471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238902b-d083-4f00-988d-7ca4492bb875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:31.299812 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2238902b-d083-4f00-988d-7ca4492bb875 admin admin] PATH_INFO: `/v3/users/8b9712a20dee41f189fc26f8ed21dd1f` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:31.301725 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238902b-d083-4f00-988d-7ca4492bb875 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b9712a20dee41f189fc26f8ed21dd1f)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:31.303829 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2238902b-d083-4f00-988d-7ca4492bb875 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:31.351192 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 824/1668] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:30 2022] POST /identity/v3/projects => generated 365 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:31.351192 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0bf14-bd77-4230-a130-14f9921bcd00 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:31.512241 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0bf14-bd77-4230-a130-14f9921bcd00 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:31.523275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dce9cc-d993-4ade-b722-71523ac2589d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:31.525440 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dce9cc-d993-4ade-b722-71523ac2589d admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:31.525440 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dce9cc-d993-4ade-b722-71523ac2589d admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:31.525440 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dce9cc-d993-4ade-b722-71523ac2589d admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:31.531030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dce9cc-d993-4ade-b722-71523ac2589d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:31.557348 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dce9cc-d993-4ade-b722-71523ac2589d admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:31.604706 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2238902b-d083-4f00-988d-7ca4492bb875 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b9712a20dee41f189fc26f8ed21dd1f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:31.618103 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2238902b-d083-4f00-988d-7ca4492bb875 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b9712a20dee41f189fc26f8ed21dd1f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:31.626415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2238902b-d083-4f00-988d-7ca4492bb875 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b9712a20dee41f189fc26f8ed21dd1f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:31.626676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2238902b-d083-4f00-988d-7ca4492bb875 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b9712a20dee41f189fc26f8ed21dd1f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:31.627211 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2238902b-d083-4f00-988d-7ca4492bb875 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b9712a20dee41f189fc26f8ed21dd1f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:31.696446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 825/1669] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:31 2022] POST /identity/v3/users => generated 283 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:31.697929 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5850b5-a6dc-4bfd-900c-ebb153efb289 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:31.698220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5850b5-a6dc-4bfd-900c-ebb153efb289 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:31.698496 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5850b5-a6dc-4bfd-900c-ebb153efb289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:31.746048 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 845/1670] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:37:31 2022] DELETE /identity/v3/users/8b9712a20dee41f189fc26f8ed21dd1f => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:31.746048 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238902b-d083-4f00-988d-7ca4492bb875 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:31.746048 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2238902b-d083-4f00-988d-7ca4492bb875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:31.791435 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-9f5850b5-a6dc-4bfd-900c-ebb153efb289 None None] MFA Rules not processed for user `a8e20ceefdcd48c88cf35ecf0bcd736b`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:31.796017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9f5850b5-a6dc-4bfd-900c-ebb153efb289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:31.925006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2238902b-d083-4f00-988d-7ca4492bb875 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:31.949568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4a2dc-a15f-4665-93c1-a14985d3e62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:31.950361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4a2dc-a15f-4665-93c1-a14985d3e62c admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:31.951289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4a2dc-a15f-4665-93c1-a14985d3e62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:31.951289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a4a2dc-a15f-4665-93c1-a14985d3e62c admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:31.951669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4a2dc-a15f-4665-93c1-a14985d3e62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:31.953310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a4a2dc-a15f-4665-93c1-a14985d3e62c admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:31.971121 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 826/1671] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:31.980269 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5850b5-a6dc-4bfd-900c-ebb153efb289 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:31.989336 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 846/1672] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:31.990317 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9f5850b5-a6dc-4bfd-900c-ebb153efb289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:31.990434 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4a2dc-a15f-4665-93c1-a14985d3e62c admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:32.001496 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a4a2dc-a15f-4665-93c1-a14985d3e62c admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:32.020632 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2134807-b764-41fb-9778-ec245c4d29e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:32.021082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2134807-b764-41fb-9778-ec245c4d29e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:32.021307 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2134807-b764-41fb-9778-ec245c4d29e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:32.032526 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2134807-b764-41fb-9778-ec245c4d29e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:32.033664 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2134807-b764-41fb-9778-ec245c4d29e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:32.037797 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2134807-b764-41fb-9778-ec245c4d29e2 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:32.076433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 847/1673] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:32.080634 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2134807-b764-41fb-9778-ec245c4d29e2 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:32.112099 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2134807-b764-41fb-9778-ec245c4d29e2 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:32.127384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c5ac0-4aa8-493a-aefd-f02d42d5c11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:32.128800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c5ac0-4aa8-493a-aefd-f02d42d5c11b admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:32.131217 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c5ac0-4aa8-493a-aefd-f02d42d5c11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:32.131826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c5ac0-4aa8-493a-aefd-f02d42d5c11b admin admin] PATH_INFO: `/v3/projects/c0c11807d9274a2a8e630a8df3311729/users/9f548ac36802406188408fc965d0a932/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:32.166739 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5850b5-a6dc-4bfd-900c-ebb153efb289 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:32.176693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c5ac0-4aa8-493a-aefd-f02d42d5c11b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c11807d9274a2a8e630a8df3311729, user_id=9f548ac36802406188408fc965d0a932, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:32.179432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c5ac0-4aa8-493a-aefd-f02d42d5c11b admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:32.185332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa14e8-3232-4582-a699-fe05a95060d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:32.187870 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa14e8-3232-4582-a699-fe05a95060d2 service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:32.191233 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa14e8-3232-4582-a699-fe05a95060d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:32.194381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa14e8-3232-4582-a699-fe05a95060d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:32.210683 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa14e8-3232-4582-a699-fe05a95060d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:32.213239 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa14e8-3232-4582-a699-fe05a95060d2 service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:32.254534 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 827/1674] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:32.327008 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 848/1675] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:32 2022] PUT /identity/v3/projects/c0c11807d9274a2a8e630a8df3311729/users/9f548ac36802406188408fc965d0a932/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:32.349937 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae52a2f-3d34-49cb-b1a4-ce974e015c75 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:32.350282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae52a2f-3d34-49cb-b1a4-ce974e015c75 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:32.350575 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae52a2f-3d34-49cb-b1a4-ce974e015c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:32.396998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-7ae52a2f-3d34-49cb-b1a4-ce974e015c75 None None] MFA Rules not processed for user `9f548ac36802406188408fc965d0a932`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:32.398553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7ae52a2f-3d34-49cb-b1a4-ce974e015c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:32.484010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 828/1676] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:32.489789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c5ac0-4aa8-493a-aefd-f02d42d5c11b admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:32.624282 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c5ac0-4aa8-493a-aefd-f02d42d5c11b admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:32.631242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50baf8d7-b91d-4b02-a3f0-5ffa6aff9381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:32.631939 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baf8d7-b91d-4b02-a3f0-5ffa6aff9381 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:32.632229 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baf8d7-b91d-4b02-a3f0-5ffa6aff9381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:32.632510 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baf8d7-b91d-4b02-a3f0-5ffa6aff9381 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:32.634918 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50baf8d7-b91d-4b02-a3f0-5ffa6aff9381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:32.638484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50baf8d7-b91d-4b02-a3f0-5ffa6aff9381 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:32.767304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 849/1677] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:32 2022] POST /identity/v3/projects => generated 365 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:32.771693 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae52a2f-3d34-49cb-b1a4-ce974e015c75 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:32.794219 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae52a2f-3d34-49cb-b1a4-ce974e015c75 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:32.922485 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba65e1-133b-4d09-8a29-71faae75435d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:32.923187 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba65e1-133b-4d09-8a29-71faae75435d admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:32.923487 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba65e1-133b-4d09-8a29-71faae75435d admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:32.923761 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba65e1-133b-4d09-8a29-71faae75435d admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:32.924475 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba65e1-133b-4d09-8a29-71faae75435d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:32.926664 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba65e1-133b-4d09-8a29-71faae75435d admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:33.066751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 829/1678] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:32 2022] POST /identity/v3/users => generated 289 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:33.068117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50baf8d7-b91d-4b02-a3f0-5ffa6aff9381 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:33.081144 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50baf8d7-b91d-4b02-a3f0-5ffa6aff9381 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:33.088549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820115d6-bf38-48ae-b265-67aaa076f80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:33.089726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820115d6-bf38-48ae-b265-67aaa076f80e admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:33.091518 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:33.094599 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820115d6-bf38-48ae-b265-67aaa076f80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:33.094599 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820115d6-bf38-48ae-b265-67aaa076f80e admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:33.094599 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820115d6-bf38-48ae-b265-67aaa076f80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:33.095524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820115d6-bf38-48ae-b265-67aaa076f80e admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:33.110793 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 850/1679] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:33.115269 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba65e1-133b-4d09-8a29-71faae75435d admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:33.127782 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba65e1-133b-4d09-8a29-71faae75435d admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:33.134399 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fddc8-e747-48eb-ad90-ebef43e6110f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:33.134399 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fddc8-e747-48eb-ad90-ebef43e6110f admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:33.134399 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fddc8-e747-48eb-ad90-ebef43e6110f admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:33.134737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5fddc8-e747-48eb-ad90-ebef43e6110f admin admin] PATH_INFO: `/v3/projects/9992e13fae97416d8f43c35c8a3fe600/users/4027ea3f8f424b718a472a100ccd38c5/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:33.156017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fddc8-e747-48eb-ad90-ebef43e6110f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9992e13fae97416d8f43c35c8a3fe600, user_id=4027ea3f8f424b718a472a100ccd38c5, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:33.159173 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5fddc8-e747-48eb-ad90-ebef43e6110f admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:33.206081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820115d6-bf38-48ae-b265-67aaa076f80e admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:33.209026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-820115d6-bf38-48ae-b265-67aaa076f80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:33.235798 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820115d6-bf38-48ae-b265-67aaa076f80e admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:33.252740 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35ac0b-98c7-49d0-b2d5-32c99b943ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:33.254090 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35ac0b-98c7-49d0-b2d5-32c99b943ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:33.254599 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35ac0b-98c7-49d0-b2d5-32c99b943ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:33.255075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35ac0b-98c7-49d0-b2d5-32c99b943ed7 admin admin] PATH_INFO: `/v3/projects/efd0e82a36ef4973993d4b602b7dcb8a` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:33.256744 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35ac0b-98c7-49d0-b2d5-32c99b943ed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd0e82a36ef4973993d4b602b7dcb8a)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:33.263143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35ac0b-98c7-49d0-b2d5-32c99b943ed7 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:33.281355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 830/1680] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:33 2022] PUT /identity/v3/projects/9992e13fae97416d8f43c35c8a3fe600/users/4027ea3f8f424b718a472a100ccd38c5/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:33.282594 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fddc8-e747-48eb-ad90-ebef43e6110f admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:33.391177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5fddc8-e747-48eb-ad90-ebef43e6110f admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:33.403455 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb0287-3d60-40ad-be48-6158578f989b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:33.407237 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb0287-3d60-40ad-be48-6158578f989b admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:33.407237 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb0287-3d60-40ad-be48-6158578f989b admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:33.410138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb0287-3d60-40ad-be48-6158578f989b admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:33.411122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb0287-3d60-40ad-be48-6158578f989b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:33.419297 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb0287-3d60-40ad-be48-6158578f989b admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:33.463773 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 831/1681] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:33.472787 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb0287-3d60-40ad-be48-6158578f989b admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:33.480762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5b35ac0b-98c7-49d0-b2d5-32c99b943ed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd0e82a36ef4973993d4b602b7dcb8a', 'request_id': 'req-5b35ac0b-98c7-49d0-b2d5-32c99b943ed7'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:33.510827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb0287-3d60-40ad-be48-6158578f989b admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:33.510827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:33.511016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5b35ac0b-98c7-49d0-b2d5-32c99b943ed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd0e82a36ef4973993d4b602b7dcb8a', 'request_id': 'req-5b35ac0b-98c7-49d0-b2d5-32c99b943ed7'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:33.529414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5b35ac0b-98c7-49d0-b2d5-32c99b943ed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd0e82a36ef4973993d4b602b7dcb8a', 'request_id': 'req-5b35ac0b-98c7-49d0-b2d5-32c99b943ed7'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:33.647668 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f2eb3-8c87-4f69-b31c-7553484e73b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:33.648592 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f2eb3-8c87-4f69-b31c-7553484e73b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:33.648883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f2eb3-8c87-4f69-b31c-7553484e73b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:33.649160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f2eb3-8c87-4f69-b31c-7553484e73b5 admin admin] PATH_INFO: `/v3/projects/9992e13fae97416d8f43c35c8a3fe600/users/4027ea3f8f424b718a472a100ccd38c5/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:33.655304 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f2eb3-8c87-4f69-b31c-7553484e73b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9992e13fae97416d8f43c35c8a3fe600, user_id=4027ea3f8f424b718a472a100ccd38c5, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:33.658871 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f2eb3-8c87-4f69-b31c-7553484e73b5 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:33.672647 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5b35ac0b-98c7-49d0-b2d5-32c99b943ed7 admin admin] The token cache is being invalidate because project efd0e82a36ef4973993d4b602b7dcb8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:37:33.672987 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5b35ac0b-98c7-49d0-b2d5-32c99b943ed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:33.676419 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5b35ac0b-98c7-49d0-b2d5-32c99b943ed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:33.689139 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 851/1683] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:37:33 2022] DELETE /identity/v3/projects/efd0e82a36ef4973993d4b602b7dcb8a => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:33.689139 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042adfa8-4663-4645-8513-63bfbce93790 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:33.689139 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042adfa8-4663-4645-8513-63bfbce93790 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:33.689139 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042adfa8-4663-4645-8513-63bfbce93790 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:33.689139 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 852/1684] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 08:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:37:33.689139 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3f3a4-bbc8-48a6-b965-80e2603c6bdd None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:33.689809 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3f3a4-bbc8-48a6-b965-80e2603c6bdd None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:33.689809 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3f3a4-bbc8-48a6-b965-80e2603c6bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:33.692323 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 832/1684] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:33 2022] PUT /identity/v3/projects/9992e13fae97416d8f43c35c8a3fe600/users/4027ea3f8f424b718a472a100ccd38c5/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:33.695629 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3567798-f838-4e59-9134-228c3c5d8d35 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:33.696122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3567798-f838-4e59-9134-228c3c5d8d35 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:33.697317 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3567798-f838-4e59-9134-228c3c5d8d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:33.730361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-f2c3f3a4-bbc8-48a6-b965-80e2603c6bdd None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:33.731634 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f2c3f3a4-bbc8-48a6-b965-80e2603c6bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:33.732213 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-c3567798-f838-4e59-9134-228c3c5d8d35 None None] MFA Rules not processed for user `4027ea3f8f424b718a472a100ccd38c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:33.733787 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c3567798-f838-4e59-9134-228c3c5d8d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:33.869109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 853/1685] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:33.870690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bbc14-dfc0-4180-8e50-53422c0bd796 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:33.871092 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bbc14-dfc0-4180-8e50-53422c0bd796 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:33.871476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bbc14-dfc0-4180-8e50-53422c0bd796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:33.877430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 833/1686] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:33.880668 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763428e0-7c50-4bec-be6b-de699282b9ce None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:33.885603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763428e0-7c50-4bec-be6b-de699282b9ce None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:33.885603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763428e0-7c50-4bec-be6b-de699282b9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:33.902615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-f62bbc14-dfc0-4180-8e50-53422c0bd796 None None] MFA Rules not processed for user `4e38b7e84d6a43efbb4c1a52e2b3e681`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:33.906900 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f62bbc14-dfc0-4180-8e50-53422c0bd796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:33.968814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-763428e0-7c50-4bec-be6b-de699282b9ce None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:33.970147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-763428e0-7c50-4bec-be6b-de699282b9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:33.986716 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 834/1687] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:33.992136 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763428e0-7c50-4bec-be6b-de699282b9ce None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:33.996339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-763428e0-7c50-4bec-be6b-de699282b9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:34.075620 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 854/1688] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 08:37:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:34.076799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bbc14-dfc0-4180-8e50-53422c0bd796 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:34.097076 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bbc14-dfc0-4180-8e50-53422c0bd796 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:34.111514 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3be57c-ead9-445b-a632-fbd5706be66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:34.112484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3be57c-ead9-445b-a632-fbd5706be66f admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:34.114864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3be57c-ead9-445b-a632-fbd5706be66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:34.115313 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3be57c-ead9-445b-a632-fbd5706be66f admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:34.117299 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3be57c-ead9-445b-a632-fbd5706be66f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:37:34.119519 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3be57c-ead9-445b-a632-fbd5706be66f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:34.121839 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3be57c-ead9-445b-a632-fbd5706be66f admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:34.150833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763428e0-7c50-4bec-be6b-de699282b9ce None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:34.152271 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 855/1689] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:37:34.153228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3be57c-ead9-445b-a632-fbd5706be66f admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:34.158183 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-7f3be57c-ead9-445b-a632-fbd5706be66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:34.158384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9adab-06d5-42f9-8bf3-fa553b4744eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:34.161257 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9adab-06d5-42f9-8bf3-fa553b4744eb service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:34.161816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9adab-06d5-42f9-8bf3-fa553b4744eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:34.162298 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9adab-06d5-42f9-8bf3-fa553b4744eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:34.186155 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9adab-06d5-42f9-8bf3-fa553b4744eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:34.190770 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c9adab-06d5-42f9-8bf3-fa553b4744eb service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:34.192209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3be57c-ead9-445b-a632-fbd5706be66f admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:34.204843 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd003b-1a09-46a2-9572-db75d8713d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:34.205921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd003b-1a09-46a2-9572-db75d8713d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:34.206209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd003b-1a09-46a2-9572-db75d8713d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:34.206491 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd003b-1a09-46a2-9572-db75d8713d5c admin admin] PATH_INFO: `/v3/projects/ede66d1b4685482e9494d25ce007be99` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:34.209848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd003b-1a09-46a2-9572-db75d8713d5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ede66d1b4685482e9494d25ce007be99)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:34.211790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd003b-1a09-46a2-9572-db75d8713d5c admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:34.217636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 835/1690] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:34.218721 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9adab-06d5-42f9-8bf3-fa553b4744eb service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:34.253561 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9adab-06d5-42f9-8bf3-fa553b4744eb service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:34.266452 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66223f5d-1908-4dd2-b7fc-bbf4477fa737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:34.278492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66223f5d-1908-4dd2-b7fc-bbf4477fa737 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:34.278492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66223f5d-1908-4dd2-b7fc-bbf4477fa737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:34.278492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66223f5d-1908-4dd2-b7fc-bbf4477fa737 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:34.278492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66223f5d-1908-4dd2-b7fc-bbf4477fa737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:34.278492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66223f5d-1908-4dd2-b7fc-bbf4477fa737 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:34.380522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 836/1691] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:34 2022] POST /identity/v3/projects => generated 369 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:34.384922 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66223f5d-1908-4dd2-b7fc-bbf4477fa737 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:34.395411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-78cd003b-1a09-46a2-9572-db75d8713d5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ede66d1b4685482e9494d25ce007be99', 'request_id': 'req-78cd003b-1a09-46a2-9572-db75d8713d5c'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:34.420376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-78cd003b-1a09-46a2-9572-db75d8713d5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ede66d1b4685482e9494d25ce007be99', 'request_id': 'req-78cd003b-1a09-46a2-9572-db75d8713d5c'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:34.442791 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-78cd003b-1a09-46a2-9572-db75d8713d5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ede66d1b4685482e9494d25ce007be99', 'request_id': 'req-78cd003b-1a09-46a2-9572-db75d8713d5c'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:34.584899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66223f5d-1908-4dd2-b7fc-bbf4477fa737 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:34.595678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d08235-14b4-44d5-873d-5748ecb84cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:34.599519 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d08235-14b4-44d5-873d-5748ecb84cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:34.601354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d08235-14b4-44d5-873d-5748ecb84cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:34.606422 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d08235-14b4-44d5-873d-5748ecb84cd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:34.606422 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d08235-14b4-44d5-873d-5748ecb84cd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:34.611886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d08235-14b4-44d5-873d-5748ecb84cd4 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:34.613014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-78cd003b-1a09-46a2-9572-db75d8713d5c admin admin] The token cache is being invalidate because project ede66d1b4685482e9494d25ce007be99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:37:34.613498 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-78cd003b-1a09-46a2-9572-db75d8713d5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:34.615789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-78cd003b-1a09-46a2-9572-db75d8713d5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:34.621972 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 856/1692] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:37:34 2022] DELETE /identity/v3/projects/ede66d1b4685482e9494d25ce007be99 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:34.623660 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185ea8e-10ec-4ef0-94f9-2848b9a9a0cd None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:34.627529 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185ea8e-10ec-4ef0-94f9-2848b9a9a0cd None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:34.627989 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185ea8e-10ec-4ef0-94f9-2848b9a9a0cd None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:34.631784 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 857/1693] 10.222.0.57 () {54 vars in 961 bytes} [Thu Jul 21 08:37:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:37:34.634131 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d2c26-b9ae-45f0-8399-6a09f9028815 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:34.634570 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d2c26-b9ae-45f0-8399-6a09f9028815 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:34.635570 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d2c26-b9ae-45f0-8399-6a09f9028815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:34.684534 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-930d2c26-b9ae-45f0-8399-6a09f9028815 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:34.686838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-930d2c26-b9ae-45f0-8399-6a09f9028815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:34.697985 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 858/1694] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:34.698871 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d2c26-b9ae-45f0-8399-6a09f9028815 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:34.700959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-930d2c26-b9ae-45f0-8399-6a09f9028815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:34.777186 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 837/1695] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:34 2022] POST /identity/v3/users => generated 285 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:37:34.778986 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3dd34-4c12-4c6f-905d-eb87611403b3 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:34.781248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3dd34-4c12-4c6f-905d-eb87611403b3 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:34.781248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3dd34-4c12-4c6f-905d-eb87611403b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:34.829038 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-eca3dd34-4c12-4c6f-905d-eb87611403b3 None None] MFA Rules not processed for user `4e38b7e84d6a43efbb4c1a52e2b3e681`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:34.830662 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-eca3dd34-4c12-4c6f-905d-eb87611403b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:34.853812 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930d2c26-b9ae-45f0-8399-6a09f9028815 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:34.864999 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c93be-1926-49d1-bd7e-db90e1d18a11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:34.865770 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c93be-1926-49d1-bd7e-db90e1d18a11 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:34.866283 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c93be-1926-49d1-bd7e-db90e1d18a11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:34.866643 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c93be-1926-49d1-bd7e-db90e1d18a11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:34.873191 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ff6c93be-1926-49d1-bd7e-db90e1d18a11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:34.912284 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:34.970732 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c93be-1926-49d1-bd7e-db90e1d18a11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:34.975583 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c93be-1926-49d1-bd7e-db90e1d18a11 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:34.975768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 838/1696] 10.222.0.57 () {58 vars in 1058 bytes} [Thu Jul 21 08:37:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:34.977785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45e4c1-aa7c-461d-a368-64c7ec180b1c None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:34.978255 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45e4c1-aa7c-461d-a368-64c7ec180b1c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:34.979010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45e4c1-aa7c-461d-a368-64c7ec180b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:35.017702 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 859/1697] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:35.025165 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc2ba8-fac0-492c-a565-be34d207ccf8 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:35.026479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc2ba8-fac0-492c-a565-be34d207ccf8 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:35.026479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc2ba8-fac0-492c-a565-be34d207ccf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:35.034221 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-ba45e4c1-aa7c-461d-a368-64c7ec180b1c None None] MFA Rules not processed for user `017d2074ad8742ca8bd156593c591b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:35.036174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ba45e4c1-aa7c-461d-a368-64c7ec180b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:35.071829 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-5cfc2ba8-fac0-492c-a565-be34d207ccf8 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:35.073343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5cfc2ba8-fac0-492c-a565-be34d207ccf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:35.096839 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 860/1698] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:35.101361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc2ba8-fac0-492c-a565-be34d207ccf8 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:35.107655 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5cfc2ba8-fac0-492c-a565-be34d207ccf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:35.125313 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 839/1699] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:35.126997 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45e4c1-aa7c-461d-a368-64c7ec180b1c None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:35.135063 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc2ba8-fac0-492c-a565-be34d207ccf8 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:35.147733 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa66302-06ab-47fb-8c73-83dc8a37530b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:35.148429 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa66302-06ab-47fb-8c73-83dc8a37530b admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:35.148722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa66302-06ab-47fb-8c73-83dc8a37530b admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:35.149005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa66302-06ab-47fb-8c73-83dc8a37530b admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:35.149811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa66302-06ab-47fb-8c73-83dc8a37530b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:35.154529 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa66302-06ab-47fb-8c73-83dc8a37530b admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:35.158420 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45e4c1-aa7c-461d-a368-64c7ec180b1c None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:35.169021 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa1aee-d966-4d90-95a2-ba8412835365 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38b7e84d6a43efbb4c1a52e2b3e681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:35.170360 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa1aee-d966-4d90-95a2-ba8412835365 service placement] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:35.176376 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa1aee-d966-4d90-95a2-ba8412835365 service placement] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:35.176809 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa1aee-d966-4d90-95a2-ba8412835365 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:35.180869 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-d4aa1aee-d966-4d90-95a2-ba8412835365 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:35.188581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 861/1700] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:35.190694 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa66302-06ab-47fb-8c73-83dc8a37530b admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:35.204745 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa1aee-d966-4d90-95a2-ba8412835365 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:35.209437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa1aee-d966-4d90-95a2-ba8412835365 service placement] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:35.222075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa66302-06ab-47fb-8c73-83dc8a37530b admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:35.237411 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:35.239745 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 840/1701] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:35.243329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47527dcd-dce2-4491-ae25-b472532123cb None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:35.244181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47527dcd-dce2-4491-ae25-b472532123cb None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:35.244181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47527dcd-dce2-4491-ae25-b472532123cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:35.255643 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85448f-dc99-4b89-be81-673195f9b63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:35.258216 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85448f-dc99-4b89-be81-673195f9b63e admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:35.260850 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85448f-dc99-4b89-be81-673195f9b63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:35.261428 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85448f-dc99-4b89-be81-673195f9b63e admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:35.263399 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85448f-dc99-4b89-be81-673195f9b63e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:37:35.279359 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85448f-dc99-4b89-be81-673195f9b63e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:35.287256 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-47527dcd-dce2-4491-ae25-b472532123cb None None] MFA Rules not processed for user `017d2074ad8742ca8bd156593c591b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:35.287443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85448f-dc99-4b89-be81-673195f9b63e admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:35.290266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-47527dcd-dce2-4491-ae25-b472532123cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:35.310028 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 841/1702] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:35.311167 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47527dcd-dce2-4491-ae25-b472532123cb None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:35.324693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 862/1703] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:37:35.326892 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85448f-dc99-4b89-be81-673195f9b63e admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:35.331987 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5a85448f-dc99-4b89-be81-673195f9b63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:35.342332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47527dcd-dce2-4491-ae25-b472532123cb None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:35.351903 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccaf010-dc44-45d1-91a0-df0827d9f1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:35.352767 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccaf010-dc44-45d1-91a0-df0827d9f1bf admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:35.357702 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccaf010-dc44-45d1-91a0-df0827d9f1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:35.357702 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccaf010-dc44-45d1-91a0-df0827d9f1bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:35.357702 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccaf010-dc44-45d1-91a0-df0827d9f1bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:35.364884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccaf010-dc44-45d1-91a0-df0827d9f1bf admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:35.383426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 842/1704] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:35.388386 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccaf010-dc44-45d1-91a0-df0827d9f1bf admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:35.412191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccaf010-dc44-45d1-91a0-df0827d9f1bf admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:35.426626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fbdcc-a890-4b5a-a516-2f164f7d2b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:35.427332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fbdcc-a890-4b5a-a516-2f164f7d2b94 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:35.427604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fbdcc-a890-4b5a-a516-2f164f7d2b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:35.427885 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fbdcc-a890-4b5a-a516-2f164f7d2b94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:35.429705 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fbdcc-a890-4b5a-a516-2f164f7d2b94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:35.430730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fbdcc-a890-4b5a-a516-2f164f7d2b94 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:35.554234 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 843/1705] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:35 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:35.555166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fbdcc-a890-4b5a-a516-2f164f7d2b94 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:35.582964 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85448f-dc99-4b89-be81-673195f9b63e admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:35.714858 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fbdcc-a890-4b5a-a516-2f164f7d2b94 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:35.718468 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1afedb-a73a-465c-b0d6-5b40c56d384f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:35.719386 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1afedb-a73a-465c-b0d6-5b40c56d384f admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:35.719676 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1afedb-a73a-465c-b0d6-5b40c56d384f admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:35.719956 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1afedb-a73a-465c-b0d6-5b40c56d384f admin admin] PATH_INFO: `/v3/projects/73da960c77754f4fbd4239b569a5978d/users/8f34c1df84b74664965afd6c5bdfb4af/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:35.759413 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1afedb-a73a-465c-b0d6-5b40c56d384f admin admin] RBAC: Authorizing `identity:create_grant(project_id=73da960c77754f4fbd4239b569a5978d, user_id=8f34c1df84b74664965afd6c5bdfb4af, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:35.766668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80745aa0-e29e-4c35-95ab-45fa4a1999f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:35.767308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80745aa0-e29e-4c35-95ab-45fa4a1999f7 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:35.767581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80745aa0-e29e-4c35-95ab-45fa4a1999f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:35.767870 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80745aa0-e29e-4c35-95ab-45fa4a1999f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:35.775746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1afedb-a73a-465c-b0d6-5b40c56d384f admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:35.843974 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:35.880682 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 844/1706] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:35 2022] PUT /identity/v3/projects/73da960c77754f4fbd4239b569a5978d/users/8f34c1df84b74664965afd6c5bdfb4af/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:35.880682 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1afedb-a73a-465c-b0d6-5b40c56d384f admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:35.903439 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:35.933222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80745aa0-e29e-4c35-95ab-45fa4a1999f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:35.933222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80745aa0-e29e-4c35-95ab-45fa4a1999f7 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:35.955646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 863/1707] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:35.962179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc43b4e-bfbf-4567-b8bd-e64fe90e597a None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:35.962179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc43b4e-bfbf-4567-b8bd-e64fe90e597a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:35.962179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc43b4e-bfbf-4567-b8bd-e64fe90e597a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:35.967957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1afedb-a73a-465c-b0d6-5b40c56d384f admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:35.982934 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ca1bc-6405-409c-9f4e-0187773a0f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:35.983634 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ca1bc-6405-409c-9f4e-0187773a0f92 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:35.983921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ca1bc-6405-409c-9f4e-0187773a0f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:35.984201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ca1bc-6405-409c-9f4e-0187773a0f92 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:35.985439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ca1bc-6405-409c-9f4e-0187773a0f92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:35.987225 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ca1bc-6405-409c-9f4e-0187773a0f92 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:36.031362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-0dc43b4e-bfbf-4567-b8bd-e64fe90e597a None None] MFA Rules not processed for user `8f34c1df84b74664965afd6c5bdfb4af`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:36.033171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-0dc43b4e-bfbf-4567-b8bd-e64fe90e597a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:36.129674 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 845/1708] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:35 2022] POST /identity/v3/users => generated 291 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:36.136421 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ca1bc-6405-409c-9f4e-0187773a0f92 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:36.159144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ca1bc-6405-409c-9f4e-0187773a0f92 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:36.172639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0949408-d267-45f5-a261-efa17be85d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:36.173618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0949408-d267-45f5-a261-efa17be85d33 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:36.174217 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0949408-d267-45f5-a261-efa17be85d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:36.175956 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0949408-d267-45f5-a261-efa17be85d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:36.176971 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0949408-d267-45f5-a261-efa17be85d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:36.181560 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0949408-d267-45f5-a261-efa17be85d33 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:36.213434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 846/1709] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:36.215119 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0949408-d267-45f5-a261-efa17be85d33 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:36.218139 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 864/1710] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:36.219361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc43b4e-bfbf-4567-b8bd-e64fe90e597a None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:36.241426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0949408-d267-45f5-a261-efa17be85d33 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:36.251839 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc43b4e-bfbf-4567-b8bd-e64fe90e597a None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:36.267477 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7dec1-1ec8-40cf-ab6b-3fd6fb778d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:36.269937 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7dec1-1ec8-40cf-ab6b-3fd6fb778d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:36.271405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7dec1-1ec8-40cf-ab6b-3fd6fb778d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:36.271405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7dec1-1ec8-40cf-ab6b-3fd6fb778d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:36.275955 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7dec1-1ec8-40cf-ab6b-3fd6fb778d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:36.277469 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb65856-c074-45ed-9c0b-06bdb3fdaf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:36.277808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7dec1-1ec8-40cf-ab6b-3fd6fb778d7c admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:36.280417 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb65856-c074-45ed-9c0b-06bdb3fdaf56 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:36.287056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb65856-c074-45ed-9c0b-06bdb3fdaf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:36.287056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb65856-c074-45ed-9c0b-06bdb3fdaf56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:36.287056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb65856-c074-45ed-9c0b-06bdb3fdaf56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:36.295356 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb65856-c074-45ed-9c0b-06bdb3fdaf56 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:36.304578 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 847/1711] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:36.305569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7dec1-1ec8-40cf-ab6b-3fd6fb778d7c admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:36.319137 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7dec1-1ec8-40cf-ab6b-3fd6fb778d7c admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:36.329401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c2f88-60d2-4f71-9f3b-6435ca47ac4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:36.331419 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c2f88-60d2-4f71-9f3b-6435ca47ac4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:36.334916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c2f88-60d2-4f71-9f3b-6435ca47ac4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:36.335348 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c2f88-60d2-4f71-9f3b-6435ca47ac4d admin admin] PATH_INFO: `/v3/projects/943317b51f0547c28f83be2eb02bf902/users/83752c05bd074ca68af764fc92d75d16/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:36.377465 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c2f88-60d2-4f71-9f3b-6435ca47ac4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=943317b51f0547c28f83be2eb02bf902, user_id=83752c05bd074ca68af764fc92d75d16, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:36.384977 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c2f88-60d2-4f71-9f3b-6435ca47ac4d admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:36.453985 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 865/1712] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:36 2022] POST /identity/v3/projects => generated 369 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:36.455273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb65856-c074-45ed-9c0b-06bdb3fdaf56 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:36.481415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 848/1713] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:36 2022] PUT /identity/v3/projects/943317b51f0547c28f83be2eb02bf902/users/83752c05bd074ca68af764fc92d75d16/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:36.499015 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c2f88-60d2-4f71-9f3b-6435ca47ac4d admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:36.500809 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-5d9c2f88-60d2-4f71-9f3b-6435ca47ac4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:36.624084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb65856-c074-45ed-9c0b-06bdb3fdaf56 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:36.655366 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c2f88-60d2-4f71-9f3b-6435ca47ac4d admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:36.677730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007075b-2dfc-4e06-a2e4-7326628b3557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:36.678660 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007075b-2dfc-4e06-a2e4-7326628b3557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:36.679089 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007075b-2dfc-4e06-a2e4-7326628b3557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:36.679377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007075b-2dfc-4e06-a2e4-7326628b3557 admin admin] PATH_INFO: `/v3/users/6060b292e6a941839c8e8bc608662394` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:36.680724 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007075b-2dfc-4e06-a2e4-7326628b3557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6060b292e6a941839c8e8bc608662394)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:36.682735 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9007075b-2dfc-4e06-a2e4-7326628b3557 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:36.826421 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c71f2-4440-4c4c-9b9f-803db072864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:36.829074 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c71f2-4440-4c4c-9b9f-803db072864a admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:36.829565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c71f2-4440-4c4c-9b9f-803db072864a admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:36.829992 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c71f2-4440-4c4c-9b9f-803db072864a admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:36.830827 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c71f2-4440-4c4c-9b9f-803db072864a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:36.836224 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c71f2-4440-4c4c-9b9f-803db072864a admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:36.918390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9007075b-2dfc-4e06-a2e4-7326628b3557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6060b292e6a941839c8e8bc608662394'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:36.977279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9007075b-2dfc-4e06-a2e4-7326628b3557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6060b292e6a941839c8e8bc608662394'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:36.998737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9007075b-2dfc-4e06-a2e4-7326628b3557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6060b292e6a941839c8e8bc608662394'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:37.001625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9007075b-2dfc-4e06-a2e4-7326628b3557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6060b292e6a941839c8e8bc608662394'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:37.003682 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9007075b-2dfc-4e06-a2e4-7326628b3557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6060b292e6a941839c8e8bc608662394'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:37.012406 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 866/1714] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:36 2022] POST /identity/v3/users => generated 291 bytes in 558 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:37:37.014797 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f4cfa-894a-43b3-9e1d-6c7ee6151f84 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:37.016282 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f4cfa-894a-43b3-9e1d-6c7ee6151f84 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:37.016720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f4cfa-894a-43b3-9e1d-6c7ee6151f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:37.090072 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-8a2f4cfa-894a-43b3-9e1d-6c7ee6151f84 None None] MFA Rules not processed for user `83752c05bd074ca68af764fc92d75d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:37.101707 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-8a2f4cfa-894a-43b3-9e1d-6c7ee6151f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:37.104902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:37.115725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 849/1715] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:37:36 2022] DELETE /identity/v3/users/6060b292e6a941839c8e8bc608662394 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:37.115725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007075b-2dfc-4e06-a2e4-7326628b3557 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:37.115725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9007075b-2dfc-4e06-a2e4-7326628b3557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:37.234206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007075b-2dfc-4e06-a2e4-7326628b3557 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:37.248755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45084758-af13-45b1-9429-10708088e8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:37.249621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45084758-af13-45b1-9429-10708088e8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:37.249891 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45084758-af13-45b1-9429-10708088e8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:37.250172 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45084758-af13-45b1-9429-10708088e8d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:37.250335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 867/1716] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:37.251042 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45084758-af13-45b1-9429-10708088e8d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:37.254463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45084758-af13-45b1-9429-10708088e8d6 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:37.256338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e961a-64a2-487b-b39b-717b4e3a34f7 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:37.256750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e961a-64a2-487b-b39b-717b4e3a34f7 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:37.257516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e961a-64a2-487b-b39b-717b4e3a34f7 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:37.262632 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 868/1717] 10.222.0.57 () {54 vars in 912 bytes} [Thu Jul 21 08:37:37 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:37:37.263648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e961a-64a2-487b-b39b-717b4e3a34f7 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:37.272572 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-444e961a-64a2-487b-b39b-717b4e3a34f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:37.272782 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 850/1718] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:37.275987 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071af63-3f6e-40c9-ab55-01cf76d90bc4 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:37.276279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071af63-3f6e-40c9-ab55-01cf76d90bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:37.276557 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071af63-3f6e-40c9-ab55-01cf76d90bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:37.314876 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e961a-64a2-487b-b39b-717b4e3a34f7 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:37.339084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04788642-6599-40f3-8398-bb2683a29358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:37.339840 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04788642-6599-40f3-8398-bb2683a29358 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:37.344660 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04788642-6599-40f3-8398-bb2683a29358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:37.344660 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04788642-6599-40f3-8398-bb2683a29358 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:37.345444 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04788642-6599-40f3-8398-bb2683a29358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:37.348233 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04788642-6599-40f3-8398-bb2683a29358 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:37.392935 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-e071af63-3f6e-40c9-ab55-01cf76d90bc4 None None] MFA Rules not processed for user `a25749f3a7c84c50b860538d1b661901`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:37.397804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e071af63-3f6e-40c9-ab55-01cf76d90bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:37.537139 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 869/1719] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:37 2022] POST /identity/v3/projects => generated 381 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:37.537139 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04788642-6599-40f3-8398-bb2683a29358 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:37.554306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 851/1720] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 08:37:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:37.559521 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071af63-3f6e-40c9-ab55-01cf76d90bc4 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:37.623499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071af63-3f6e-40c9-ab55-01cf76d90bc4 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:37.695916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04788642-6599-40f3-8398-bb2683a29358 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:37.707037 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc5d8e-abfa-40ba-9809-22ff59606873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:37.707969 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc5d8e-abfa-40ba-9809-22ff59606873 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:37.708252 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc5d8e-abfa-40ba-9809-22ff59606873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:37.708530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc5d8e-abfa-40ba-9809-22ff59606873 admin admin] PATH_INFO: `/v3/projects/440733cec22240c69c944bfd4c52d28a/users/2df056798457462a9d6cbf1bfc77ed73/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:37.747167 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc5d8e-abfa-40ba-9809-22ff59606873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=440733cec22240c69c944bfd4c52d28a, user_id=2df056798457462a9d6cbf1bfc77ed73, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:37.750277 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc5d8e-abfa-40ba-9809-22ff59606873 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:37.763682 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20993e3e-448c-43e1-8128-135ae6d6f21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:37.764529 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20993e3e-448c-43e1-8128-135ae6d6f21c admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:37.764814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20993e3e-448c-43e1-8128-135ae6d6f21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:37.765098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20993e3e-448c-43e1-8128-135ae6d6f21c admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:37.765842 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20993e3e-448c-43e1-8128-135ae6d6f21c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:37.769752 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20993e3e-448c-43e1-8128-135ae6d6f21c admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:37.841102 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 870/1721] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:37 2022] PUT /identity/v3/projects/440733cec22240c69c944bfd4c52d28a/users/2df056798457462a9d6cbf1bfc77ed73/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:37.842264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc5d8e-abfa-40ba-9809-22ff59606873 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:37.847621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-dacc5d8e-abfa-40ba-9809-22ff59606873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:37.931789 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 852/1722] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:37 2022] POST /identity/v3/users => generated 297 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:37.934533 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20993e3e-448c-43e1-8128-135ae6d6f21c admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:37.959252 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20993e3e-448c-43e1-8128-135ae6d6f21c admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:38.007520 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc5d8e-abfa-40ba-9809-22ff59606873 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:38.013973 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400299d-a341-4e5e-9c7e-21eb99e846d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:38.018068 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400299d-a341-4e5e-9c7e-21eb99e846d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:38.018750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400299d-a341-4e5e-9c7e-21eb99e846d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:38.019928 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400299d-a341-4e5e-9c7e-21eb99e846d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:38.037130 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400299d-a341-4e5e-9c7e-21eb99e846d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:38.038881 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400299d-a341-4e5e-9c7e-21eb99e846d6 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:38.059466 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 871/1723] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:38.060981 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400299d-a341-4e5e-9c7e-21eb99e846d6 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:38.108004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278c543-804b-45e6-a749-10c51f2b6510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:38.108899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278c543-804b-45e6-a749-10c51f2b6510 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:38.109320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278c543-804b-45e6-a749-10c51f2b6510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:38.111479 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278c543-804b-45e6-a749-10c51f2b6510 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:38.112476 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278c543-804b-45e6-a749-10c51f2b6510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:38.114418 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278c543-804b-45e6-a749-10c51f2b6510 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:38.148703 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 853/1724] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:38.149992 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278c543-804b-45e6-a749-10c51f2b6510 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:38.171640 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278c543-804b-45e6-a749-10c51f2b6510 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:38.180305 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:38.187502 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d33cc5-84de-44b3-ac99-3f5dd36c80be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:38.189998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d33cc5-84de-44b3-ac99-3f5dd36c80be admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:38.191817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d33cc5-84de-44b3-ac99-3f5dd36c80be admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:38.192225 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d33cc5-84de-44b3-ac99-3f5dd36c80be admin admin] PATH_INFO: `/v3/projects/440733cec22240c69c944bfd4c52d28a/users/2df056798457462a9d6cbf1bfc77ed73/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:38.196643 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d33cc5-84de-44b3-ac99-3f5dd36c80be admin admin] RBAC: Authorizing `identity:create_grant(project_id=440733cec22240c69c944bfd4c52d28a, user_id=2df056798457462a9d6cbf1bfc77ed73, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:38.201460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d33cc5-84de-44b3-ac99-3f5dd36c80be admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:38.223368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400299d-a341-4e5e-9c7e-21eb99e846d6 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:38.231026 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 854/1725] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:38 2022] PUT /identity/v3/projects/440733cec22240c69c944bfd4c52d28a/users/2df056798457462a9d6cbf1bfc77ed73/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:38.241720 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d33cc5-84de-44b3-ac99-3f5dd36c80be admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:38.244812 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-76d33cc5-84de-44b3-ac99-3f5dd36c80be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:38.394129 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3d4e1-1f53-4cb8-946e-f83c59347807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:38.394871 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3d4e1-1f53-4cb8-946e-f83c59347807 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:38.397028 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3d4e1-1f53-4cb8-946e-f83c59347807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:38.397620 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3d4e1-1f53-4cb8-946e-f83c59347807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:38.401040 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3d4e1-1f53-4cb8-946e-f83c59347807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:38.403611 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3d4e1-1f53-4cb8-946e-f83c59347807 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:38.418685 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d33cc5-84de-44b3-ac99-3f5dd36c80be admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:38.426087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db4832-42f0-461a-824c-31f4bad8405f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:38.428847 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db4832-42f0-461a-824c-31f4bad8405f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:38.429308 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db4832-42f0-461a-824c-31f4bad8405f admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:38.429684 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db4832-42f0-461a-824c-31f4bad8405f admin admin] PATH_INFO: `/v3/projects/e1835845a32d4355be9895f1e4e0fa8a` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:38.431421 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db4832-42f0-461a-824c-31f4bad8405f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1835845a32d4355be9895f1e4e0fa8a)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:38.434093 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 872/1726] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:38.435502 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36016675-90c5-4b4b-9117-2527ac3c98d9 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:38.435799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36016675-90c5-4b4b-9117-2527ac3c98d9 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:38.435915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db4832-42f0-461a-824c-31f4bad8405f admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:38.436132 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36016675-90c5-4b4b-9117-2527ac3c98d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:38.469452 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-36016675-90c5-4b4b-9117-2527ac3c98d9 None None] MFA Rules not processed for user `2df056798457462a9d6cbf1bfc77ed73`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:38.472253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-36016675-90c5-4b4b-9117-2527ac3c98d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:38.656716 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-77db4832-42f0-461a-824c-31f4bad8405f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1835845a32d4355be9895f1e4e0fa8a', 'request_id': 'req-77db4832-42f0-461a-824c-31f4bad8405f'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:38.681025 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-77db4832-42f0-461a-824c-31f4bad8405f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1835845a32d4355be9895f1e4e0fa8a', 'request_id': 'req-77db4832-42f0-461a-824c-31f4bad8405f'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:38.715815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 873/1727] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:38 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:38.715815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36016675-90c5-4b4b-9117-2527ac3c98d9 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:38.757053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36016675-90c5-4b4b-9117-2527ac3c98d9 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:38.860975 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-77db4832-42f0-461a-824c-31f4bad8405f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1835845a32d4355be9895f1e4e0fa8a', 'request_id': 'req-77db4832-42f0-461a-824c-31f4bad8405f'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:38.884762 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-77db4832-42f0-461a-824c-31f4bad8405f admin admin] The token cache is being invalidate because project e1835845a32d4355be9895f1e4e0fa8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:37:38.888287 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-77db4832-42f0-461a-824c-31f4bad8405f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:38.892913 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-77db4832-42f0-461a-824c-31f4bad8405f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:38.896004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 855/1728] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:37:38 2022] DELETE /identity/v3/projects/e1835845a32d4355be9895f1e4e0fa8a => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:38.896998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db4832-42f0-461a-824c-31f4bad8405f admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:38.898614 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-77db4832-42f0-461a-824c-31f4bad8405f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:38.932763 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7b9b7-ca54-4acb-b110-90d6dbecd467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:38.937010 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7b9b7-ca54-4acb-b110-90d6dbecd467 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:38.938225 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7b9b7-ca54-4acb-b110-90d6dbecd467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:38.939388 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7b9b7-ca54-4acb-b110-90d6dbecd467 admin admin] PATH_INFO: `/v3/projects/249fca9ead1f452292b264d36f0756ca/users/fbd3db7cfce1406896663bf6e1ab24a5/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:38.993376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7b9b7-ca54-4acb-b110-90d6dbecd467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=249fca9ead1f452292b264d36f0756ca, user_id=fbd3db7cfce1406896663bf6e1ab24a5, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:39.000776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7b9b7-ca54-4acb-b110-90d6dbecd467 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:39.034161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db4832-42f0-461a-824c-31f4bad8405f admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:39.090145 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccea863-d6ff-4bdb-af1b-740ea2b70943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:39.091599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccea863-d6ff-4bdb-af1b-740ea2b70943 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:39.092042 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccea863-d6ff-4bdb-af1b-740ea2b70943 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:39.092618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccea863-d6ff-4bdb-af1b-740ea2b70943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:39.095598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-cccea863-d6ff-4bdb-af1b-740ea2b70943 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:39.142333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:39.146637 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 874/1729] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:38 2022] PUT /identity/v3/projects/249fca9ead1f452292b264d36f0756ca/users/fbd3db7cfce1406896663bf6e1ab24a5/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:39.153055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7b9b7-ca54-4acb-b110-90d6dbecd467 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:39.153055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-d4b7b9b7-ca54-4acb-b110-90d6dbecd467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:39.280297 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccea863-d6ff-4bdb-af1b-740ea2b70943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:39.300864 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccea863-d6ff-4bdb-af1b-740ea2b70943 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:39.362631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 856/1730] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:38 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:39.366366 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccea863-d6ff-4bdb-af1b-740ea2b70943 service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:39.371730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-cccea863-d6ff-4bdb-af1b-740ea2b70943 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:39.413568 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccea863-d6ff-4bdb-af1b-740ea2b70943 service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:39.427083 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7b9b7-ca54-4acb-b110-90d6dbecd467 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:39.431505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1c1ae-abe5-4990-ade2-cf9f0d3c97a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:39.432510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1c1ae-abe5-4990-ade2-cf9f0d3c97a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:39.432860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1c1ae-abe5-4990-ade2-cf9f0d3c97a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:39.433204 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1c1ae-abe5-4990-ade2-cf9f0d3c97a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:39.434994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1c1ae-abe5-4990-ade2-cf9f0d3c97a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:39.436990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1c1ae-abe5-4990-ade2-cf9f0d3c97a3 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:39.450265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161672c-6679-4820-a0d1-f9fba7240991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:39.451250 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161672c-6679-4820-a0d1-f9fba7240991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:39.451538 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161672c-6679-4820-a0d1-f9fba7240991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:39.451825 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161672c-6679-4820-a0d1-f9fba7240991 admin admin] PATH_INFO: `/v3/users/b580fccab33d4b899afc3e1b547bf8bd` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:39.459398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161672c-6679-4820-a0d1-f9fba7240991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b580fccab33d4b899afc3e1b547bf8bd)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:39.466488 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161672c-6679-4820-a0d1-f9fba7240991 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:39.466999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 857/1731] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:39.468033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1c1ae-abe5-4990-ade2-cf9f0d3c97a3 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:39.470097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b4b1c1ae-abe5-4990-ade2-cf9f0d3c97a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:39.586424 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1c1ae-abe5-4990-ade2-cf9f0d3c97a3 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:39.591759 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d798d-d2bb-4b93-b6f5-231ac51e03df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38b7e84d6a43efbb4c1a52e2b3e681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:39.592567 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d798d-d2bb-4b93-b6f5-231ac51e03df service placement] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:39.592917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d798d-d2bb-4b93-b6f5-231ac51e03df service placement] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:39.593263 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d798d-d2bb-4b93-b6f5-231ac51e03df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:39.595273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-476d798d-d2bb-4b93-b6f5-231ac51e03df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:39.624160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d798d-d2bb-4b93-b6f5-231ac51e03df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:39.626131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d798d-d2bb-4b93-b6f5-231ac51e03df service placement] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:39.647475 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 858/1732] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:39.650286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d798d-d2bb-4b93-b6f5-231ac51e03df service placement] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:39.674180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d798d-d2bb-4b93-b6f5-231ac51e03df service placement] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:39.709280 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaaba73-e796-4d5f-a27c-cb4e2d56f3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:39.710994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaba73-e796-4d5f-a27c-cb4e2d56f3e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:39.711461 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaba73-e796-4d5f-a27c-cb4e2d56f3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:39.711988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaaba73-e796-4d5f-a27c-cb4e2d56f3e3 admin admin] PATH_INFO: `/v3/projects/249fca9ead1f452292b264d36f0756ca/users/fbd3db7cfce1406896663bf6e1ab24a5/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:39.717229 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaaba73-e796-4d5f-a27c-cb4e2d56f3e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=249fca9ead1f452292b264d36f0756ca, user_id=fbd3db7cfce1406896663bf6e1ab24a5, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:39.738225 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaaba73-e796-4d5f-a27c-cb4e2d56f3e3 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:39.789370 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 859/1733] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:39 2022] PUT /identity/v3/projects/249fca9ead1f452292b264d36f0756ca/users/fbd3db7cfce1406896663bf6e1ab24a5/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:39.803713 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4161672c-6679-4820-a0d1-f9fba7240991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b580fccab33d4b899afc3e1b547bf8bd'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:39.803847 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e434b3-08be-45f5-925a-af42f19f2736 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:39.805148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e434b3-08be-45f5-925a-af42f19f2736 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:39.805561 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e434b3-08be-45f5-925a-af42f19f2736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:39.840002 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4161672c-6679-4820-a0d1-f9fba7240991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b580fccab33d4b899afc3e1b547bf8bd'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:39.842346 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-70e434b3-08be-45f5-925a-af42f19f2736 None None] MFA Rules not processed for user `017d2074ad8742ca8bd156593c591b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:39.844819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-70e434b3-08be-45f5-925a-af42f19f2736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:39.857164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4161672c-6679-4820-a0d1-f9fba7240991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b580fccab33d4b899afc3e1b547bf8bd'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:39.859255 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4161672c-6679-4820-a0d1-f9fba7240991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b580fccab33d4b899afc3e1b547bf8bd'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:39.861750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4161672c-6679-4820-a0d1-f9fba7240991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b580fccab33d4b899afc3e1b547bf8bd'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:39.980619 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 875/1734] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:37:39 2022] DELETE /identity/v3/users/b580fccab33d4b899afc3e1b547bf8bd => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:39.982082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4544fd5-2cdc-4dd8-8bcd-ff8b31e698b0 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:39.982376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4544fd5-2cdc-4dd8-8bcd-ff8b31e698b0 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:39.982661 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4544fd5-2cdc-4dd8-8bcd-ff8b31e698b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:39.995212 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 860/1735] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:40.090513 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-b4544fd5-2cdc-4dd8-8bcd-ff8b31e698b0 None None] MFA Rules not processed for user `fbd3db7cfce1406896663bf6e1ab24a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:40.090707 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b4544fd5-2cdc-4dd8-8bcd-ff8b31e698b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:40.124449 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923405b-5d46-4ccd-b827-d9ccc53abc06 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:40.125070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923405b-5d46-4ccd-b827-d9ccc53abc06 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:40.125502 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923405b-5d46-4ccd-b827-d9ccc53abc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:40.174102 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-b923405b-5d46-4ccd-b827-d9ccc53abc06 None None] MFA Rules not processed for user `a8e20ceefdcd48c88cf35ecf0bcd736b`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:40.179731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b923405b-5d46-4ccd-b827-d9ccc53abc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:40.296672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 861/1736] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:40.332696 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 876/1737] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:40.472073 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923405b-5d46-4ccd-b827-d9ccc53abc06 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:40.475228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b923405b-5d46-4ccd-b827-d9ccc53abc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:40.605886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923405b-5d46-4ccd-b827-d9ccc53abc06 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:40.610713 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb5f3f-fc91-4bca-b60c-a3409f22b9d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:40.611750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb5f3f-fc91-4bca-b60c-a3409f22b9d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:40.611861 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb5f3f-fc91-4bca-b60c-a3409f22b9d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:40.612095 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb5f3f-fc91-4bca-b60c-a3409f22b9d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:40.625152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb5f3f-fc91-4bca-b60c-a3409f22b9d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:40.628091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb5f3f-fc91-4bca-b60c-a3409f22b9d8 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:40.656997 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 862/1738] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:40.746347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4544fd5-2cdc-4dd8-8bcd-ff8b31e698b0 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:40.748021 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b4544fd5-2cdc-4dd8-8bcd-ff8b31e698b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:40.893503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:INSERT=5,keystone:SELECT=90,keystone:DELETE=5 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:40.950467 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:40.952817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb5f3f-fc91-4bca-b60c-a3409f22b9d8 service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:40.967247 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb5f3f-fc91-4bca-b60c-a3409f22b9d8 service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:40.984799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d79e7-2ac6-4c99-882c-9775f488aca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:40.985200 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4544fd5-2cdc-4dd8-8bcd-ff8b31e698b0 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:40.985473 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d79e7-2ac6-4c99-882c-9775f488aca7 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:40.985796 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d79e7-2ac6-4c99-882c-9775f488aca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:40.986229 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d79e7-2ac6-4c99-882c-9775f488aca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:40.991253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-850d79e7-2ac6-4c99-882c-9775f488aca7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:41.006690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910f273-068f-4564-8d44-7024981ee0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:41.007650 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910f273-068f-4564-8d44-7024981ee0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:41.007934 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910f273-068f-4564-8d44-7024981ee0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:41.008206 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910f273-068f-4564-8d44-7024981ee0b7 admin admin] PATH_INFO: `/v3/users/9f548ac36802406188408fc965d0a932` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:41.010249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910f273-068f-4564-8d44-7024981ee0b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f548ac36802406188408fc965d0a932)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:41.012294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a910f273-068f-4564-8d44-7024981ee0b7 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:41.154614 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d79e7-2ac6-4c99-882c-9775f488aca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:41.156188 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d79e7-2ac6-4c99-882c-9775f488aca7 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:41.179073 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 863/1739] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:41.230941 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d79e7-2ac6-4c99-882c-9775f488aca7 service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:41.233268 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-850d79e7-2ac6-4c99-882c-9775f488aca7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:41.252566 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d79e7-2ac6-4c99-882c-9775f488aca7 service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:41.259552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcbba4-165e-45b3-8b31-a1fe7e7d8dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:41.261694 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcbba4-165e-45b3-8b31-a1fe7e7d8dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:41.262138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcbba4-165e-45b3-8b31-a1fe7e7d8dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:41.262644 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcbba4-165e-45b3-8b31-a1fe7e7d8dcb admin admin] PATH_INFO: `/v3/projects/a2f7f7934f1e4e28abdd5b52339eecb8` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:41.264222 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcbba4-165e-45b3-8b31-a1fe7e7d8dcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f7f7934f1e4e28abdd5b52339eecb8)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:41.268091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcbba4-165e-45b3-8b31-a1fe7e7d8dcb admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:41.289970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a910f273-068f-4564-8d44-7024981ee0b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f548ac36802406188408fc965d0a932'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:41.315335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a910f273-068f-4564-8d44-7024981ee0b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f548ac36802406188408fc965d0a932'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:41.322824 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a910f273-068f-4564-8d44-7024981ee0b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f548ac36802406188408fc965d0a932'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:41.323576 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a910f273-068f-4564-8d44-7024981ee0b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f548ac36802406188408fc965d0a932'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:41.324202 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a910f273-068f-4564-8d44-7024981ee0b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f548ac36802406188408fc965d0a932'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:41.448166 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 877/1740] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:37:40 2022] DELETE /identity/v3/users/9f548ac36802406188408fc965d0a932 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:41.452689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165d997-97c8-45f4-a72d-c5d566b4cb9d None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:41.452979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165d997-97c8-45f4-a72d-c5d566b4cb9d None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:41.453251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165d997-97c8-45f4-a72d-c5d566b4cb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:41.476584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-5bfcbba4-165e-45b3-8b31-a1fe7e7d8dcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f7f7934f1e4e28abdd5b52339eecb8', 'request_id': 'req-5bfcbba4-165e-45b3-8b31-a1fe7e7d8dcb'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:41.485941 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-5bfcbba4-165e-45b3-8b31-a1fe7e7d8dcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f7f7934f1e4e28abdd5b52339eecb8', 'request_id': 'req-5bfcbba4-165e-45b3-8b31-a1fe7e7d8dcb'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:41.486632 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-f165d997-97c8-45f4-a72d-c5d566b4cb9d None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:41.488556 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f165d997-97c8-45f4-a72d-c5d566b4cb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:41.592344 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-5bfcbba4-165e-45b3-8b31-a1fe7e7d8dcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f7f7934f1e4e28abdd5b52339eecb8', 'request_id': 'req-5bfcbba4-165e-45b3-8b31-a1fe7e7d8dcb'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:41.594093 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 878/1741] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:41.618305 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a0ab9-7d4d-4d14-893f-80e934305916 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:41.618498 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-5bfcbba4-165e-45b3-8b31-a1fe7e7d8dcb admin admin] The token cache is being invalidate because project a2f7f7934f1e4e28abdd5b52339eecb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:37:41.618792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-5bfcbba4-165e-45b3-8b31-a1fe7e7d8dcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:41.619736 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a0ab9-7d4d-4d14-893f-80e934305916 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:41.620071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-5bfcbba4-165e-45b3-8b31-a1fe7e7d8dcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:41.620640 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a0ab9-7d4d-4d14-893f-80e934305916 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:41.625931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 879/1742] 10.222.0.57 () {54 vars in 912 bytes} [Thu Jul 21 08:37:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 08:37:41.647763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 864/1743] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:37:41 2022] DELETE /identity/v3/projects/a2f7f7934f1e4e28abdd5b52339eecb8 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:41.649107 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afd2e3-1f36-4282-8859-e46b5e024134 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:41.649434 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afd2e3-1f36-4282-8859-e46b5e024134 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:41.649749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afd2e3-1f36-4282-8859-e46b5e024134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:41.658636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785d6aa-1410-4a5f-88ee-6478ec5f0bc6 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:41.658935 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785d6aa-1410-4a5f-88ee-6478ec5f0bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:41.659824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785d6aa-1410-4a5f-88ee-6478ec5f0bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:41.693880 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-a785d6aa-1410-4a5f-88ee-6478ec5f0bc6 None None] MFA Rules not processed for user `a25749f3a7c84c50b860538d1b661901`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:41.693880 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a785d6aa-1410-4a5f-88ee-6478ec5f0bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:41.707148 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-32afd2e3-1f36-4282-8859-e46b5e024134 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:41.708414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-32afd2e3-1f36-4282-8859-e46b5e024134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:41.766644 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 880/1744] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:41.767964 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afd2e3-1f36-4282-8859-e46b5e024134 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:41.776234 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-32afd2e3-1f36-4282-8859-e46b5e024134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:41.868513 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 865/1745] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 08:37:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:41.870557 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0d111-92d6-464b-b069-4ee1ba33c9d7 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:41.870557 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0d111-92d6-464b-b069-4ee1ba33c9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:41.870688 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0d111-92d6-464b-b069-4ee1ba33c9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:41.918839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-fca0d111-92d6-464b-b069-4ee1ba33c9d7 None None] MFA Rules not processed for user `e8da794aec2f4d80a79e7c16a611f6f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:41.921302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-fca0d111-92d6-464b-b069-4ee1ba33c9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:41.990576 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afd2e3-1f36-4282-8859-e46b5e024134 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:42.007242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c635e6f-f4af-4496-9ab9-d72e7af38edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:42.008305 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c635e6f-f4af-4496-9ab9-d72e7af38edf service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:42.008725 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c635e6f-f4af-4496-9ab9-d72e7af38edf service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:42.009137 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c635e6f-f4af-4496-9ab9-d72e7af38edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:42.015675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-9c635e6f-f4af-4496-9ab9-d72e7af38edf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:42.040730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c635e6f-f4af-4496-9ab9-d72e7af38edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:42.042235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c635e6f-f4af-4496-9ab9-d72e7af38edf service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:42.078377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 881/1746] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:42.095740 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d4c6-142c-4894-9573-ca70da69c9ea None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:42.098138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d4c6-142c-4894-9573-ca70da69c9ea None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:42.098448 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d4c6-142c-4894-9573-ca70da69c9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:42.104962 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 866/1747] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:42.106541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0d111-92d6-464b-b069-4ee1ba33c9d7 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:42.137438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0d111-92d6-464b-b069-4ee1ba33c9d7 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:42.137669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-c502d4c6-142c-4894-9573-ca70da69c9ea None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:42.138907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-c502d4c6-142c-4894-9573-ca70da69c9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:42.151360 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc779a68-ec81-478e-bf9b-1956c2851224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:42.152106 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc779a68-ec81-478e-bf9b-1956c2851224 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:42.152394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc779a68-ec81-478e-bf9b-1956c2851224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:42.152665 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc779a68-ec81-478e-bf9b-1956c2851224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:42.175656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 882/1748] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:42.178863 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f10ff-7045-412f-9bad-2fb0e7848706 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:42.179157 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f10ff-7045-412f-9bad-2fb0e7848706 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:42.179441 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f10ff-7045-412f-9bad-2fb0e7848706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:42.180079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc779a68-ec81-478e-bf9b-1956c2851224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:42.184528 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc779a68-ec81-478e-bf9b-1956c2851224 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:42.209453 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 867/1749] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:42.213008 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6547c-e3eb-42f1-9df9-443275485600 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:42.213354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6547c-e3eb-42f1-9df9-443275485600 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:42.213665 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6547c-e3eb-42f1-9df9-443275485600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:42.267498 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-9ac6547c-e3eb-42f1-9df9-443275485600 None None] MFA Rules not processed for user `e8da794aec2f4d80a79e7c16a611f6f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:42.268655 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9ac6547c-e3eb-42f1-9df9-443275485600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:42.278803 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-428f10ff-7045-412f-9bad-2fb0e7848706 None None] MFA Rules not processed for user `fb4b22bc322c419bab3445f7dfb186fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:42.283625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-428f10ff-7045-412f-9bad-2fb0e7848706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:42.313340 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 868/1750] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:42.313848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6547c-e3eb-42f1-9df9-443275485600 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:42.386899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6547c-e3eb-42f1-9df9-443275485600 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:42.410097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c19ccd-da9e-44d9-827b-3a5054926b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:42.415384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c19ccd-da9e-44d9-827b-3a5054926b8f admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:42.425131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c19ccd-da9e-44d9-827b-3a5054926b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:42.425818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c19ccd-da9e-44d9-827b-3a5054926b8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:42.426809 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c19ccd-da9e-44d9-827b-3a5054926b8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:37:42.427273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c19ccd-da9e-44d9-827b-3a5054926b8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:42.429134 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c19ccd-da9e-44d9-827b-3a5054926b8f admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:42.477354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 883/1751] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:42.478219 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 869/1752] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:37:42.481637 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f10ff-7045-412f-9bad-2fb0e7848706 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:42.531809 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f10ff-7045-412f-9bad-2fb0e7848706 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:42.567969 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae348ee-3b18-4b68-8821-816ab7701449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:42.569886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae348ee-3b18-4b68-8821-816ab7701449 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:42.570185 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae348ee-3b18-4b68-8821-816ab7701449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:42.570472 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae348ee-3b18-4b68-8821-816ab7701449 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:42.575315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae348ee-3b18-4b68-8821-816ab7701449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:42.578743 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae348ee-3b18-4b68-8821-816ab7701449 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:42.735160 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 884/1753] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:42 2022] POST /identity/v3/projects => generated 385 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:42.741584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c19ccd-da9e-44d9-827b-3a5054926b8f admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:42.787004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c19ccd-da9e-44d9-827b-3a5054926b8f admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:42.965187 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71177f-0271-4694-8730-6ec161e1c25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:42.967798 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71177f-0271-4694-8730-6ec161e1c25d admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:42.968814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71177f-0271-4694-8730-6ec161e1c25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:42.969871 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71177f-0271-4694-8730-6ec161e1c25d admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:42.972089 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71177f-0271-4694-8730-6ec161e1c25d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:42.977510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71177f-0271-4694-8730-6ec161e1c25d admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:43.115100 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 870/1754] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:42 2022] POST /identity/v3/users => generated 293 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:43.131558 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae348ee-3b18-4b68-8821-816ab7701449 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:43.143669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae348ee-3b18-4b68-8821-816ab7701449 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:43.164052 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff463e0-a5ab-4e1e-8f49-ee26dc88fcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:43.165265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff463e0-a5ab-4e1e-8f49-ee26dc88fcac admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:43.165744 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff463e0-a5ab-4e1e-8f49-ee26dc88fcac admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:43.166496 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff463e0-a5ab-4e1e-8f49-ee26dc88fcac admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:43.167370 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff463e0-a5ab-4e1e-8f49-ee26dc88fcac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:43.169147 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff463e0-a5ab-4e1e-8f49-ee26dc88fcac admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:43.203672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 885/1755] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:43.209156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71177f-0271-4694-8730-6ec161e1c25d admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:43.229307 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71177f-0271-4694-8730-6ec161e1c25d admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:43.254188 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcadda6-74c4-49d3-9de9-b4e12b08b783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:43.254919 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcadda6-74c4-49d3-9de9-b4e12b08b783 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:43.255202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcadda6-74c4-49d3-9de9-b4e12b08b783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:43.255473 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcadda6-74c4-49d3-9de9-b4e12b08b783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:43.256366 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcadda6-74c4-49d3-9de9-b4e12b08b783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:43.258093 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcadda6-74c4-49d3-9de9-b4e12b08b783 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:43.259596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff463e0-a5ab-4e1e-8f49-ee26dc88fcac admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:43.261601 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-fff463e0-a5ab-4e1e-8f49-ee26dc88fcac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:43.314435 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 871/1756] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:43.316587 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcadda6-74c4-49d3-9de9-b4e12b08b783 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:43.336436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcadda6-74c4-49d3-9de9-b4e12b08b783 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:43.365455 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fdeb2a-0c9c-4d5c-a529-9f54b55081fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:43.369861 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdeb2a-0c9c-4d5c-a529-9f54b55081fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:43.370284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdeb2a-0c9c-4d5c-a529-9f54b55081fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:43.371468 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fdeb2a-0c9c-4d5c-a529-9f54b55081fe admin admin] PATH_INFO: `/v3/projects/ce3a418d534d4117a7e4b4cf2e7a3da7/users/6e098b1b9eee400eacb64293c3cc100f/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:43.432412 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fdeb2a-0c9c-4d5c-a529-9f54b55081fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3a418d534d4117a7e4b4cf2e7a3da7, user_id=6e098b1b9eee400eacb64293c3cc100f, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:43.438780 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fdeb2a-0c9c-4d5c-a529-9f54b55081fe admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:43.541260 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 872/1757] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:43 2022] PUT /identity/v3/projects/ce3a418d534d4117a7e4b4cf2e7a3da7/users/6e098b1b9eee400eacb64293c3cc100f/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:43.542897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff463e0-a5ab-4e1e-8f49-ee26dc88fcac admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:43.552557 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510465b-c4da-4e44-9e7c-308e059a4134 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:43.553102 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510465b-c4da-4e44-9e7c-308e059a4134 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:43.553557 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510465b-c4da-4e44-9e7c-308e059a4134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:43.610576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-c510465b-c4da-4e44-9e7c-308e059a4134 None None] MFA Rules not processed for user `6e098b1b9eee400eacb64293c3cc100f`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:43.614493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c510465b-c4da-4e44-9e7c-308e059a4134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:43.699280 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:43.753573 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623ebdd-03ee-4aad-b7e4-6e58d9084f29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:43.754254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623ebdd-03ee-4aad-b7e4-6e58d9084f29 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:43.754543 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623ebdd-03ee-4aad-b7e4-6e58d9084f29 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:43.754823 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623ebdd-03ee-4aad-b7e4-6e58d9084f29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:43.806670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 873/1758] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:43.815525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510465b-c4da-4e44-9e7c-308e059a4134 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:43.815525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c510465b-c4da-4e44-9e7c-308e059a4134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:43.877326 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:43.934657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623ebdd-03ee-4aad-b7e4-6e58d9084f29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:43.936286 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623ebdd-03ee-4aad-b7e4-6e58d9084f29 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:43.957854 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 886/1759] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:43.958754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623ebdd-03ee-4aad-b7e4-6e58d9084f29 service nova] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:43.960169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510465b-c4da-4e44-9e7c-308e059a4134 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:43.992037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c9d85-0233-4dd5-86a0-fc0c4dd34318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:43.993000 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c9d85-0233-4dd5-86a0-fc0c4dd34318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:43.993277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c9d85-0233-4dd5-86a0-fc0c4dd34318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:43.993578 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c9d85-0233-4dd5-86a0-fc0c4dd34318 admin admin] PATH_INFO: `/v3/projects/c0c11807d9274a2a8e630a8df3311729` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:43.995996 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c9d85-0233-4dd5-86a0-fc0c4dd34318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0c11807d9274a2a8e630a8df3311729)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:43.999077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c9d85-0233-4dd5-86a0-fc0c4dd34318 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:44.016890 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623ebdd-03ee-4aad-b7e4-6e58d9084f29 service nova] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:44.032203 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad703839-e0d7-452e-a7dd-6422ab4bcab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:44.032964 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad703839-e0d7-452e-a7dd-6422ab4bcab2 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:44.033354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad703839-e0d7-452e-a7dd-6422ab4bcab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:44.033879 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad703839-e0d7-452e-a7dd-6422ab4bcab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:44.035479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad703839-e0d7-452e-a7dd-6422ab4bcab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:44.037941 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad703839-e0d7-452e-a7dd-6422ab4bcab2 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:44.196510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-1c7c9d85-0233-4dd5-86a0-fc0c4dd34318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0c11807d9274a2a8e630a8df3311729', 'request_id': 'req-1c7c9d85-0233-4dd5-86a0-fc0c4dd34318'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:44.212781 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-1c7c9d85-0233-4dd5-86a0-fc0c4dd34318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0c11807d9274a2a8e630a8df3311729', 'request_id': 'req-1c7c9d85-0233-4dd5-86a0-fc0c4dd34318'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:44.214368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 887/1760] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:43 2022] POST /identity/v3/projects => generated 385 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:44.215410 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad703839-e0d7-452e-a7dd-6422ab4bcab2 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:44.219921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ad703839-e0d7-452e-a7dd-6422ab4bcab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:44.354799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-1c7c9d85-0233-4dd5-86a0-fc0c4dd34318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0c11807d9274a2a8e630a8df3311729', 'request_id': 'req-1c7c9d85-0233-4dd5-86a0-fc0c4dd34318'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:44.377067 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad703839-e0d7-452e-a7dd-6422ab4bcab2 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:44.390769 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-1c7c9d85-0233-4dd5-86a0-fc0c4dd34318 admin admin] The token cache is being invalidate because project c0c11807d9274a2a8e630a8df3311729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:37:44.392071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-1c7c9d85-0233-4dd5-86a0-fc0c4dd34318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:44.401103 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-1c7c9d85-0233-4dd5-86a0-fc0c4dd34318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:44.407986 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 874/1761] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:37:43 2022] DELETE /identity/v3/projects/c0c11807d9274a2a8e630a8df3311729 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:44.407986 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c9d85-0233-4dd5-86a0-fc0c4dd34318 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:44.419689 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-1c7c9d85-0233-4dd5-86a0-fc0c4dd34318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:44.423516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cfc3a-12f4-41aa-9fa4-bc608d4fcc9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:44.425684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cfc3a-12f4-41aa-9fa4-bc608d4fcc9b service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:44.426229 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cfc3a-12f4-41aa-9fa4-bc608d4fcc9b service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:44.428246 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81cfc3a-12f4-41aa-9fa4-bc608d4fcc9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:44.435644 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f81cfc3a-12f4-41aa-9fa4-bc608d4fcc9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:44.547458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c9d85-0233-4dd5-86a0-fc0c4dd34318 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:44.610469 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81cfc3a-12f4-41aa-9fa4-bc608d4fcc9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:44.613099 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81cfc3a-12f4-41aa-9fa4-bc608d4fcc9b service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:44.647505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 888/1762] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:44.648239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cfc3a-12f4-41aa-9fa4-bc608d4fcc9b service nova] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:44.649919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f81cfc3a-12f4-41aa-9fa4-bc608d4fcc9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:44.716564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27c109-d883-4c3e-aab4-a63d8cd8e2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:44.719374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27c109-d883-4c3e-aab4-a63d8cd8e2ad admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:44.719832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27c109-d883-4c3e-aab4-a63d8cd8e2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:44.720290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27c109-d883-4c3e-aab4-a63d8cd8e2ad admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:44.722833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27c109-d883-4c3e-aab4-a63d8cd8e2ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:44.725788 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27c109-d883-4c3e-aab4-a63d8cd8e2ad admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:44.879456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81cfc3a-12f4-41aa-9fa4-bc608d4fcc9b service nova] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:44.887675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af67dd-7298-490b-b862-5a90c000aefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:44.887675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af67dd-7298-490b-b862-5a90c000aefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:44.887675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af67dd-7298-490b-b862-5a90c000aefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:44.887675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af67dd-7298-490b-b862-5a90c000aefb admin admin] PATH_INFO: `/v3/users/4027ea3f8f424b718a472a100ccd38c5` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:44.888471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af67dd-7298-490b-b862-5a90c000aefb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4027ea3f8f424b718a472a100ccd38c5)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:44.890566 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af67dd-7298-490b-b862-5a90c000aefb admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:44.978004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 875/1763] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:44 2022] POST /identity/v3/users => generated 299 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:44.979343 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27c109-d883-4c3e-aab4-a63d8cd8e2ad admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:44.982132 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-3c27c109-d883-4c3e-aab4-a63d8cd8e2ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:44.992819 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:45.005857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27c109-d883-4c3e-aab4-a63d8cd8e2ad admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:45.022216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180dc86a-c928-4cee-a5ac-31643893dd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:45.023377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dc86a-c928-4cee-a5ac-31643893dd20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:45.023758 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dc86a-c928-4cee-a5ac-31643893dd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:45.024101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180dc86a-c928-4cee-a5ac-31643893dd20 admin admin] PATH_INFO: `/v3/users/8f34c1df84b74664965afd6c5bdfb4af` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:45.025646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180dc86a-c928-4cee-a5ac-31643893dd20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f34c1df84b74664965afd6c5bdfb4af)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:45.030636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180dc86a-c928-4cee-a5ac-31643893dd20 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:45.142676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-53af67dd-7298-490b-b862-5a90c000aefb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4027ea3f8f424b718a472a100ccd38c5'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:45.169961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-53af67dd-7298-490b-b862-5a90c000aefb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4027ea3f8f424b718a472a100ccd38c5'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:45.202106 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-53af67dd-7298-490b-b862-5a90c000aefb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4027ea3f8f424b718a472a100ccd38c5'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:45.204401 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-53af67dd-7298-490b-b862-5a90c000aefb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4027ea3f8f424b718a472a100ccd38c5'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:45.205069 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-53af67dd-7298-490b-b862-5a90c000aefb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4027ea3f8f424b718a472a100ccd38c5'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:45.307564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 889/1764] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:37:44 2022] DELETE /identity/v3/users/4027ea3f8f424b718a472a100ccd38c5 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:45.311703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af67dd-7298-490b-b862-5a90c000aefb admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:45.313328 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-53af67dd-7298-490b-b862-5a90c000aefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:45.325711 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-180dc86a-c928-4cee-a5ac-31643893dd20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f34c1df84b74664965afd6c5bdfb4af'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:45.369849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-180dc86a-c928-4cee-a5ac-31643893dd20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f34c1df84b74664965afd6c5bdfb4af'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:45.397959 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-180dc86a-c928-4cee-a5ac-31643893dd20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f34c1df84b74664965afd6c5bdfb4af'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:45.398746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-180dc86a-c928-4cee-a5ac-31643893dd20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f34c1df84b74664965afd6c5bdfb4af'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:45.399378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-180dc86a-c928-4cee-a5ac-31643893dd20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f34c1df84b74664965afd6c5bdfb4af'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:45.509964 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 876/1765] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:37:44 2022] DELETE /identity/v3/users/8f34c1df84b74664965afd6c5bdfb4af => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:45.515435 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05039b23-b2be-4e1d-8c6b-09ef20c2ddce None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:45.515944 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05039b23-b2be-4e1d-8c6b-09ef20c2ddce None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:45.516372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05039b23-b2be-4e1d-8c6b-09ef20c2ddce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:45.518805 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af67dd-7298-490b-b862-5a90c000aefb admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:45.588553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-05039b23-b2be-4e1d-8c6b-09ef20c2ddce None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:45.589836 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-05039b23-b2be-4e1d-8c6b-09ef20c2ddce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:45.683062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1c125-424f-46c2-9666-c3af567538e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:45.683762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1c125-424f-46c2-9666-c3af567538e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:45.684045 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1c125-424f-46c2-9666-c3af567538e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:45.684321 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1c125-424f-46c2-9666-c3af567538e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:45.685066 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1c125-424f-46c2-9666-c3af567538e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:45.689290 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1c125-424f-46c2-9666-c3af567538e3 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:45.727265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 890/1766] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:45.730978 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8731c1e-69fc-48e8-b612-317ac66b675f None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:45.735699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8731c1e-69fc-48e8-b612-317ac66b675f None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:45.736082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8731c1e-69fc-48e8-b612-317ac66b675f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:45.814738 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 877/1767] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:45.815764 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05039b23-b2be-4e1d-8c6b-09ef20c2ddce None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:45.820123 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-05039b23-b2be-4e1d-8c6b-09ef20c2ddce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:45.851884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05039b23-b2be-4e1d-8c6b-09ef20c2ddce None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:45.863187 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63505763-f8b4-41bd-a02c-932f10d37d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:45.864395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63505763-f8b4-41bd-a02c-932f10d37d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:45.864825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63505763-f8b4-41bd-a02c-932f10d37d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:45.865396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63505763-f8b4-41bd-a02c-932f10d37d38 admin admin] PATH_INFO: `/v3/projects/4f287676940346aaaded9487ccf45c00/users/96e1136f95c74d149112b63e4eb7c1a6/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:45.912712 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63505763-f8b4-41bd-a02c-932f10d37d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f287676940346aaaded9487ccf45c00, user_id=96e1136f95c74d149112b63e4eb7c1a6, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:45.926742 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63505763-f8b4-41bd-a02c-932f10d37d38 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:45.933644 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-d8731c1e-69fc-48e8-b612-317ac66b675f None None] MFA Rules not processed for user `22750d44d710439da1d18a78419b1adf`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:45.934887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-d8731c1e-69fc-48e8-b612-317ac66b675f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:46.079146 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 878/1768] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:45 2022] PUT /identity/v3/projects/4f287676940346aaaded9487ccf45c00/users/96e1136f95c74d149112b63e4eb7c1a6/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:46.081360 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63505763-f8b4-41bd-a02c-932f10d37d38 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:46.082944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 891/1769] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 08:37:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:46.084160 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8731c1e-69fc-48e8-b612-317ac66b675f None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:46.106549 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-63505763-f8b4-41bd-a02c-932f10d37d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:46.114645 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8731c1e-69fc-48e8-b612-317ac66b675f None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:46.216328 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bedd7-7a9c-487a-bb95-9291329b5862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:46.220634 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bedd7-7a9c-487a-bb95-9291329b5862 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:46.240237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bedd7-7a9c-487a-bb95-9291329b5862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:46.243637 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79bedd7-7a9c-487a-bb95-9291329b5862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:46.244300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bedd7-7a9c-487a-bb95-9291329b5862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:46.251611 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79bedd7-7a9c-487a-bb95-9291329b5862 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:46.334179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63505763-f8b4-41bd-a02c-932f10d37d38 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:46.358954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 892/1770] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:46.365562 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bedd7-7a9c-487a-bb95-9291329b5862 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:46.370537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7de22d-920b-4cef-bd4c-f08ad9a3b46d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:46.371460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7de22d-920b-4cef-bd4c-f08ad9a3b46d service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:46.371916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7de22d-920b-4cef-bd4c-f08ad9a3b46d service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:46.372605 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7de22d-920b-4cef-bd4c-f08ad9a3b46d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:46.399529 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7de22d-920b-4cef-bd4c-f08ad9a3b46d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:46.401255 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7de22d-920b-4cef-bd4c-f08ad9a3b46d service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:46.415462 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79bedd7-7a9c-487a-bb95-9291329b5862 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:46.416762 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 879/1771] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:46.457404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acf8f6-31f0-4810-8297-f4b96f6aeae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:46.478855 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acf8f6-31f0-4810-8297-f4b96f6aeae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:46.483438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acf8f6-31f0-4810-8297-f4b96f6aeae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:46.483755 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6acf8f6-31f0-4810-8297-f4b96f6aeae9 admin admin] PATH_INFO: `/v3/projects/4f287676940346aaaded9487ccf45c00/users/96e1136f95c74d149112b63e4eb7c1a6/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:46.498729 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6acf8f6-31f0-4810-8297-f4b96f6aeae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f287676940346aaaded9487ccf45c00, user_id=96e1136f95c74d149112b63e4eb7c1a6, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:46.515947 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6acf8f6-31f0-4810-8297-f4b96f6aeae9 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:46.559601 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 893/1772] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:46 2022] PUT /identity/v3/projects/4f287676940346aaaded9487ccf45c00/users/96e1136f95c74d149112b63e4eb7c1a6/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:46.570739 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aa34c-ec95-4017-a4c8-fcae4088b3c3 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:46.571066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aa34c-ec95-4017-a4c8-fcae4088b3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:46.571348 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aa34c-ec95-4017-a4c8-fcae4088b3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:46.607021 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acf8f6-31f0-4810-8297-f4b96f6aeae9 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:46.609425 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f6acf8f6-31f0-4810-8297-f4b96f6aeae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:46.617808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-be6aa34c-ec95-4017-a4c8-fcae4088b3c3 None None] MFA Rules not processed for user `96e1136f95c74d149112b63e4eb7c1a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:46.620377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-be6aa34c-ec95-4017-a4c8-fcae4088b3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:46.703591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:46.775785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:46.922497 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6acf8f6-31f0-4810-8297-f4b96f6aeae9 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:46.929571 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 880/1773] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:46.951863 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d59bc-618d-40c9-bb55-e1bbfa4543ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e349e5dfcd74406b922d3d1ce0fa5ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:46.961389 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d59bc-618d-40c9-bb55-e1bbfa4543ba service swift] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:46.961389 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d59bc-618d-40c9-bb55-e1bbfa4543ba service swift] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:46.961389 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d59bc-618d-40c9-bb55-e1bbfa4543ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:46.966625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6aa34c-ec95-4017-a4c8-fcae4088b3c3 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:46.969327 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-be6aa34c-ec95-4017-a4c8-fcae4088b3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:47.128036 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6aa34c-ec95-4017-a4c8-fcae4088b3c3 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:47.132602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4e77a-fa57-4234-bc15-583ca5d99c37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:47.133685 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4e77a-fa57-4234-bc15-583ca5d99c37 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:47.134123 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4e77a-fa57-4234-bc15-583ca5d99c37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:47.134546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4e77a-fa57-4234-bc15-583ca5d99c37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:47.147431 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4e77a-fa57-4234-bc15-583ca5d99c37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:47.149180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4e77a-fa57-4234-bc15-583ca5d99c37 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:47.161662 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 881/1774] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:37:47.163514 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d59bc-618d-40c9-bb55-e1bbfa4543ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:47.166972 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d59bc-618d-40c9-bb55-e1bbfa4543ba service swift] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:47.192548 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 894/1775] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 08:37:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 08:37:47.632495 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4e77a-fa57-4234-bc15-583ca5d99c37 service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:47.632495 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-54f4e77a-fa57-4234-bc15-583ca5d99c37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:47.739674 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4e77a-fa57-4234-bc15-583ca5d99c37 service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:47.745273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0fa0ac-eeb9-4126-b444-aa30e00c16ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:47.746266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fa0ac-eeb9-4126-b444-aa30e00c16ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:47.746656 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fa0ac-eeb9-4126-b444-aa30e00c16ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:47.746978 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fa0ac-eeb9-4126-b444-aa30e00c16ef admin admin] PATH_INFO: `/v3/projects/9992e13fae97416d8f43c35c8a3fe600` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:47.748242 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fa0ac-eeb9-4126-b444-aa30e00c16ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=9992e13fae97416d8f43c35c8a3fe600)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:47.750334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0fa0ac-eeb9-4126-b444-aa30e00c16ef admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:47.910088 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d59bc-618d-40c9-bb55-e1bbfa4543ba service swift] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:47.911522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-cc8d59bc-618d-40c9-bb55-e1bbfa4543ba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:47.918801 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-2a0fa0ac-eeb9-4126-b444-aa30e00c16ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9992e13fae97416d8f43c35c8a3fe600', 'request_id': 'req-2a0fa0ac-eeb9-4126-b444-aa30e00c16ef'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:47.926207 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-2a0fa0ac-eeb9-4126-b444-aa30e00c16ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9992e13fae97416d8f43c35c8a3fe600', 'request_id': 'req-2a0fa0ac-eeb9-4126-b444-aa30e00c16ef'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:47.926613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d59bc-618d-40c9-bb55-e1bbfa4543ba service swift] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:47.998046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aec944-9311-44ee-aed3-b92c55c86545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:47.999187 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aec944-9311-44ee-aed3-b92c55c86545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:47.999474 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aec944-9311-44ee-aed3-b92c55c86545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:47.999750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aec944-9311-44ee-aed3-b92c55c86545 admin admin] PATH_INFO: `/v3/projects/73da960c77754f4fbd4239b569a5978d` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:48.001239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aec944-9311-44ee-aed3-b92c55c86545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73da960c77754f4fbd4239b569a5978d)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:48.002909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aec944-9311-44ee-aed3-b92c55c86545 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:48.014820 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-2a0fa0ac-eeb9-4126-b444-aa30e00c16ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9992e13fae97416d8f43c35c8a3fe600', 'request_id': 'req-2a0fa0ac-eeb9-4126-b444-aa30e00c16ef'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:48.028434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-2a0fa0ac-eeb9-4126-b444-aa30e00c16ef admin admin] The token cache is being invalidate because project 9992e13fae97416d8f43c35c8a3fe600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:37:48.028845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-2a0fa0ac-eeb9-4126-b444-aa30e00c16ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:48.029793 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-2a0fa0ac-eeb9-4126-b444-aa30e00c16ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:48.031943 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 882/1776] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:37:47 2022] DELETE /identity/v3/projects/9992e13fae97416d8f43c35c8a3fe600 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:48.036813 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fa98c-22d5-4180-8fdf-bc768e5bb247 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:48.037603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fa98c-22d5-4180-8fdf-bc768e5bb247 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:48.039760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fa98c-22d5-4180-8fdf-bc768e5bb247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:48.060595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-341fa98c-22d5-4180-8fdf-bc768e5bb247 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:48.061990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-341fa98c-22d5-4180-8fdf-bc768e5bb247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:48.070647 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 883/1777] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:48.079216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11e3fd-b8fe-45c5-91d4-dfacde576f49 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:48.079575 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11e3fd-b8fe-45c5-91d4-dfacde576f49 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:48.079925 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11e3fd-b8fe-45c5-91d4-dfacde576f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:48.098171 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-ed11e3fd-b8fe-45c5-91d4-dfacde576f49 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:48.099386 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ed11e3fd-b8fe-45c5-91d4-dfacde576f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:48.107557 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 884/1778] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:37:48.111538 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11e3fd-b8fe-45c5-91d4-dfacde576f49 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:48.120779 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11e3fd-b8fe-45c5-91d4-dfacde576f49 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:48.125324 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3c73c-0def-4a41-9695-bedd51da15a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:48.125994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c73c-0def-4a41-9695-bedd51da15a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:48.126284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c73c-0def-4a41-9695-bedd51da15a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:48.126671 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3c73c-0def-4a41-9695-bedd51da15a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:48.127282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3c73c-0def-4a41-9695-bedd51da15a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:37:48.127596 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3c73c-0def-4a41-9695-bedd51da15a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:48.129814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3c73c-0def-4a41-9695-bedd51da15a0 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:48.142273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 885/1779] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:37:48.146465 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3c73c-0def-4a41-9695-bedd51da15a0 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:48.151661 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-17aec944-9311-44ee-aed3-b92c55c86545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73da960c77754f4fbd4239b569a5978d', 'request_id': 'req-17aec944-9311-44ee-aed3-b92c55c86545'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:48.160509 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-17aec944-9311-44ee-aed3-b92c55c86545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73da960c77754f4fbd4239b569a5978d', 'request_id': 'req-17aec944-9311-44ee-aed3-b92c55c86545'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:48.161787 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3c73c-0def-4a41-9695-bedd51da15a0 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:48.179583 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-17aec944-9311-44ee-aed3-b92c55c86545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73da960c77754f4fbd4239b569a5978d', 'request_id': 'req-17aec944-9311-44ee-aed3-b92c55c86545'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:48.223016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47a7e3-9015-4d23-a559-6a575b9d7ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:48.223604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47a7e3-9015-4d23-a559-6a575b9d7ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:48.223892 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47a7e3-9015-4d23-a559-6a575b9d7ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:48.224166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47a7e3-9015-4d23-a559-6a575b9d7ac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:48.224862 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47a7e3-9015-4d23-a559-6a575b9d7ac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:48.226805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47a7e3-9015-4d23-a559-6a575b9d7ac0 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:48.271731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-17aec944-9311-44ee-aed3-b92c55c86545 admin admin] The token cache is being invalidate because project 73da960c77754f4fbd4239b569a5978d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:37:48.272029 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-17aec944-9311-44ee-aed3-b92c55c86545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:48.272708 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-17aec944-9311-44ee-aed3-b92c55c86545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:48.274970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 895/1780] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:37:47 2022] DELETE /identity/v3/projects/73da960c77754f4fbd4239b569a5978d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:37:48.279624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aec944-9311-44ee-aed3-b92c55c86545 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:48.281717 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-17aec944-9311-44ee-aed3-b92c55c86545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:48.295685 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aec944-9311-44ee-aed3-b92c55c86545 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:48.302620 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e62ab-f938-4c83-946a-d0feffb35d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:48.303552 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e62ab-f938-4c83-946a-d0feffb35d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:48.303831 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e62ab-f938-4c83-946a-d0feffb35d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:48.304125 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e62ab-f938-4c83-946a-d0feffb35d5e admin admin] PATH_INFO: `/v3/users/2df056798457462a9d6cbf1bfc77ed73` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:48.306091 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e62ab-f938-4c83-946a-d0feffb35d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2df056798457462a9d6cbf1bfc77ed73)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:48.308032 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e62ab-f938-4c83-946a-d0feffb35d5e admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:48.372313 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 886/1781] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:48 2022] POST /identity/v3/projects => generated 375 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:37:48.373117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47a7e3-9015-4d23-a559-6a575b9d7ac0 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:48.384252 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-6d47a7e3-9015-4d23-a559-6a575b9d7ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:48.459166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47a7e3-9015-4d23-a559-6a575b9d7ac0 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:48.465147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8be9bc-e4c8-470b-ac5d-ec1f7376d6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:48.465952 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8be9bc-e4c8-470b-ac5d-ec1f7376d6cd admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:48.466460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8be9bc-e4c8-470b-ac5d-ec1f7376d6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:48.466818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8be9bc-e4c8-470b-ac5d-ec1f7376d6cd admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:48.467604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8be9bc-e4c8-470b-ac5d-ec1f7376d6cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:48.469667 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8be9bc-e4c8-470b-ac5d-ec1f7376d6cd admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:48.604184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c84e62ab-f938-4c83-946a-d0feffb35d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df056798457462a9d6cbf1bfc77ed73'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:48.617309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c84e62ab-f938-4c83-946a-d0feffb35d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df056798457462a9d6cbf1bfc77ed73'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:48.626002 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c84e62ab-f938-4c83-946a-d0feffb35d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df056798457462a9d6cbf1bfc77ed73'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:48.626804 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c84e62ab-f938-4c83-946a-d0feffb35d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df056798457462a9d6cbf1bfc77ed73'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:48.632700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c84e62ab-f938-4c83-946a-d0feffb35d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df056798457462a9d6cbf1bfc77ed73'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:48.649318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:48.656913 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 887/1782] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:48 2022] POST /identity/v3/users => generated 288 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:37:48.661581 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8be9bc-e4c8-470b-ac5d-ec1f7376d6cd admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:48.663354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-fb8be9bc-e4c8-470b-ac5d-ec1f7376d6cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:48.676664 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8be9bc-e4c8-470b-ac5d-ec1f7376d6cd admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:48.683292 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4c53e-9d24-448b-acda-017d443919f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:48.684240 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4c53e-9d24-448b-acda-017d443919f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:48.684684 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4c53e-9d24-448b-acda-017d443919f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:48.685102 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4c53e-9d24-448b-acda-017d443919f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:48.686037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4c53e-9d24-448b-acda-017d443919f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:48.687738 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4c53e-9d24-448b-acda-017d443919f6 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:48.699535 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 888/1783] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:37:48.703145 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4c53e-9d24-448b-acda-017d443919f6 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:48.720480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4c53e-9d24-448b-acda-017d443919f6 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:48.731598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d3f53-d37d-4a9f-a498-464639eed0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:48.731598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d3f53-d37d-4a9f-a498-464639eed0bf admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:48.731598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d3f53-d37d-4a9f-a498-464639eed0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:48.731598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d3f53-d37d-4a9f-a498-464639eed0bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:48.738564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d3f53-d37d-4a9f-a498-464639eed0bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:48.738564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d3f53-d37d-4a9f-a498-464639eed0bf admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:48.742250 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 896/1784] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:37:48 2022] DELETE /identity/v3/users/2df056798457462a9d6cbf1bfc77ed73 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:48.743462 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e62ab-f938-4c83-946a-d0feffb35d5e admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:48.746469 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-c84e62ab-f938-4c83-946a-d0feffb35d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:48.750451 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 889/1785] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:48.755597 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d3f53-d37d-4a9f-a498-464639eed0bf admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:48.774356 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d3f53-d37d-4a9f-a498-464639eed0bf admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:48.853740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a23b9-ae3c-4588-808a-d468db4c86a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:48.854931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a23b9-ae3c-4588-808a-d468db4c86a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:48.855427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a23b9-ae3c-4588-808a-d468db4c86a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:48.855850 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a23b9-ae3c-4588-808a-d468db4c86a4 admin admin] PATH_INFO: `/v3/projects/bd45054d508f413c97dedb35791f7f34/users/303611ae87c046af8efc51986234d295/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:48.873129 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e62ab-f938-4c83-946a-d0feffb35d5e admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:48.876882 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a23b9-ae3c-4588-808a-d468db4c86a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd45054d508f413c97dedb35791f7f34, user_id=303611ae87c046af8efc51986234d295, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:48.880172 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a23b9-ae3c-4588-808a-d468db4c86a4 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:48.887739 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fea41-2188-441f-aac9-18439b2e30b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:48.889393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fea41-2188-441f-aac9-18439b2e30b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:48.890149 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fea41-2188-441f-aac9-18439b2e30b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:48.890592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fea41-2188-441f-aac9-18439b2e30b4 admin admin] PATH_INFO: `/v3/users/6e098b1b9eee400eacb64293c3cc100f` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:48.892054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fea41-2188-441f-aac9-18439b2e30b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e098b1b9eee400eacb64293c3cc100f)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:48.895795 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fea41-2188-441f-aac9-18439b2e30b4 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:48.973645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 890/1786] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:48 2022] PUT /identity/v3/projects/bd45054d508f413c97dedb35791f7f34/users/303611ae87c046af8efc51986234d295/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:48.981117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37b6b3-0716-4184-a47c-b3e6eb1792fd None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:48.981700 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37b6b3-0716-4184-a47c-b3e6eb1792fd None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:48.981979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37b6b3-0716-4184-a47c-b3e6eb1792fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:49.013644 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-fc37b6b3-0716-4184-a47c-b3e6eb1792fd None None] MFA Rules not processed for user `303611ae87c046af8efc51986234d295`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:49.015064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-fc37b6b3-0716-4184-a47c-b3e6eb1792fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:49.081025 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 891/1787] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:37:49.090091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37b6b3-0716-4184-a47c-b3e6eb1792fd None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:49.137671 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-520fea41-2188-441f-aac9-18439b2e30b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e098b1b9eee400eacb64293c3cc100f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:49.158869 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-520fea41-2188-441f-aac9-18439b2e30b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e098b1b9eee400eacb64293c3cc100f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:49.161813 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37b6b3-0716-4184-a47c-b3e6eb1792fd None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:49.167119 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab056a5-b224-4cd4-9eb0-abfc7a85fbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:49.172015 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab056a5-b224-4cd4-9eb0-abfc7a85fbf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:49.172015 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab056a5-b224-4cd4-9eb0-abfc7a85fbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:49.172015 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab056a5-b224-4cd4-9eb0-abfc7a85fbf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:49.172015 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab056a5-b224-4cd4-9eb0-abfc7a85fbf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:49.172361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-520fea41-2188-441f-aac9-18439b2e30b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e098b1b9eee400eacb64293c3cc100f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:49.172458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab056a5-b224-4cd4-9eb0-abfc7a85fbf2 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:49.174371 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-520fea41-2188-441f-aac9-18439b2e30b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e098b1b9eee400eacb64293c3cc100f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:49.176793 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-520fea41-2188-441f-aac9-18439b2e30b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e098b1b9eee400eacb64293c3cc100f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:49.256062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 897/1788] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:37:48 2022] DELETE /identity/v3/users/6e098b1b9eee400eacb64293c3cc100f => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:49.260527 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dd28e-aa20-4279-9a77-08a8cd736494 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:49.260858 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dd28e-aa20-4279-9a77-08a8cd736494 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:49.261141 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dd28e-aa20-4279-9a77-08a8cd736494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:49.280211 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-c07dd28e-aa20-4279-9a77-08a8cd736494 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:49.281447 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-c07dd28e-aa20-4279-9a77-08a8cd736494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:49.309043 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:49.321178 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 892/1789] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:49 2022] POST /identity/v3/projects => generated 377 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:37:49.321178 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab056a5-b224-4cd4-9eb0-abfc7a85fbf2 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:49.321502 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-fab056a5-b224-4cd4-9eb0-abfc7a85fbf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:49.353763 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 898/1790] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:49.354684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dd28e-aa20-4279-9a77-08a8cd736494 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:49.358095 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-c07dd28e-aa20-4279-9a77-08a8cd736494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:49.370401 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dd28e-aa20-4279-9a77-08a8cd736494 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:49.391257 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab056a5-b224-4cd4-9eb0-abfc7a85fbf2 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:49.396719 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d778c5-fb01-4cb2-9411-01b55593aa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:49.397610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d778c5-fb01-4cb2-9411-01b55593aa94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:49.397898 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d778c5-fb01-4cb2-9411-01b55593aa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:49.398178 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d778c5-fb01-4cb2-9411-01b55593aa94 admin admin] PATH_INFO: `/v3/projects/440733cec22240c69c944bfd4c52d28a` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:49.399722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d778c5-fb01-4cb2-9411-01b55593aa94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=440733cec22240c69c944bfd4c52d28a)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:49.402088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d778c5-fb01-4cb2-9411-01b55593aa94 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:49.434160 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7e431-c50b-45a8-87ab-46032d3e9d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:49.434842 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7e431-c50b-45a8-87ab-46032d3e9d00 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:49.435128 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7e431-c50b-45a8-87ab-46032d3e9d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:49.435406 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7e431-c50b-45a8-87ab-46032d3e9d00 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:49.436097 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7e431-c50b-45a8-87ab-46032d3e9d00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:49.438219 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7e431-c50b-45a8-87ab-46032d3e9d00 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:49.522179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f1d778c5-fb01-4cb2-9411-01b55593aa94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440733cec22240c69c944bfd4c52d28a', 'request_id': 'req-f1d778c5-fb01-4cb2-9411-01b55593aa94'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:49.527478 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f1d778c5-fb01-4cb2-9411-01b55593aa94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440733cec22240c69c944bfd4c52d28a', 'request_id': 'req-f1d778c5-fb01-4cb2-9411-01b55593aa94'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:49.539489 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 899/1791] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:49 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:49.540963 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eac0a6-8c66-48c6-9294-e14c8031f68b None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:49.541346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eac0a6-8c66-48c6-9294-e14c8031f68b None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:49.541722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eac0a6-8c66-48c6-9294-e14c8031f68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:49.559355 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-f0eac0a6-8c66-48c6-9294-e14c8031f68b None None] MFA Rules not processed for user `fb4b22bc322c419bab3445f7dfb186fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:49.560615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f0eac0a6-8c66-48c6-9294-e14c8031f68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:49.608655 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f1d778c5-fb01-4cb2-9411-01b55593aa94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440733cec22240c69c944bfd4c52d28a', 'request_id': 'req-f1d778c5-fb01-4cb2-9411-01b55593aa94'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:49.622767 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f1d778c5-fb01-4cb2-9411-01b55593aa94 admin admin] The token cache is being invalidate because project 440733cec22240c69c944bfd4c52d28a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:37:49.623063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f1d778c5-fb01-4cb2-9411-01b55593aa94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:49.623783 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f1d778c5-fb01-4cb2-9411-01b55593aa94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:49.625711 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 893/1792] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:37:49 2022] DELETE /identity/v3/projects/440733cec22240c69c944bfd4c52d28a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:49.626585 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d778c5-fb01-4cb2-9411-01b55593aa94 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:49.632317 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 900/1793] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:49.632317 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eac0a6-8c66-48c6-9294-e14c8031f68b None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:49.633370 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f1d778c5-fb01-4cb2-9411-01b55593aa94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:49.716818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d778c5-fb01-4cb2-9411-01b55593aa94 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:49.731139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb2a9e-c034-4b20-bf44-960c97a6e0a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:49.732700 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb2a9e-c034-4b20-bf44-960c97a6e0a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:49.732700 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb2a9e-c034-4b20-bf44-960c97a6e0a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:49.732700 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb2a9e-c034-4b20-bf44-960c97a6e0a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:49.735975 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-efcb2a9e-c034-4b20-bf44-960c97a6e0a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:49.765272 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eac0a6-8c66-48c6-9294-e14c8031f68b None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:49.780693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37332459-e542-4b49-8c7a-2c63e7e7ba82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:49.786741 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37332459-e542-4b49-8c7a-2c63e7e7ba82 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:49.787036 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37332459-e542-4b49-8c7a-2c63e7e7ba82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:49.787320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37332459-e542-4b49-8c7a-2c63e7e7ba82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:49.788095 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37332459-e542-4b49-8c7a-2c63e7e7ba82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:49.803320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37332459-e542-4b49-8c7a-2c63e7e7ba82 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:49.835666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 901/1794] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:49.835666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4e891-a3d5-4831-a758-62ad00498e7c None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:49.835666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4e891-a3d5-4831-a758-62ad00498e7c None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:49.835666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4e891-a3d5-4831-a758-62ad00498e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:49.848848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb2a9e-c034-4b20-bf44-960c97a6e0a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:49.850550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb2a9e-c034-4b20-bf44-960c97a6e0a2 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:49.863378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 894/1795] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:49.864652 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb2a9e-c034-4b20-bf44-960c97a6e0a2 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:49.866209 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-efcb2a9e-c034-4b20-bf44-960c97a6e0a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:49.900566 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-27d4e891-a3d5-4831-a758-62ad00498e7c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:49.902290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb2a9e-c034-4b20-bf44-960c97a6e0a2 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:49.904798 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-27d4e891-a3d5-4831-a758-62ad00498e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:49.907835 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:49.930491 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37f6b3-13e2-47ac-a44f-cb35cc5a3b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:49.931961 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37f6b3-13e2-47ac-a44f-cb35cc5a3b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:49.935541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37f6b3-13e2-47ac-a44f-cb35cc5a3b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:49.936770 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37f6b3-13e2-47ac-a44f-cb35cc5a3b52 admin admin] PATH_INFO: `/v3/projects/ea10aaf49bc94c8b9a8f8b613c25f205/users/532864bcae4e4fbcb4d9dc8b0d8d4edd/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:49.949580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 902/1796] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:49.957401 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464ba3d-c252-4670-bc1a-aa72d23eb068 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:49.957776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464ba3d-c252-4670-bc1a-aa72d23eb068 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:49.958532 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464ba3d-c252-4670-bc1a-aa72d23eb068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:49.983042 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37f6b3-13e2-47ac-a44f-cb35cc5a3b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea10aaf49bc94c8b9a8f8b613c25f205, user_id=532864bcae4e4fbcb4d9dc8b0d8d4edd, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:49.989462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37f6b3-13e2-47ac-a44f-cb35cc5a3b52 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:49.999689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-5464ba3d-c252-4670-bc1a-aa72d23eb068 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:50.001378 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5464ba3d-c252-4670-bc1a-aa72d23eb068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:50.013470 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 903/1797] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:37:50.017442 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464ba3d-c252-4670-bc1a-aa72d23eb068 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:50.032847 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464ba3d-c252-4670-bc1a-aa72d23eb068 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:50.037779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a288c-cf6c-4063-b003-66d87591746e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:50.038441 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a288c-cf6c-4063-b003-66d87591746e admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:50.038854 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a288c-cf6c-4063-b003-66d87591746e admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:50.039026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a288c-cf6c-4063-b003-66d87591746e admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:50.040020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a288c-cf6c-4063-b003-66d87591746e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:37:50.040366 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a288c-cf6c-4063-b003-66d87591746e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:50.042203 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a288c-cf6c-4063-b003-66d87591746e admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:50.070521 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 904/1798] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:37:50.071766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a288c-cf6c-4063-b003-66d87591746e admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:50.092595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 895/1799] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:49 2022] PUT /identity/v3/projects/ea10aaf49bc94c8b9a8f8b613c25f205/users/532864bcae4e4fbcb4d9dc8b0d8d4edd/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:50.106153 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37f6b3-13e2-47ac-a44f-cb35cc5a3b52 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:50.109735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a288c-cf6c-4063-b003-66d87591746e admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:50.215497 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:50.259340 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37f6b3-13e2-47ac-a44f-cb35cc5a3b52 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:50.271858 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa97291-720b-4ba5-a215-d23088f16284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:50.272558 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa97291-720b-4ba5-a215-d23088f16284 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:50.272845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa97291-720b-4ba5-a215-d23088f16284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:50.273127 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa97291-720b-4ba5-a215-d23088f16284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:50.273938 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa97291-720b-4ba5-a215-d23088f16284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:50.275563 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa97291-720b-4ba5-a215-d23088f16284 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:50.336595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 896/1800] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:50.339561 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa97291-720b-4ba5-a215-d23088f16284 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:50.355657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc4b60-3c7b-4cf9-937b-b40b67b427c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:50.356975 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc4b60-3c7b-4cf9-937b-b40b67b427c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:50.357410 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc4b60-3c7b-4cf9-937b-b40b67b427c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:50.357857 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc4b60-3c7b-4cf9-937b-b40b67b427c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:50.359597 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc4b60-3c7b-4cf9-937b-b40b67b427c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:50.362273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc4b60-3c7b-4cf9-937b-b40b67b427c9 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:50.373556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa97291-720b-4ba5-a215-d23088f16284 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:50.379637 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087d5da-c094-41d1-9d56-a35eff825cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:50.381239 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087d5da-c094-41d1-9d56-a35eff825cd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:50.381485 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087d5da-c094-41d1-9d56-a35eff825cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:50.381903 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087d5da-c094-41d1-9d56-a35eff825cd8 admin admin] PATH_INFO: `/v3/projects/ea10aaf49bc94c8b9a8f8b613c25f205/users/532864bcae4e4fbcb4d9dc8b0d8d4edd/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:50.394238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087d5da-c094-41d1-9d56-a35eff825cd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea10aaf49bc94c8b9a8f8b613c25f205, user_id=532864bcae4e4fbcb4d9dc8b0d8d4edd, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:50.402577 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087d5da-c094-41d1-9d56-a35eff825cd8 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:50.416444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 897/1801] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:50 2022] PUT /identity/v3/projects/ea10aaf49bc94c8b9a8f8b613c25f205/users/532864bcae4e4fbcb4d9dc8b0d8d4edd/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:50.429451 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b280cf-f033-4105-a887-921efaa28c58 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:50.430041 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b280cf-f033-4105-a887-921efaa28c58 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:50.430424 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b280cf-f033-4105-a887-921efaa28c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:50.523183 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-89b280cf-f033-4105-a887-921efaa28c58 None None] MFA Rules not processed for user `532864bcae4e4fbcb4d9dc8b0d8d4edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:50.528242 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-89b280cf-f033-4105-a887-921efaa28c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:50.580896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 905/1802] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:50 2022] POST /identity/v3/projects => generated 377 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:50.588403 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc4b60-3c7b-4cf9-937b-b40b67b427c9 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:50.687683 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:50.874704 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc4b60-3c7b-4cf9-937b-b40b67b427c9 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:50.875194 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 898/1803] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:50.876054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d651c91-8574-481a-ab84-8d52fcb75a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:50.876054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d651c91-8574-481a-ab84-8d52fcb75a94 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:50.876054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d651c91-8574-481a-ab84-8d52fcb75a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:50.876054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d651c91-8574-481a-ab84-8d52fcb75a94 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:50.876462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a1d97-7691-44fa-8802-4fdef4c16471 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:50.876558 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d651c91-8574-481a-ab84-8d52fcb75a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:50.876641 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a1d97-7691-44fa-8802-4fdef4c16471 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:50.876641 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704a1d97-7691-44fa-8802-4fdef4c16471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:50.876815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d651c91-8574-481a-ab84-8d52fcb75a94 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:50.945232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-704a1d97-7691-44fa-8802-4fdef4c16471 None None] MFA Rules not processed for user `a25749f3a7c84c50b860538d1b661901`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:50.945232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-704a1d97-7691-44fa-8802-4fdef4c16471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:51.028415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 899/1804] 10.222.0.52 () {58 vars in 1015 bytes} [Thu Jul 21 08:37:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:51.029511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a1d97-7691-44fa-8802-4fdef4c16471 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:51.034403 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-704a1d97-7691-44fa-8802-4fdef4c16471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:51.157930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704a1d97-7691-44fa-8802-4fdef4c16471 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:51.169376 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e23d48-1fae-4570-bb54-9ecddf56ed4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:51.170122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e23d48-1fae-4570-bb54-9ecddf56ed4d service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:51.170395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e23d48-1fae-4570-bb54-9ecddf56ed4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:51.170697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e23d48-1fae-4570-bb54-9ecddf56ed4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:51.186479 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f9e23d48-1fae-4570-bb54-9ecddf56ed4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:51.311544 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e23d48-1fae-4570-bb54-9ecddf56ed4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:51.313599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e23d48-1fae-4570-bb54-9ecddf56ed4d service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:51.324050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 906/1805] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:50 2022] POST /identity/v3/users => generated 289 bytes in 739 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:51.325223 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d651c91-8574-481a-ab84-8d52fcb75a94 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:51.376599 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d651c91-8574-481a-ab84-8d52fcb75a94 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:51.401701 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 900/1806] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:51.402649 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e23d48-1fae-4570-bb54-9ecddf56ed4d service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:51.421315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719840d-c6ac-4376-9d06-8e9d881c3c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:51.436238 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719840d-c6ac-4376-9d06-8e9d881c3c2a service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:51.436597 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719840d-c6ac-4376-9d06-8e9d881c3c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:51.436893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719840d-c6ac-4376-9d06-8e9d881c3c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:51.483729 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e23d48-1fae-4570-bb54-9ecddf56ed4d service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:51.485770 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719840d-c6ac-4376-9d06-8e9d881c3c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:51.496295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719840d-c6ac-4376-9d06-8e9d881c3c2a service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:51.512601 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 907/1807] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:51.514053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719840d-c6ac-4376-9d06-8e9d881c3c2a service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:51.515651 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2719840d-c6ac-4376-9d06-8e9d881c3c2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:51.527503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499996c-f99e-4502-ad03-5a1ec9c73fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:51.532649 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499996c-f99e-4502-ad03-5a1ec9c73fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:51.532869 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499996c-f99e-4502-ad03-5a1ec9c73fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:51.541402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499996c-f99e-4502-ad03-5a1ec9c73fc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:51.542281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499996c-f99e-4502-ad03-5a1ec9c73fc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:51.552564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719840d-c6ac-4376-9d06-8e9d881c3c2a service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:51.556352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499996c-f99e-4502-ad03-5a1ec9c73fc5 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:51.562658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed350e54-294b-4390-927f-28a4f7546ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:51.564089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed350e54-294b-4390-927f-28a4f7546ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:51.564463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed350e54-294b-4390-927f-28a4f7546ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:51.564810 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed350e54-294b-4390-927f-28a4f7546ac0 admin admin] PATH_INFO: `/v3/projects/ce3a418d534d4117a7e4b4cf2e7a3da7` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:51.566519 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed350e54-294b-4390-927f-28a4f7546ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce3a418d534d4117a7e4b4cf2e7a3da7)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:51.569089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed350e54-294b-4390-927f-28a4f7546ac0 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:51.622752 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 901/1808] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:51.626647 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499996c-f99e-4502-ad03-5a1ec9c73fc5 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:51.630647 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:51.641625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499996c-f99e-4502-ad03-5a1ec9c73fc5 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:51.647556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c156a-36b8-4862-8442-f5749d9c9f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:51.649752 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c156a-36b8-4862-8442-f5749d9c9f1a admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:51.650333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c156a-36b8-4862-8442-f5749d9c9f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:51.650739 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c156a-36b8-4862-8442-f5749d9c9f1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:51.651732 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c156a-36b8-4862-8442-f5749d9c9f1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:51.653387 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c156a-36b8-4862-8442-f5749d9c9f1a admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:51.668444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 902/1809] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:37:51.675200 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c156a-36b8-4862-8442-f5749d9c9f1a admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:51.772853 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c156a-36b8-4862-8442-f5749d9c9f1a admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:51.787733 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ed350e54-294b-4390-927f-28a4f7546ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce3a418d534d4117a7e4b4cf2e7a3da7', 'request_id': 'req-ed350e54-294b-4390-927f-28a4f7546ac0'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:51.832122 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ed350e54-294b-4390-927f-28a4f7546ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce3a418d534d4117a7e4b4cf2e7a3da7', 'request_id': 'req-ed350e54-294b-4390-927f-28a4f7546ac0'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:51.910750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ed350e54-294b-4390-927f-28a4f7546ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce3a418d534d4117a7e4b4cf2e7a3da7', 'request_id': 'req-ed350e54-294b-4390-927f-28a4f7546ac0'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.042257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ed350e54-294b-4390-927f-28a4f7546ac0 admin admin] The token cache is being invalidate because project ce3a418d534d4117a7e4b4cf2e7a3da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:37:52.043303 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ed350e54-294b-4390-927f-28a4f7546ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.046459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ed350e54-294b-4390-927f-28a4f7546ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.066670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccc189-3b14-431a-b696-382fa0c5c051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:52.067631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccc189-3b14-431a-b696-382fa0c5c051 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:52.067918 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccc189-3b14-431a-b696-382fa0c5c051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:52.068194 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccc189-3b14-431a-b696-382fa0c5c051 admin admin] PATH_INFO: `/v3/projects/b060bec73c8040e2a4b77110fd13065a/users/5c5527e43a4c463e8661c02b815034c2/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:52.071796 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 908/1810] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:37:51 2022] DELETE /identity/v3/projects/ce3a418d534d4117a7e4b4cf2e7a3da7 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:52.078673 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed350e54-294b-4390-927f-28a4f7546ac0 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:52.083841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ed350e54-294b-4390-927f-28a4f7546ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:52.155030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed350e54-294b-4390-927f-28a4f7546ac0 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:52.162356 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccc189-3b14-431a-b696-382fa0c5c051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b060bec73c8040e2a4b77110fd13065a, user_id=5c5527e43a4c463e8661c02b815034c2, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:52.172290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ccc189-3b14-431a-b696-382fa0c5c051 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:52.174350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443a67a-a348-43d9-82e2-6133a6948dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:52.175889 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443a67a-a348-43d9-82e2-6133a6948dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:52.183075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443a67a-a348-43d9-82e2-6133a6948dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:52.185187 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b443a67a-a348-43d9-82e2-6133a6948dfb admin admin] PATH_INFO: `/v3/users/96e1136f95c74d149112b63e4eb7c1a6` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:52.189192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443a67a-a348-43d9-82e2-6133a6948dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=96e1136f95c74d149112b63e4eb7c1a6)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:52.197673 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b443a67a-a348-43d9-82e2-6133a6948dfb admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:52.296509 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 903/1811] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:51 2022] PUT /identity/v3/projects/b060bec73c8040e2a4b77110fd13065a/users/5c5527e43a4c463e8661c02b815034c2/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:52.299577 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26a5b9-e1d0-4fb7-8869-3c2f948aed75 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:52.300734 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26a5b9-e1d0-4fb7-8869-3c2f948aed75 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:52.301012 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d26a5b9-e1d0-4fb7-8869-3c2f948aed75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:52.350354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-0d26a5b9-e1d0-4fb7-8869-3c2f948aed75 None None] MFA Rules not processed for user `5c5527e43a4c463e8661c02b815034c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:52.350354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-0d26a5b9-e1d0-4fb7-8869-3c2f948aed75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:52.528416 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-b443a67a-a348-43d9-82e2-6133a6948dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96e1136f95c74d149112b63e4eb7c1a6'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.594171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-b443a67a-a348-43d9-82e2-6133a6948dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96e1136f95c74d149112b63e4eb7c1a6'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.608460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 904/1812] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:52.615171 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26a5b9-e1d0-4fb7-8869-3c2f948aed75 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:52.616590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-b443a67a-a348-43d9-82e2-6133a6948dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96e1136f95c74d149112b63e4eb7c1a6'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.617730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-b443a67a-a348-43d9-82e2-6133a6948dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96e1136f95c74d149112b63e4eb7c1a6'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.618995 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-b443a67a-a348-43d9-82e2-6133a6948dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96e1136f95c74d149112b63e4eb7c1a6'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:52.623003 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-0d26a5b9-e1d0-4fb7-8869-3c2f948aed75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:52.736783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 909/1813] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:37:52 2022] DELETE /identity/v3/users/96e1136f95c74d149112b63e4eb7c1a6 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:52.772955 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:52.972930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d26a5b9-e1d0-4fb7-8869-3c2f948aed75 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:53.188742 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebbe59-50b8-4c0c-a98d-b783b1986909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:53.193424 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebbe59-50b8-4c0c-a98d-b783b1986909 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:53.193424 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebbe59-50b8-4c0c-a98d-b783b1986909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:53.193424 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ebbe59-50b8-4c0c-a98d-b783b1986909 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:53.193424 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebbe59-50b8-4c0c-a98d-b783b1986909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:53.196516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ebbe59-50b8-4c0c-a98d-b783b1986909 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:53.358961 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 905/1814] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:52 2022] POST /identity/v3/projects => generated 377 bytes in 750 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:53.363817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443a67a-a348-43d9-82e2-6133a6948dfb admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:53.371241 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b443a67a-a348-43d9-82e2-6133a6948dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:53.427160 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b443a67a-a348-43d9-82e2-6133a6948dfb admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:53.615615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd710a33-7554-46c7-adb8-fa768e6a6677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:53.618917 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd710a33-7554-46c7-adb8-fa768e6a6677 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:53.619427 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd710a33-7554-46c7-adb8-fa768e6a6677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:53.619893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd710a33-7554-46c7-adb8-fa768e6a6677 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:53.633493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd710a33-7554-46c7-adb8-fa768e6a6677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:53.636108 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd710a33-7554-46c7-adb8-fa768e6a6677 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:53.780053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 910/1815] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:53 2022] POST /identity/v3/users => generated 289 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:53.784109 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebbe59-50b8-4c0c-a98d-b783b1986909 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:53.804963 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ebbe59-50b8-4c0c-a98d-b783b1986909 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:53.829665 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988dc56-716a-4b3f-8c8b-de0c8736f7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:53.831639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988dc56-716a-4b3f-8c8b-de0c8736f7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:53.832176 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988dc56-716a-4b3f-8c8b-de0c8736f7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:53.834128 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988dc56-716a-4b3f-8c8b-de0c8736f7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:53.838284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988dc56-716a-4b3f-8c8b-de0c8736f7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:53.862074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988dc56-716a-4b3f-8c8b-de0c8736f7b4 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:53.941386 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 906/1816] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:53.945969 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd710a33-7554-46c7-adb8-fa768e6a6677 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:53.976818 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd710a33-7554-46c7-adb8-fa768e6a6677 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:53.992952 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d6929-1f8d-4e32-a9ca-28a80ec83706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:53.995460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d6929-1f8d-4e32-a9ca-28a80ec83706 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:53.995955 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d6929-1f8d-4e32-a9ca-28a80ec83706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:53.996255 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d6929-1f8d-4e32-a9ca-28a80ec83706 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:53.997027 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d6929-1f8d-4e32-a9ca-28a80ec83706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:54.007563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d6929-1f8d-4e32-a9ca-28a80ec83706 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:54.039008 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 911/1817] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:37:54.046660 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988dc56-716a-4b3f-8c8b-de0c8736f7b4 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:54.084943 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988dc56-716a-4b3f-8c8b-de0c8736f7b4 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:54.100982 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:54.104512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899eb83c-e872-4df3-a716-75ff8c8f0dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:54.107915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899eb83c-e872-4df3-a716-75ff8c8f0dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:54.108354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899eb83c-e872-4df3-a716-75ff8c8f0dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:54.111754 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899eb83c-e872-4df3-a716-75ff8c8f0dc2 admin admin] PATH_INFO: `/v3/projects/851345e7b9a248128df1df5e0b2975fc/users/a49c9ed313dc478da16d6f7877f42517/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:54.203434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899eb83c-e872-4df3-a716-75ff8c8f0dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=851345e7b9a248128df1df5e0b2975fc, user_id=a49c9ed313dc478da16d6f7877f42517, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:54.213989 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899eb83c-e872-4df3-a716-75ff8c8f0dc2 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:54.334833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 907/1818] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:54 2022] PUT /identity/v3/projects/851345e7b9a248128df1df5e0b2975fc/users/a49c9ed313dc478da16d6f7877f42517/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:54.336100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bdecb-efce-4de4-8baa-37e0c708dbb2 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:54.336397 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bdecb-efce-4de4-8baa-37e0c708dbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:54.336689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bdecb-efce-4de4-8baa-37e0c708dbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:54.415188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-802bdecb-efce-4de4-8baa-37e0c708dbb2 None None] MFA Rules not processed for user `a49c9ed313dc478da16d6f7877f42517`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:54.417420 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-802bdecb-efce-4de4-8baa-37e0c708dbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:54.732312 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899eb83c-e872-4df3-a716-75ff8c8f0dc2 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:54.737913 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 912/1819] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:37:54.923504 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899eb83c-e872-4df3-a716-75ff8c8f0dc2 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:54.930490 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff93a4-11cb-471a-8911-e6602ce0d35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:54.931850 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff93a4-11cb-471a-8911-e6602ce0d35d admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:54.932295 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff93a4-11cb-471a-8911-e6602ce0d35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:54.932903 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff93a4-11cb-471a-8911-e6602ce0d35d admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:54.934953 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff93a4-11cb-471a-8911-e6602ce0d35d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:54.942052 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff93a4-11cb-471a-8911-e6602ce0d35d admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:55.055513 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:55.075142 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 908/1820] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:54 2022] POST /identity/v3/projects => generated 377 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:55.078548 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bdecb-efce-4de4-8baa-37e0c708dbb2 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:55.098252 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bdecb-efce-4de4-8baa-37e0c708dbb2 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:55.272361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931e3a7-f2b1-45fc-8e67-6009feff1b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:55.273478 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931e3a7-f2b1-45fc-8e67-6009feff1b54 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:55.275234 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931e3a7-f2b1-45fc-8e67-6009feff1b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:55.275850 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931e3a7-f2b1-45fc-8e67-6009feff1b54 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:55.277203 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931e3a7-f2b1-45fc-8e67-6009feff1b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:55.281463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931e3a7-f2b1-45fc-8e67-6009feff1b54 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:55.424107 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 913/1821] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:55 2022] POST /identity/v3/users => generated 295 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:55.424511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff93a4-11cb-471a-8911-e6602ce0d35d admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:55.438340 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff93a4-11cb-471a-8911-e6602ce0d35d admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:55.459894 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a1eb5-8b35-4ec5-a20e-d42778a94bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:55.460610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a1eb5-8b35-4ec5-a20e-d42778a94bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:55.461079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a1eb5-8b35-4ec5-a20e-d42778a94bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:55.461740 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a1eb5-8b35-4ec5-a20e-d42778a94bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:55.462625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a1eb5-8b35-4ec5-a20e-d42778a94bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:55.464420 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2a1eb5-8b35-4ec5-a20e-d42778a94bbd admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:55.498114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931e3a7-f2b1-45fc-8e67-6009feff1b54 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:55.499154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 909/1822] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:55.510895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931e3a7-f2b1-45fc-8e67-6009feff1b54 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:55.541405 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690d522-d919-44ab-9ba2-edd8b9db6286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:55.542358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690d522-d919-44ab-9ba2-edd8b9db6286 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:55.542659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690d522-d919-44ab-9ba2-edd8b9db6286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:55.542934 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690d522-d919-44ab-9ba2-edd8b9db6286 admin admin] PATH_INFO: `/v3/projects/2da5aceba2c74f539fc3e4377148c3a6/users/8a97518d21614677a4cd6dd9116ef91a/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:55.625988 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690d522-d919-44ab-9ba2-edd8b9db6286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da5aceba2c74f539fc3e4377148c3a6, user_id=8a97518d21614677a4cd6dd9116ef91a, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:55.637662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690d522-d919-44ab-9ba2-edd8b9db6286 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:55.728704 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 914/1823] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:55 2022] PUT /identity/v3/projects/2da5aceba2c74f539fc3e4377148c3a6/users/8a97518d21614677a4cd6dd9116ef91a/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:55.732749 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a1eb5-8b35-4ec5-a20e-d42778a94bbd admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:55.760750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a1eb5-8b35-4ec5-a20e-d42778a94bbd admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:55.879660 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7cf9e-f180-4628-a644-fdf05c458b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:55.881057 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7cf9e-f180-4628-a644-fdf05c458b97 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:55.881959 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7cf9e-f180-4628-a644-fdf05c458b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:55.882900 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7cf9e-f180-4628-a644-fdf05c458b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:55.885331 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7cf9e-f180-4628-a644-fdf05c458b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:55.887401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7cf9e-f180-4628-a644-fdf05c458b97 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:55.913688 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 910/1824] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:55.923859 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690d522-d919-44ab-9ba2-edd8b9db6286 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:55.938324 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690d522-d919-44ab-9ba2-edd8b9db6286 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:55.944194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad739708-6023-4124-bc4b-857ee6ab5144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:55.945356 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad739708-6023-4124-bc4b-857ee6ab5144 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:55.945760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad739708-6023-4124-bc4b-857ee6ab5144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:55.946029 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad739708-6023-4124-bc4b-857ee6ab5144 admin admin] PATH_INFO: `/v3/projects/2da5aceba2c74f539fc3e4377148c3a6/users/8a97518d21614677a4cd6dd9116ef91a/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:55.948225 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad739708-6023-4124-bc4b-857ee6ab5144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da5aceba2c74f539fc3e4377148c3a6, user_id=8a97518d21614677a4cd6dd9116ef91a, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:55.951067 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad739708-6023-4124-bc4b-857ee6ab5144 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:55.972866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 915/1825] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:55 2022] PUT /identity/v3/projects/2da5aceba2c74f539fc3e4377148c3a6/users/8a97518d21614677a4cd6dd9116ef91a/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:37:55.975754 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ac77a-ffc6-4e9f-b789-a54f606156ac None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:55.976127 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ac77a-ffc6-4e9f-b789-a54f606156ac None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:55.976525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ac77a-ffc6-4e9f-b789-a54f606156ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:55.979898 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:56.035872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-8e7ac77a-ffc6-4e9f-b789-a54f606156ac None None] MFA Rules not processed for user `8a97518d21614677a4cd6dd9116ef91a`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:56.037715 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-8e7ac77a-ffc6-4e9f-b789-a54f606156ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:56.084211 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad739708-6023-4124-bc4b-857ee6ab5144 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:56.088636 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ad739708-6023-4124-bc4b-857ee6ab5144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:56.193052 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 911/1826] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:56.206454 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ac77a-ffc6-4e9f-b789-a54f606156ac None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:56.206999 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad739708-6023-4124-bc4b-857ee6ab5144 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:56.207956 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-8e7ac77a-ffc6-4e9f-b789-a54f606156ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:56.212958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152905ef-1a42-4c1c-bb65-75969fe79d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:56.213866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152905ef-1a42-4c1c-bb65-75969fe79d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:56.214157 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152905ef-1a42-4c1c-bb65-75969fe79d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:56.214490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152905ef-1a42-4c1c-bb65-75969fe79d54 admin admin] PATH_INFO: `/v3/projects/4f287676940346aaaded9487ccf45c00` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:56.215802 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152905ef-1a42-4c1c-bb65-75969fe79d54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f287676940346aaaded9487ccf45c00)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:56.222011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152905ef-1a42-4c1c-bb65-75969fe79d54 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:56.355051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ac77a-ffc6-4e9f-b789-a54f606156ac None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:56.364432 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e988a-69a6-4525-ae54-ea18b72d36c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:56.366714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e988a-69a6-4525-ae54-ea18b72d36c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:56.369813 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e988a-69a6-4525-ae54-ea18b72d36c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:56.369813 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e988a-69a6-4525-ae54-ea18b72d36c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:56.390750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e988a-69a6-4525-ae54-ea18b72d36c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:56.392569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e988a-69a6-4525-ae54-ea18b72d36c1 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:56.420929 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-152905ef-1a42-4c1c-bb65-75969fe79d54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f287676940346aaaded9487ccf45c00', 'request_id': 'req-152905ef-1a42-4c1c-bb65-75969fe79d54'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:56.424989 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 912/1827] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:37:56.442884 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-152905ef-1a42-4c1c-bb65-75969fe79d54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f287676940346aaaded9487ccf45c00', 'request_id': 'req-152905ef-1a42-4c1c-bb65-75969fe79d54'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:56.461503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-152905ef-1a42-4c1c-bb65-75969fe79d54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f287676940346aaaded9487ccf45c00', 'request_id': 'req-152905ef-1a42-4c1c-bb65-75969fe79d54'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:56.576772 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-152905ef-1a42-4c1c-bb65-75969fe79d54 admin admin] The token cache is being invalidate because project 4f287676940346aaaded9487ccf45c00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:37:56.578005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-152905ef-1a42-4c1c-bb65-75969fe79d54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:56.579009 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-152905ef-1a42-4c1c-bb65-75969fe79d54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:37:56.581797 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 916/1828] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:37:56 2022] DELETE /identity/v3/projects/4f287676940346aaaded9487ccf45c00 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:37:56.588222 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd63c4b-e07d-4489-9add-65ff1d079288 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:56.588616 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd63c4b-e07d-4489-9add-65ff1d079288 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:56.588904 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd63c4b-e07d-4489-9add-65ff1d079288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:56.626713 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152905ef-1a42-4c1c-bb65-75969fe79d54 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:56.628815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-152905ef-1a42-4c1c-bb65-75969fe79d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:56.647114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-cfd63c4b-e07d-4489-9add-65ff1d079288 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:56.648446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-cfd63c4b-e07d-4489-9add-65ff1d079288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:56.751266 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152905ef-1a42-4c1c-bb65-75969fe79d54 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:56.757880 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 913/1829] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:56.760929 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b320e43-0c68-4edd-8937-99dfaf04e775 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:56.761089 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28de889-dd3d-4045-9840-699e1dc79152 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:56.761443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28de889-dd3d-4045-9840-699e1dc79152 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:56.761638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b320e43-0c68-4edd-8937-99dfaf04e775 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:56.761927 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28de889-dd3d-4045-9840-699e1dc79152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:56.762026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b320e43-0c68-4edd-8937-99dfaf04e775 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:56.762811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b320e43-0c68-4edd-8937-99dfaf04e775 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:56.767680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-3b320e43-0c68-4edd-8937-99dfaf04e775 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:56.805201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-d28de889-dd3d-4045-9840-699e1dc79152 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:56.807353 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-d28de889-dd3d-4045-9840-699e1dc79152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:56.821836 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 914/1830] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:37:56.827650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28de889-dd3d-4045-9840-699e1dc79152 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:56.847605 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28de889-dd3d-4045-9840-699e1dc79152 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:56.863353 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bacf8-81f5-4c07-aee9-b465fc986c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:56.864616 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bacf8-81f5-4c07-aee9-b465fc986c46 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:56.864616 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bacf8-81f5-4c07-aee9-b465fc986c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:56.864616 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bacf8-81f5-4c07-aee9-b465fc986c46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:56.865278 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18bacf8-81f5-4c07-aee9-b465fc986c46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:37:56.865764 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18bacf8-81f5-4c07-aee9-b465fc986c46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:56.867216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18bacf8-81f5-4c07-aee9-b465fc986c46 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:56.895829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 915/1831] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:37:56.901663 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bacf8-81f5-4c07-aee9-b465fc986c46 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:56.904686 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b320e43-0c68-4edd-8937-99dfaf04e775 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:56.909731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b320e43-0c68-4edd-8937-99dfaf04e775 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:56.925628 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18bacf8-81f5-4c07-aee9-b465fc986c46 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:56.937989 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 917/1832] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:37:56.939392 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf2a28-fc4e-4c8c-bd9b-5f24ccbc0826 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:56.939681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf2a28-fc4e-4c8c-bd9b-5f24ccbc0826 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:56.940677 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf2a28-fc4e-4c8c-bd9b-5f24ccbc0826 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:56.941044 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d0aff-befa-48ce-a1e9-45e7928fd3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:56.941869 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d0aff-befa-48ce-a1e9-45e7928fd3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:56.942224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d0aff-befa-48ce-a1e9-45e7928fd3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:56.942562 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d0aff-befa-48ce-a1e9-45e7928fd3e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:56.943309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 918/1833] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 08:37:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:37:56.943434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d0aff-befa-48ce-a1e9-45e7928fd3e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:56.945453 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d0aff-befa-48ce-a1e9-45e7928fd3e5 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:56.957899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6efdfb-2a43-41b8-8c75-ac5fdd812d10 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:56.960915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6efdfb-2a43-41b8-8c75-ac5fdd812d10 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:56.960915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6efdfb-2a43-41b8-8c75-ac5fdd812d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:57.014814 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-0c6efdfb-2a43-41b8-8c75-ac5fdd812d10 None None] MFA Rules not processed for user `b6670a010c034f7999c9445452c02473`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:57.017643 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-0c6efdfb-2a43-41b8-8c75-ac5fdd812d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:57.069965 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 916/1834] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:37:56 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:57.071120 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d0aff-befa-48ce-a1e9-45e7928fd3e5 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:57.194321 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 919/1835] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 08:37:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:37:57.197569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d0aff-befa-48ce-a1e9-45e7928fd3e5 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:57.214843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13436a0c-4d69-4330-8453-ac86dffc2aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:57.224992 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13436a0c-4d69-4330-8453-ac86dffc2aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:57.225117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6efdfb-2a43-41b8-8c75-ac5fdd812d10 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:57.226622 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-0c6efdfb-2a43-41b8-8c75-ac5fdd812d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:57.227330 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13436a0c-4d69-4330-8453-ac86dffc2aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:57.227633 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13436a0c-4d69-4330-8453-ac86dffc2aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:57.228360 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13436a0c-4d69-4330-8453-ac86dffc2aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:57.234080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13436a0c-4d69-4330-8453-ac86dffc2aa1 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:57.253105 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6efdfb-2a43-41b8-8c75-ac5fdd812d10 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:57.337939 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 917/1836] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:37:57 2022] POST /identity/v3/users => generated 288 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:37:57.339148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13436a0c-4d69-4330-8453-ac86dffc2aa1 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:57.344082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33a2db-cf06-4d39-be5c-7f11989d32b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:57.344793 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33a2db-cf06-4d39-be5c-7f11989d32b7 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:57.345082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33a2db-cf06-4d39-be5c-7f11989d32b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:57.345364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33a2db-cf06-4d39-be5c-7f11989d32b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:57.356502 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33a2db-cf06-4d39-be5c-7f11989d32b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:57.358811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33a2db-cf06-4d39-be5c-7f11989d32b7 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:57.360704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13436a0c-4d69-4330-8453-ac86dffc2aa1 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:57.370454 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf74e7-31a6-4c6a-9efc-01ee29473b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:57.371146 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf74e7-31a6-4c6a-9efc-01ee29473b39 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:57.371430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf74e7-31a6-4c6a-9efc-01ee29473b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:57.373474 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf74e7-31a6-4c6a-9efc-01ee29473b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:57.374282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf74e7-31a6-4c6a-9efc-01ee29473b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:57.376829 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 920/1837] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:57.380977 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf74e7-31a6-4c6a-9efc-01ee29473b39 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:57.392263 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:57.415400 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:37:57.429010 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33a2db-cf06-4d39-be5c-7f11989d32b7 service nova] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:57.429615 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 918/1838] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:57.445886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33a2db-cf06-4d39-be5c-7f11989d32b7 service nova] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:57.459051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307546e-66ff-4e3a-996c-c0388e4dbc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:57.460027 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307546e-66ff-4e3a-996c-c0388e4dbc97 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:57.460460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307546e-66ff-4e3a-996c-c0388e4dbc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:57.460882 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307546e-66ff-4e3a-996c-c0388e4dbc97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:57.461786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307546e-66ff-4e3a-996c-c0388e4dbc97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:57.464996 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307546e-66ff-4e3a-996c-c0388e4dbc97 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:57.493267 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 921/1839] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:37:57.497493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf74e7-31a6-4c6a-9efc-01ee29473b39 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:57.509055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf74e7-31a6-4c6a-9efc-01ee29473b39 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:57.514674 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b354771-c525-4a42-85e8-b83a1d26df8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:57.515825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b354771-c525-4a42-85e8-b83a1d26df8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:57.516284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b354771-c525-4a42-85e8-b83a1d26df8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:57.516757 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b354771-c525-4a42-85e8-b83a1d26df8b admin admin] PATH_INFO: `/v3/projects/f42f282d5d9148dc8ff115a54349d1e5/users/0c3595b2c3fe454481309e4db3016699/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:57.536750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b354771-c525-4a42-85e8-b83a1d26df8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42f282d5d9148dc8ff115a54349d1e5, user_id=0c3595b2c3fe454481309e4db3016699, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:57.539560 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b354771-c525-4a42-85e8-b83a1d26df8b admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:57.648247 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 919/1840] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:37:57 2022] PUT /identity/v3/projects/f42f282d5d9148dc8ff115a54349d1e5/users/0c3595b2c3fe454481309e4db3016699/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:37:57.658401 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195c5fd-edad-48c1-a1b0-e8b9453f68ce None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:57.662039 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195c5fd-edad-48c1-a1b0-e8b9453f68ce None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:57.662730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195c5fd-edad-48c1-a1b0-e8b9453f68ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:57.750899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-c195c5fd-edad-48c1-a1b0-e8b9453f68ce None None] MFA Rules not processed for user `0c3595b2c3fe454481309e4db3016699`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:57.754507 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-c195c5fd-edad-48c1-a1b0-e8b9453f68ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:57.840946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 922/1841] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:37:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:57.849065 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b354771-c525-4a42-85e8-b83a1d26df8b admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:57.850900 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-4b354771-c525-4a42-85e8-b83a1d26df8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:57.934571 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b354771-c525-4a42-85e8-b83a1d26df8b admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:57.938406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723a13c-4045-4ebe-8a7e-d3db32927d2c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b27a4861d6b4ddfaca1a97efdaf008d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:57.939061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a13c-4045-4ebe-8a7e-d3db32927d2c service glance] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:57.939347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a13c-4045-4ebe-8a7e-d3db32927d2c service glance] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:57.939627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a13c-4045-4ebe-8a7e-d3db32927d2c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:57.949989 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723a13c-4045-4ebe-8a7e-d3db32927d2c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:57.951444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723a13c-4045-4ebe-8a7e-d3db32927d2c service glance] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:57.961813 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 920/1842] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:37:59.252772 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195c5fd-edad-48c1-a1b0-e8b9453f68ce None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:59.329176 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195c5fd-edad-48c1-a1b0-e8b9453f68ce None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:37:59.333497 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6577415-485f-45e6-b8a0-a4af26f8d7f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:37:59.334180 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6577415-485f-45e6-b8a0-a4af26f8d7f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:59.334462 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6577415-485f-45e6-b8a0-a4af26f8d7f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:59.334739 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6577415-485f-45e6-b8a0-a4af26f8d7f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:59.336554 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-a6577415-485f-45e6-b8a0-a4af26f8d7f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:59.436525 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6577415-485f-45e6-b8a0-a4af26f8d7f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:37:59.438125 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6577415-485f-45e6-b8a0-a4af26f8d7f8 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:37:59.449741 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 923/1843] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:37:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:37:59.782802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3716d-6d65-4414-8b4a-dcca751fc2f3 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:37:59.784688 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3716d-6d65-4414-8b4a-dcca751fc2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:37:59.785206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3716d-6d65-4414-8b4a-dcca751fc2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:37:59.811810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-7cc3716d-6d65-4414-8b4a-dcca751fc2f3 None None] MFA Rules not processed for user `22750d44d710439da1d18a78419b1adf`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:37:59.813032 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7cc3716d-6d65-4414-8b4a-dcca751fc2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:37:59.878943 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 921/1844] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 08:37:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:37:59.894601 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6577415-485f-45e6-b8a0-a4af26f8d7f8 service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:37:59.896257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-a6577415-485f-45e6-b8a0-a4af26f8d7f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:00.059849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6577415-485f-45e6-b8a0-a4af26f8d7f8 service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:00.078084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702630fd-82a1-421c-b2d2-4173b3f4f1d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e349e5dfcd74406b922d3d1ce0fa5ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:00.078084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702630fd-82a1-421c-b2d2-4173b3f4f1d8 service swift] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:00.078084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702630fd-82a1-421c-b2d2-4173b3f4f1d8 service swift] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:00.078084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702630fd-82a1-421c-b2d2-4173b3f4f1d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:00.089922 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702630fd-82a1-421c-b2d2-4173b3f4f1d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:00.092412 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702630fd-82a1-421c-b2d2-4173b3f4f1d8 service swift] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:00.103309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 924/1845] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 08:37:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:38:00.391478 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:00.481549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:00.726854 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3716d-6d65-4414-8b4a-dcca751fc2f3 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:00.729128 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7cc3716d-6d65-4414-8b4a-dcca751fc2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:00.925863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3716d-6d65-4414-8b4a-dcca751fc2f3 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:00.933390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ffc52-0a73-48a5-9d1a-539d18113b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:00.934610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ffc52-0a73-48a5-9d1a-539d18113b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:00.938254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ffc52-0a73-48a5-9d1a-539d18113b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:00.938735 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ffc52-0a73-48a5-9d1a-539d18113b78 admin admin] PATH_INFO: `/v3/users/83752c05bd074ca68af764fc92d75d16` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:00.942924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ffc52-0a73-48a5-9d1a-539d18113b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83752c05bd074ca68af764fc92d75d16)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:00.945142 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ffc52-0a73-48a5-9d1a-539d18113b78 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:00.997864 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:01.106211 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:01.196168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4f1ffc52-0a73-48a5-9d1a-539d18113b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83752c05bd074ca68af764fc92d75d16'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:01.212762 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4f1ffc52-0a73-48a5-9d1a-539d18113b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83752c05bd074ca68af764fc92d75d16'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:01.232046 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4f1ffc52-0a73-48a5-9d1a-539d18113b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83752c05bd074ca68af764fc92d75d16'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:01.236141 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4f1ffc52-0a73-48a5-9d1a-539d18113b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83752c05bd074ca68af764fc92d75d16'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:01.236860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4f1ffc52-0a73-48a5-9d1a-539d18113b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83752c05bd074ca68af764fc92d75d16'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:01.324349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 922/1846] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:00 2022] DELETE /identity/v3/users/83752c05bd074ca68af764fc92d75d16 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:01.331559 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5491b-cd05-41a5-9533-91a43bc9b81e None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:01.331559 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5491b-cd05-41a5-9533-91a43bc9b81e None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:01.331559 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5491b-cd05-41a5-9533-91a43bc9b81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:01.352413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-99a5491b-cd05-41a5-9533-91a43bc9b81e None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:01.354529 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-99a5491b-cd05-41a5-9533-91a43bc9b81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:01.430619 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 925/1847] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:01.474232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ffc52-0a73-48a5-9d1a-539d18113b78 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:01.476508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-4f1ffc52-0a73-48a5-9d1a-539d18113b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:01.584781 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ffc52-0a73-48a5-9d1a-539d18113b78 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:01.593491 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624abf35-9d72-4248-8d60-e0e886c543f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:01.594253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624abf35-9d72-4248-8d60-e0e886c543f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:01.594613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624abf35-9d72-4248-8d60-e0e886c543f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:01.594964 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624abf35-9d72-4248-8d60-e0e886c543f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:01.606100 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624abf35-9d72-4248-8d60-e0e886c543f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:01.607755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624abf35-9d72-4248-8d60-e0e886c543f6 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:01.617993 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 923/1848] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:01.972717 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:02.323480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5491b-cd05-41a5-9533-91a43bc9b81e None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:02.325569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-99a5491b-cd05-41a5-9533-91a43bc9b81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:02.347862 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5491b-cd05-41a5-9533-91a43bc9b81e None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:02.360121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b522a3-b583-4bbe-a1e3-4c30ece274c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:02.361044 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b522a3-b583-4bbe-a1e3-4c30ece274c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:02.361332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b522a3-b583-4bbe-a1e3-4c30ece274c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:02.361645 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b522a3-b583-4bbe-a1e3-4c30ece274c1 admin admin] PATH_INFO: `/v3/projects/943317b51f0547c28f83be2eb02bf902` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:02.370681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b522a3-b583-4bbe-a1e3-4c30ece274c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=943317b51f0547c28f83be2eb02bf902)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:02.372686 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b522a3-b583-4bbe-a1e3-4c30ece274c1 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:02.379524 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:02.450718 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd077fd-605a-4ebf-a4a9-03b476bfe66f None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:02.451018 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd077fd-605a-4ebf-a4a9-03b476bfe66f None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:02.451299 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd077fd-605a-4ebf-a4a9-03b476bfe66f None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:02.453172 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 924/1849] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 08:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:38:02.524172 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9719-7b90-45db-8a36-3104aa7bd41a None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:02.524172 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9719-7b90-45db-8a36-3104aa7bd41a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:02.524172 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f9719-7b90-45db-8a36-3104aa7bd41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:02.560161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-eb4f9719-7b90-45db-8a36-3104aa7bd41a None None] MFA Rules not processed for user `b6670a010c034f7999c9445452c02473`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:02.563387 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-eb4f9719-7b90-45db-8a36-3104aa7bd41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:02.628700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-08b522a3-b583-4bbe-a1e3-4c30ece274c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '943317b51f0547c28f83be2eb02bf902', 'request_id': 'req-08b522a3-b583-4bbe-a1e3-4c30ece274c1'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:02.660988 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-08b522a3-b583-4bbe-a1e3-4c30ece274c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '943317b51f0547c28f83be2eb02bf902', 'request_id': 'req-08b522a3-b583-4bbe-a1e3-4c30ece274c1'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:02.683089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-08b522a3-b583-4bbe-a1e3-4c30ece274c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '943317b51f0547c28f83be2eb02bf902', 'request_id': 'req-08b522a3-b583-4bbe-a1e3-4c30ece274c1'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:02.767424 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 925/1850] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 08:38:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:38:02.823153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-08b522a3-b583-4bbe-a1e3-4c30ece274c1 admin admin] The token cache is being invalidate because project 943317b51f0547c28f83be2eb02bf902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:02.823153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-08b522a3-b583-4bbe-a1e3-4c30ece274c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:02.823153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-08b522a3-b583-4bbe-a1e3-4c30ece274c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:02.823153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 926/1851] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:02 2022] DELETE /identity/v3/projects/943317b51f0547c28f83be2eb02bf902 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:02.825998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f9719-7b90-45db-8a36-3104aa7bd41a None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:02.955047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f9719-7b90-45db-8a36-3104aa7bd41a None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:02.955047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdcce2-7055-41a0-8e38-839d82e28cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:02.955047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdcce2-7055-41a0-8e38-839d82e28cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:02.955047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdcce2-7055-41a0-8e38-839d82e28cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:02.955447 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdcce2-7055-41a0-8e38-839d82e28cdb admin admin] PATH_INFO: `/v3/users/fbd3db7cfce1406896663bf6e1ab24a5` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:02.955447 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdcce2-7055-41a0-8e38-839d82e28cdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd3db7cfce1406896663bf6e1ab24a5)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:02.955447 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdcce2-7055-41a0-8e38-839d82e28cdb admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:03.009147 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b522a3-b583-4bbe-a1e3-4c30ece274c1 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:03.011819 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-08b522a3-b583-4bbe-a1e3-4c30ece274c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:03.030347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b522a3-b583-4bbe-a1e3-4c30ece274c1 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:03.043481 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b37e0-1379-4769-89c9-7717a8135889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:03.044228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b37e0-1379-4769-89c9-7717a8135889 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:03.044630 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b37e0-1379-4769-89c9-7717a8135889 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:03.044988 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b37e0-1379-4769-89c9-7717a8135889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:03.046979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-061b37e0-1379-4769-89c9-7717a8135889 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:03.060201 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b37e0-1379-4769-89c9-7717a8135889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:03.061833 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b37e0-1379-4769-89c9-7717a8135889 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:03.078132 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 927/1852] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:38:03.170886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-93fdcce2-7055-41a0-8e38-839d82e28cdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd3db7cfce1406896663bf6e1ab24a5'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:03.183185 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-93fdcce2-7055-41a0-8e38-839d82e28cdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd3db7cfce1406896663bf6e1ab24a5'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:03.192569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-93fdcce2-7055-41a0-8e38-839d82e28cdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd3db7cfce1406896663bf6e1ab24a5'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:03.193326 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-93fdcce2-7055-41a0-8e38-839d82e28cdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd3db7cfce1406896663bf6e1ab24a5'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:03.194003 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-93fdcce2-7055-41a0-8e38-839d82e28cdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd3db7cfce1406896663bf6e1ab24a5'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:03.266966 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 926/1853] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:02 2022] DELETE /identity/v3/users/fbd3db7cfce1406896663bf6e1ab24a5 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:03.339083 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:03.454750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:03.705145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b37e0-1379-4769-89c9-7717a8135889 service nova] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:03.706601 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-061b37e0-1379-4769-89c9-7717a8135889 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:03.720248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b37e0-1379-4769-89c9-7717a8135889 service nova] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:03.782171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fc38c-430f-4339-b669-8cee173d6787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:03.783051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fc38c-430f-4339-b669-8cee173d6787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:03.783330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fc38c-430f-4339-b669-8cee173d6787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:03.783614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fc38c-430f-4339-b669-8cee173d6787 admin admin] PATH_INFO: `/v3/projects/249fca9ead1f452292b264d36f0756ca` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:03.785043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fc38c-430f-4339-b669-8cee173d6787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=249fca9ead1f452292b264d36f0756ca)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:03.787224 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fc38c-430f-4339-b669-8cee173d6787 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:04.006377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a61fc38c-430f-4339-b669-8cee173d6787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '249fca9ead1f452292b264d36f0756ca', 'request_id': 'req-a61fc38c-430f-4339-b669-8cee173d6787'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:04.012419 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a61fc38c-430f-4339-b669-8cee173d6787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '249fca9ead1f452292b264d36f0756ca', 'request_id': 'req-a61fc38c-430f-4339-b669-8cee173d6787'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:04.031119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a61fc38c-430f-4339-b669-8cee173d6787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '249fca9ead1f452292b264d36f0756ca', 'request_id': 'req-a61fc38c-430f-4339-b669-8cee173d6787'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:04.111801 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a61fc38c-430f-4339-b669-8cee173d6787 admin admin] The token cache is being invalidate because project 249fca9ead1f452292b264d36f0756ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:04.112825 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a61fc38c-430f-4339-b669-8cee173d6787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:04.114026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a61fc38c-430f-4339-b669-8cee173d6787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:04.116235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 928/1854] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:03 2022] DELETE /identity/v3/projects/249fca9ead1f452292b264d36f0756ca => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:04.121508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d04b1a-025a-4e04-b830-f1cfd0316973 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:04.122106 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d04b1a-025a-4e04-b830-f1cfd0316973 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:04.122198 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d04b1a-025a-4e04-b830-f1cfd0316973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:04.153500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-76d04b1a-025a-4e04-b830-f1cfd0316973 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:04.156221 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-76d04b1a-025a-4e04-b830-f1cfd0316973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:04.239456 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 927/1855] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:04.247324 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c258ec-8824-40e5-9361-c659dc487863 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:04.247620 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c258ec-8824-40e5-9361-c659dc487863 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:04.247907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c258ec-8824-40e5-9361-c659dc487863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:04.289827 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-b9c258ec-8824-40e5-9361-c659dc487863 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:04.291080 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b9c258ec-8824-40e5-9361-c659dc487863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:04.300489 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 929/1856] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:04.304544 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d04b1a-025a-4e04-b830-f1cfd0316973 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:04.315190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d04b1a-025a-4e04-b830-f1cfd0316973 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:04.320527 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abbc08-3ebb-49fd-ab75-6096fa770320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:04.321353 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abbc08-3ebb-49fd-ab75-6096fa770320 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:04.321744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abbc08-3ebb-49fd-ab75-6096fa770320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:04.322099 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abbc08-3ebb-49fd-ab75-6096fa770320 admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:04.323045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abbc08-3ebb-49fd-ab75-6096fa770320 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:38:04.323462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abbc08-3ebb-49fd-ab75-6096fa770320 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:04.325218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abbc08-3ebb-49fd-ab75-6096fa770320 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:04.343435 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 928/1857] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:38:04.349964 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c258ec-8824-40e5-9361-c659dc487863 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:04.370790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c258ec-8824-40e5-9361-c659dc487863 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:04.376689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864837a8-f1b9-4d32-bdb1-f9acd403025f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:04.377414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864837a8-f1b9-4d32-bdb1-f9acd403025f admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:04.377734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864837a8-f1b9-4d32-bdb1-f9acd403025f admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:04.378013 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864837a8-f1b9-4d32-bdb1-f9acd403025f admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:04.378785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864837a8-f1b9-4d32-bdb1-f9acd403025f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:04.380747 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864837a8-f1b9-4d32-bdb1-f9acd403025f admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:04.482614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 930/1858] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:04 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:38:04.483962 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abbc08-3ebb-49fd-ab75-6096fa770320 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:04.495387 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abbc08-3ebb-49fd-ab75-6096fa770320 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:04.559980 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6c1c2-5824-416a-b2c7-c48462548b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:04.560752 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6c1c2-5824-416a-b2c7-c48462548b55 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:04.561037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6c1c2-5824-416a-b2c7-c48462548b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:04.561315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6c1c2-5824-416a-b2c7-c48462548b55 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:04.562110 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6c1c2-5824-416a-b2c7-c48462548b55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:04.564860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6c1c2-5824-416a-b2c7-c48462548b55 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:04.642967 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 929/1859] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:04 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:04.644381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864837a8-f1b9-4d32-bdb1-f9acd403025f admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:04.664699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864837a8-f1b9-4d32-bdb1-f9acd403025f admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:04.669840 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070f8da-f617-4e6b-9d28-09b8115a2142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:04.670537 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070f8da-f617-4e6b-9d28-09b8115a2142 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:04.670835 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070f8da-f617-4e6b-9d28-09b8115a2142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:04.671190 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070f8da-f617-4e6b-9d28-09b8115a2142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:04.671975 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070f8da-f617-4e6b-9d28-09b8115a2142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:04.673633 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070f8da-f617-4e6b-9d28-09b8115a2142 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:04.687226 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 931/1860] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:04.692018 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6c1c2-5824-416a-b2c7-c48462548b55 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:04.704766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6c1c2-5824-416a-b2c7-c48462548b55 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:04.712987 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328046bc-8f05-4d93-99bb-ff112901d20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:04.713703 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328046bc-8f05-4d93-99bb-ff112901d20c admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:04.713992 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328046bc-8f05-4d93-99bb-ff112901d20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:04.716346 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328046bc-8f05-4d93-99bb-ff112901d20c admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:04.717753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328046bc-8f05-4d93-99bb-ff112901d20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:04.719471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328046bc-8f05-4d93-99bb-ff112901d20c admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:04.747945 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 930/1861] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:04.753049 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070f8da-f617-4e6b-9d28-09b8115a2142 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:04.770226 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070f8da-f617-4e6b-9d28-09b8115a2142 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:04.777112 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580caa8d-fc1e-4602-9992-39edede102a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:04.778067 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580caa8d-fc1e-4602-9992-39edede102a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:04.778357 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580caa8d-fc1e-4602-9992-39edede102a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:04.778980 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580caa8d-fc1e-4602-9992-39edede102a5 admin admin] PATH_INFO: `/v3/projects/d7ae646934c0410383f2f70d3020837f/users/5d0b0f9746054c52a6b4edd41310962e/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:04.797364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580caa8d-fc1e-4602-9992-39edede102a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ae646934c0410383f2f70d3020837f, user_id=5d0b0f9746054c52a6b4edd41310962e, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:04.800827 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580caa8d-fc1e-4602-9992-39edede102a5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:04.956068 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 932/1862] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:04 2022] PUT /identity/v3/projects/d7ae646934c0410383f2f70d3020837f/users/5d0b0f9746054c52a6b4edd41310962e/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:04.971588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77237286-2512-4179-820e-5317ca3e3583 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:04.972081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77237286-2512-4179-820e-5317ca3e3583 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:04.972505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77237286-2512-4179-820e-5317ca3e3583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:05.035054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-77237286-2512-4179-820e-5317ca3e3583 None None] MFA Rules not processed for user `5d0b0f9746054c52a6b4edd41310962e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:05.038918 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-77237286-2512-4179-820e-5317ca3e3583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:05.225197 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 931/1863] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:05.233390 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580caa8d-fc1e-4602-9992-39edede102a5 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:05.332456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580caa8d-fc1e-4602-9992-39edede102a5 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:05.339355 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7afbd-3948-4b45-940c-52e1c0e7c7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:05.339938 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77237286-2512-4179-820e-5317ca3e3583 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:05.340134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7afbd-3948-4b45-940c-52e1c0e7c7c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:05.340432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7afbd-3948-4b45-940c-52e1c0e7c7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:05.340725 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7afbd-3948-4b45-940c-52e1c0e7c7c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:05.341424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7afbd-3948-4b45-940c-52e1c0e7c7c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:05.342420 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-77237286-2512-4179-820e-5317ca3e3583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:05.343440 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7afbd-3948-4b45-940c-52e1c0e7c7c0 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:05.359494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77237286-2512-4179-820e-5317ca3e3583 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:05.365246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017f933-5621-4347-9e2f-8872189145b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:05.366470 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017f933-5621-4347-9e2f-8872189145b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:05.366940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017f933-5621-4347-9e2f-8872189145b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:05.367401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017f933-5621-4347-9e2f-8872189145b7 admin admin] PATH_INFO: `/v3/users/5c5527e43a4c463e8661c02b815034c2` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:05.368872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017f933-5621-4347-9e2f-8872189145b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c5527e43a4c463e8661c02b815034c2)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:05.371274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e017f933-5621-4347-9e2f-8872189145b7 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:05.380831 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:05.496498 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 933/1864] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:05 2022] POST /identity/v3/projects => generated 373 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:05.504063 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7afbd-3948-4b45-940c-52e1c0e7c7c0 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:05.566693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:05.579697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e017f933-5621-4347-9e2f-8872189145b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c5527e43a4c463e8661c02b815034c2'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:05.594616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7afbd-3948-4b45-940c-52e1c0e7c7c0 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:05.600152 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2dcca-6b42-47dc-b110-9b514bbab5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:05.601092 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2dcca-6b42-47dc-b110-9b514bbab5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:05.601798 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2dcca-6b42-47dc-b110-9b514bbab5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:05.602202 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2dcca-6b42-47dc-b110-9b514bbab5e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:05.602446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e017f933-5621-4347-9e2f-8872189145b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c5527e43a4c463e8661c02b815034c2'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:05.603164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2dcca-6b42-47dc-b110-9b514bbab5e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:05.605826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2dcca-6b42-47dc-b110-9b514bbab5e1 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:05.617677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e017f933-5621-4347-9e2f-8872189145b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c5527e43a4c463e8661c02b815034c2'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:05.618656 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e017f933-5621-4347-9e2f-8872189145b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c5527e43a4c463e8661c02b815034c2'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:05.619579 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e017f933-5621-4347-9e2f-8872189145b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c5527e43a4c463e8661c02b815034c2'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:05.734425 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 932/1865] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:05 2022] DELETE /identity/v3/users/5c5527e43a4c463e8661c02b815034c2 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:05.736087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d27f3-6753-4bf3-8f25-6be3d3a938c4 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:05.736458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d27f3-6753-4bf3-8f25-6be3d3a938c4 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:05.736841 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d27f3-6753-4bf3-8f25-6be3d3a938c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:05.739332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 934/1866] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:05 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:05.744161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2dcca-6b42-47dc-b110-9b514bbab5e1 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:05.748534 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2ba2dcca-6b42-47dc-b110-9b514bbab5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:05.762196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2dcca-6b42-47dc-b110-9b514bbab5e1 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:05.783470 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-e33d27f3-6753-4bf3-8f25-6be3d3a938c4 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:05.784856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e33d27f3-6753-4bf3-8f25-6be3d3a938c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:05.823304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b47b88-18ac-4f00-86d8-8dac35101c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:05.824306 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b47b88-18ac-4f00-86d8-8dac35101c47 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:05.824819 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b47b88-18ac-4f00-86d8-8dac35101c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:05.825272 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b47b88-18ac-4f00-86d8-8dac35101c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:05.826393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b47b88-18ac-4f00-86d8-8dac35101c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:05.828236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b47b88-18ac-4f00-86d8-8dac35101c47 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:05.839776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 935/1867] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:05.851171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b47b88-18ac-4f00-86d8-8dac35101c47 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:05.863453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b47b88-18ac-4f00-86d8-8dac35101c47 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:05.873510 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9186892-28ca-4580-a527-d474d8c8a2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:05.874478 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9186892-28ca-4580-a527-d474d8c8a2c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:05.874730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9186892-28ca-4580-a527-d474d8c8a2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:05.875006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9186892-28ca-4580-a527-d474d8c8a2c6 admin admin] PATH_INFO: `/v3/projects/bf8e07dc277d40b8bc9a9b06eb8ccd5d/users/f2a6e1beb81e421896de6bb0e83498ab/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:05.880749 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 933/1868] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:05.890370 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d27f3-6753-4bf3-8f25-6be3d3a938c4 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:05.891726 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e33d27f3-6753-4bf3-8f25-6be3d3a938c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:05.892636 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9186892-28ca-4580-a527-d474d8c8a2c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf8e07dc277d40b8bc9a9b06eb8ccd5d, user_id=f2a6e1beb81e421896de6bb0e83498ab, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:05.895992 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9186892-28ca-4580-a527-d474d8c8a2c6 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:05.958287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 936/1869] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:05 2022] PUT /identity/v3/projects/bf8e07dc277d40b8bc9a9b06eb8ccd5d/users/f2a6e1beb81e421896de6bb0e83498ab/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:05.962797 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9186892-28ca-4580-a527-d474d8c8a2c6 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:05.970851 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d27f3-6753-4bf3-8f25-6be3d3a938c4 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:06.032096 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9186892-28ca-4580-a527-d474d8c8a2c6 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:06.033402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afdf56-1c9d-4db0-897e-33582cb33643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:06.034361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afdf56-1c9d-4db0-897e-33582cb33643 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:06.034708 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afdf56-1c9d-4db0-897e-33582cb33643 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:06.035049 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afdf56-1c9d-4db0-897e-33582cb33643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:06.037475 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e53062-2bc6-4412-af07-12a5f6591cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:06.038316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e53062-2bc6-4412-af07-12a5f6591cde admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:06.038659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e53062-2bc6-4412-af07-12a5f6591cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:06.038770 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e53062-2bc6-4412-af07-12a5f6591cde admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:06.039511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e53062-2bc6-4412-af07-12a5f6591cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:06.041364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e53062-2bc6-4412-af07-12a5f6591cde admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:06.045426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afdf56-1c9d-4db0-897e-33582cb33643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:06.046992 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afdf56-1c9d-4db0-897e-33582cb33643 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:06.057466 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 937/1870] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:38:06.059237 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 934/1871] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:38:06.068625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e53062-2bc6-4412-af07-12a5f6591cde admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:06.081838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e53062-2bc6-4412-af07-12a5f6591cde admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:06.090688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91efb06-60cd-46e2-99e3-c2fb166a65e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:06.091608 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91efb06-60cd-46e2-99e3-c2fb166a65e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:06.091890 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91efb06-60cd-46e2-99e3-c2fb166a65e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:06.092219 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91efb06-60cd-46e2-99e3-c2fb166a65e5 admin admin] PATH_INFO: `/v3/projects/bf8e07dc277d40b8bc9a9b06eb8ccd5d/users/f2a6e1beb81e421896de6bb0e83498ab/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:06.094293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91efb06-60cd-46e2-99e3-c2fb166a65e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf8e07dc277d40b8bc9a9b06eb8ccd5d, user_id=f2a6e1beb81e421896de6bb0e83498ab, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:06.097057 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91efb06-60cd-46e2-99e3-c2fb166a65e5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:06.128451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 938/1872] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:06 2022] PUT /identity/v3/projects/bf8e07dc277d40b8bc9a9b06eb8ccd5d/users/f2a6e1beb81e421896de6bb0e83498ab/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:06.138722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1420370-b4f6-48ed-8fb1-136936c8db80 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:06.139262 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1420370-b4f6-48ed-8fb1-136936c8db80 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:06.139717 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1420370-b4f6-48ed-8fb1-136936c8db80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:06.170885 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-b1420370-b4f6-48ed-8fb1-136936c8db80 None None] MFA Rules not processed for user `f2a6e1beb81e421896de6bb0e83498ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:06.172587 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b1420370-b4f6-48ed-8fb1-136936c8db80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:06.264238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 935/1873] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:06.283249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91efb06-60cd-46e2-99e3-c2fb166a65e5 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:06.287346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f91efb06-60cd-46e2-99e3-c2fb166a65e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:06.391207 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91efb06-60cd-46e2-99e3-c2fb166a65e5 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:06.395781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0953ed5-d985-4dd6-bbfe-b2866463a49e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:06.396452 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0953ed5-d985-4dd6-bbfe-b2866463a49e service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:06.396809 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0953ed5-d985-4dd6-bbfe-b2866463a49e service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:06.397163 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0953ed5-d985-4dd6-bbfe-b2866463a49e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:06.408787 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0953ed5-d985-4dd6-bbfe-b2866463a49e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:06.411393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0953ed5-d985-4dd6-bbfe-b2866463a49e service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:06.425845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 939/1874] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:06.638780 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:07.027311 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1420370-b4f6-48ed-8fb1-136936c8db80 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:07.029179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b1420370-b4f6-48ed-8fb1-136936c8db80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:07.133516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1420370-b4f6-48ed-8fb1-136936c8db80 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:07.138432 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162e665-c420-4f45-94a5-61b6178fd66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:07.139305 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162e665-c420-4f45-94a5-61b6178fd66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:07.139635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162e665-c420-4f45-94a5-61b6178fd66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:07.139856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162e665-c420-4f45-94a5-61b6178fd66d admin admin] PATH_INFO: `/v3/projects/b060bec73c8040e2a4b77110fd13065a` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:07.141068 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162e665-c420-4f45-94a5-61b6178fd66d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b060bec73c8040e2a4b77110fd13065a)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:07.143886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162e665-c420-4f45-94a5-61b6178fd66d admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:07.215048 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=80,keystone:INSERT=4,keystone:DELETE=16 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:07.323947 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a162e665-c420-4f45-94a5-61b6178fd66d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b060bec73c8040e2a4b77110fd13065a', 'request_id': 'req-a162e665-c420-4f45-94a5-61b6178fd66d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:07.341147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a162e665-c420-4f45-94a5-61b6178fd66d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b060bec73c8040e2a4b77110fd13065a', 'request_id': 'req-a162e665-c420-4f45-94a5-61b6178fd66d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:07.408758 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a162e665-c420-4f45-94a5-61b6178fd66d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b060bec73c8040e2a4b77110fd13065a', 'request_id': 'req-a162e665-c420-4f45-94a5-61b6178fd66d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:07.428260 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a162e665-c420-4f45-94a5-61b6178fd66d admin admin] The token cache is being invalidate because project b060bec73c8040e2a4b77110fd13065a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:07.428634 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a162e665-c420-4f45-94a5-61b6178fd66d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:07.443851 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a162e665-c420-4f45-94a5-61b6178fd66d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:07.443851 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 936/1875] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:07 2022] DELETE /identity/v3/projects/b060bec73c8040e2a4b77110fd13065a => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:07.445687 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0953ed5-d985-4dd6-bbfe-b2866463a49e service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:07.463009 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0953ed5-d985-4dd6-bbfe-b2866463a49e service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:07.548340 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f07c5e-bfb1-4b71-95a2-be14269295b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:07.555449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07c5e-bfb1-4b71-95a2-be14269295b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:07.555449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07c5e-bfb1-4b71-95a2-be14269295b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:07.555449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07c5e-bfb1-4b71-95a2-be14269295b5 admin admin] PATH_INFO: `/v3/users/a49c9ed313dc478da16d6f7877f42517` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:07.555449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f07c5e-bfb1-4b71-95a2-be14269295b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a49c9ed313dc478da16d6f7877f42517)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:07.555449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f07c5e-bfb1-4b71-95a2-be14269295b5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:07.840124 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f4f07c5e-bfb1-4b71-95a2-be14269295b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a49c9ed313dc478da16d6f7877f42517'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:07.852182 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:07.856629 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f4f07c5e-bfb1-4b71-95a2-be14269295b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a49c9ed313dc478da16d6f7877f42517'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:07.864757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f4f07c5e-bfb1-4b71-95a2-be14269295b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a49c9ed313dc478da16d6f7877f42517'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:07.865514 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f4f07c5e-bfb1-4b71-95a2-be14269295b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a49c9ed313dc478da16d6f7877f42517'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:07.866201 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f4f07c5e-bfb1-4b71-95a2-be14269295b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a49c9ed313dc478da16d6f7877f42517'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:07.981498 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 940/1876] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:07 2022] DELETE /identity/v3/users/a49c9ed313dc478da16d6f7877f42517 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:08.059326 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162e665-c420-4f45-94a5-61b6178fd66d admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:08.064065 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a162e665-c420-4f45-94a5-61b6178fd66d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:08.077812 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162e665-c420-4f45-94a5-61b6178fd66d admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:08.145483 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47529f0-f60d-42ab-b9ed-b7e4eda1a1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:08.149764 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47529f0-f60d-42ab-b9ed-b7e4eda1a1ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:08.149764 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47529f0-f60d-42ab-b9ed-b7e4eda1a1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:08.149764 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47529f0-f60d-42ab-b9ed-b7e4eda1a1ff admin admin] PATH_INFO: `/v3/users/5d0b0f9746054c52a6b4edd41310962e` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:08.149764 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47529f0-f60d-42ab-b9ed-b7e4eda1a1ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d0b0f9746054c52a6b4edd41310962e)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:08.151129 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47529f0-f60d-42ab-b9ed-b7e4eda1a1ff admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:08.375280 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a47529f0-f60d-42ab-b9ed-b7e4eda1a1ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d0b0f9746054c52a6b4edd41310962e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:08.396388 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a47529f0-f60d-42ab-b9ed-b7e4eda1a1ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d0b0f9746054c52a6b4edd41310962e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:08.405283 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a47529f0-f60d-42ab-b9ed-b7e4eda1a1ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d0b0f9746054c52a6b4edd41310962e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:08.406487 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a47529f0-f60d-42ab-b9ed-b7e4eda1a1ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d0b0f9746054c52a6b4edd41310962e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:08.407171 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a47529f0-f60d-42ab-b9ed-b7e4eda1a1ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d0b0f9746054c52a6b4edd41310962e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:08.534399 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 937/1877] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:08 2022] DELETE /identity/v3/users/5d0b0f9746054c52a6b4edd41310962e => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:08.536524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab27ac4-7d4e-4b7c-85cd-fb171891f767 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:08.537025 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab27ac4-7d4e-4b7c-85cd-fb171891f767 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:08.537116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab27ac4-7d4e-4b7c-85cd-fb171891f767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:08.559041 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-7ab27ac4-7d4e-4b7c-85cd-fb171891f767 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:08.560263 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-7ab27ac4-7d4e-4b7c-85cd-fb171891f767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:08.657148 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 941/1878] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:08.667097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47529f0-f60d-42ab-b9ed-b7e4eda1a1ff admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:08.668583 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a47529f0-f60d-42ab-b9ed-b7e4eda1a1ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:08.732245 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab27ac4-7d4e-4b7c-85cd-fb171891f767 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:08.733769 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47529f0-f60d-42ab-b9ed-b7e4eda1a1ff admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:08.734017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-7ab27ac4-7d4e-4b7c-85cd-fb171891f767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:08.737675 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c58ee-1100-4796-a1fa-392ff2ee7193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:08.738411 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c58ee-1100-4796-a1fa-392ff2ee7193 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:08.738697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c58ee-1100-4796-a1fa-392ff2ee7193 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:08.739029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c58ee-1100-4796-a1fa-392ff2ee7193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:08.750769 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c58ee-1100-4796-a1fa-392ff2ee7193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:08.752915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46c58ee-1100-4796-a1fa-392ff2ee7193 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:08.764172 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 938/1879] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:08.772874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab27ac4-7d4e-4b7c-85cd-fb171891f767 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:08.786495 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a1d8e-fafb-4319-acdf-6c760b42ef36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:08.786495 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a1d8e-fafb-4319-acdf-6c760b42ef36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:08.786495 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a1d8e-fafb-4319-acdf-6c760b42ef36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:08.786495 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a1d8e-fafb-4319-acdf-6c760b42ef36 admin admin] PATH_INFO: `/v3/projects/851345e7b9a248128df1df5e0b2975fc` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:08.786946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a1d8e-fafb-4319-acdf-6c760b42ef36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=851345e7b9a248128df1df5e0b2975fc)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:08.788552 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a1d8e-fafb-4319-acdf-6c760b42ef36 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:08.946278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a34a1d8e-fafb-4319-acdf-6c760b42ef36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '851345e7b9a248128df1df5e0b2975fc', 'request_id': 'req-a34a1d8e-fafb-4319-acdf-6c760b42ef36'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:08.952432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a34a1d8e-fafb-4319-acdf-6c760b42ef36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '851345e7b9a248128df1df5e0b2975fc', 'request_id': 'req-a34a1d8e-fafb-4319-acdf-6c760b42ef36'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:08.957893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a34a1d8e-fafb-4319-acdf-6c760b42ef36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '851345e7b9a248128df1df5e0b2975fc', 'request_id': 'req-a34a1d8e-fafb-4319-acdf-6c760b42ef36'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:09.066386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a34a1d8e-fafb-4319-acdf-6c760b42ef36 admin admin] The token cache is being invalidate because project 851345e7b9a248128df1df5e0b2975fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:09.069964 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a34a1d8e-fafb-4319-acdf-6c760b42ef36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:09.069964 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a34a1d8e-fafb-4319-acdf-6c760b42ef36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:09.069964 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 942/1880] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:08 2022] DELETE /identity/v3/projects/851345e7b9a248128df1df5e0b2975fc => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:38:09.073148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c58ee-1100-4796-a1fa-392ff2ee7193 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:09.085896 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c58ee-1100-4796-a1fa-392ff2ee7193 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:09.150470 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11c4fd-279c-4c09-9839-f05b9bda2f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:09.151366 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11c4fd-279c-4c09-9839-f05b9bda2f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:09.151820 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11c4fd-279c-4c09-9839-f05b9bda2f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:09.152109 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11c4fd-279c-4c09-9839-f05b9bda2f85 admin admin] PATH_INFO: `/v3/users/8a97518d21614677a4cd6dd9116ef91a` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:09.153336 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11c4fd-279c-4c09-9839-f05b9bda2f85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a97518d21614677a4cd6dd9116ef91a)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:09.155423 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11c4fd-279c-4c09-9839-f05b9bda2f85 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:09.301542 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:09.310363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a1d8e-fafb-4319-acdf-6c760b42ef36 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:09.311857 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-a34a1d8e-fafb-4319-acdf-6c760b42ef36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:09.328600 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a1d8e-fafb-4319-acdf-6c760b42ef36 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:09.339689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6fb37-6f32-4808-8ed0-0bc398959a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:09.340606 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6fb37-6f32-4808-8ed0-0bc398959a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:09.340911 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6fb37-6f32-4808-8ed0-0bc398959a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:09.341172 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6fb37-6f32-4808-8ed0-0bc398959a6d admin admin] PATH_INFO: `/v3/projects/d7ae646934c0410383f2f70d3020837f` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:09.342450 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6fb37-6f32-4808-8ed0-0bc398959a6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7ae646934c0410383f2f70d3020837f)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:09.344454 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6fb37-6f32-4808-8ed0-0bc398959a6d admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:09.410423 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-fa11c4fd-279c-4c09-9839-f05b9bda2f85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a97518d21614677a4cd6dd9116ef91a'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:09.420791 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:09.425041 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-fa11c4fd-279c-4c09-9839-f05b9bda2f85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a97518d21614677a4cd6dd9116ef91a'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:09.433989 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-fa11c4fd-279c-4c09-9839-f05b9bda2f85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a97518d21614677a4cd6dd9116ef91a'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:09.434920 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-fa11c4fd-279c-4c09-9839-f05b9bda2f85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a97518d21614677a4cd6dd9116ef91a'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:09.435975 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-fa11c4fd-279c-4c09-9839-f05b9bda2f85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a97518d21614677a4cd6dd9116ef91a'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:09.484863 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-13a6fb37-6f32-4808-8ed0-0bc398959a6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7ae646934c0410383f2f70d3020837f', 'request_id': 'req-13a6fb37-6f32-4808-8ed0-0bc398959a6d'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:09.492244 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-13a6fb37-6f32-4808-8ed0-0bc398959a6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7ae646934c0410383f2f70d3020837f', 'request_id': 'req-13a6fb37-6f32-4808-8ed0-0bc398959a6d'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:09.501170 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-13a6fb37-6f32-4808-8ed0-0bc398959a6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7ae646934c0410383f2f70d3020837f', 'request_id': 'req-13a6fb37-6f32-4808-8ed0-0bc398959a6d'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:09.566765 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 939/1881] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:09 2022] DELETE /identity/v3/users/8a97518d21614677a4cd6dd9116ef91a => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:09.669263 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-13a6fb37-6f32-4808-8ed0-0bc398959a6d admin admin] The token cache is being invalidate because project d7ae646934c0410383f2f70d3020837f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:09.671732 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-13a6fb37-6f32-4808-8ed0-0bc398959a6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:09.671732 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-13a6fb37-6f32-4808-8ed0-0bc398959a6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:09.671947 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 943/1882] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:09 2022] DELETE /identity/v3/projects/d7ae646934c0410383f2f70d3020837f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:38:09.676151 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11c4fd-279c-4c09-9839-f05b9bda2f85 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:09.677705 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-fa11c4fd-279c-4c09-9839-f05b9bda2f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:09.742990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11c4fd-279c-4c09-9839-f05b9bda2f85 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:09.747756 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643bca1-be90-445b-8758-9ddca63983e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:09.748638 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643bca1-be90-445b-8758-9ddca63983e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:09.748925 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643bca1-be90-445b-8758-9ddca63983e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:09.749196 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643bca1-be90-445b-8758-9ddca63983e9 admin admin] PATH_INFO: `/v3/users/f2a6e1beb81e421896de6bb0e83498ab` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:09.753746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643bca1-be90-445b-8758-9ddca63983e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2a6e1beb81e421896de6bb0e83498ab)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:09.753746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643bca1-be90-445b-8758-9ddca63983e9 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:10.229299 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-d643bca1-be90-445b-8758-9ddca63983e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2a6e1beb81e421896de6bb0e83498ab'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:10.233315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6fb37-6f32-4808-8ed0-0bc398959a6d admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:10.234881 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-13a6fb37-6f32-4808-8ed0-0bc398959a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:10.242455 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-d643bca1-be90-445b-8758-9ddca63983e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2a6e1beb81e421896de6bb0e83498ab'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:10.250685 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-d643bca1-be90-445b-8758-9ddca63983e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2a6e1beb81e421896de6bb0e83498ab'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:10.251480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-d643bca1-be90-445b-8758-9ddca63983e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2a6e1beb81e421896de6bb0e83498ab'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:10.252927 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-d643bca1-be90-445b-8758-9ddca63983e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2a6e1beb81e421896de6bb0e83498ab'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:10.308124 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6fb37-6f32-4808-8ed0-0bc398959a6d admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:10.313627 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840cf9e-e732-4551-897b-6e55e10f9a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:10.315016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840cf9e-e732-4551-897b-6e55e10f9a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:10.315306 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840cf9e-e732-4551-897b-6e55e10f9a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:10.315586 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840cf9e-e732-4551-897b-6e55e10f9a19 admin admin] PATH_INFO: `/v3/projects/2da5aceba2c74f539fc3e4377148c3a6` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:10.316793 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840cf9e-e732-4551-897b-6e55e10f9a19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da5aceba2c74f539fc3e4377148c3a6)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:10.319189 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9840cf9e-e732-4551-897b-6e55e10f9a19 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:10.340430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 940/1883] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:09 2022] DELETE /identity/v3/users/f2a6e1beb81e421896de6bb0e83498ab => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:10.467871 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-9840cf9e-e732-4551-897b-6e55e10f9a19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da5aceba2c74f539fc3e4377148c3a6', 'request_id': 'req-9840cf9e-e732-4551-897b-6e55e10f9a19'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:10.478727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-9840cf9e-e732-4551-897b-6e55e10f9a19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da5aceba2c74f539fc3e4377148c3a6', 'request_id': 'req-9840cf9e-e732-4551-897b-6e55e10f9a19'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:10.485947 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-9840cf9e-e732-4551-897b-6e55e10f9a19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da5aceba2c74f539fc3e4377148c3a6', 'request_id': 'req-9840cf9e-e732-4551-897b-6e55e10f9a19'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:10.595254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-9840cf9e-e732-4551-897b-6e55e10f9a19 admin admin] The token cache is being invalidate because project 2da5aceba2c74f539fc3e4377148c3a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:10.601144 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-9840cf9e-e732-4551-897b-6e55e10f9a19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:10.601144 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-9840cf9e-e732-4551-897b-6e55e10f9a19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:10.601144 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 944/1884] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:10 2022] DELETE /identity/v3/projects/2da5aceba2c74f539fc3e4377148c3a6 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:10.606462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a51768-5b03-4e7d-bcfe-ba2e799a65fd None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:10.606973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a51768-5b03-4e7d-bcfe-ba2e799a65fd None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:10.607095 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a51768-5b03-4e7d-bcfe-ba2e799a65fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:10.625425 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-f4a51768-5b03-4e7d-bcfe-ba2e799a65fd None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:10.626670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f4a51768-5b03-4e7d-bcfe-ba2e799a65fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:10.695411 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 941/1885] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:10.706336 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3065d-60d1-49e4-860c-6b5a87292930 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:10.707308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3065d-60d1-49e4-860c-6b5a87292930 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:10.707687 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a3065d-60d1-49e4-860c-6b5a87292930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:10.712165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:10.728680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-43a3065d-60d1-49e4-860c-6b5a87292930 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:10.730047 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-43a3065d-60d1-49e4-860c-6b5a87292930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:10.739565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 945/1886] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:10.747116 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a51768-5b03-4e7d-bcfe-ba2e799a65fd None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:10.760068 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a51768-5b03-4e7d-bcfe-ba2e799a65fd None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:10.765913 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbf5c1-0f8f-43da-9afe-5478de40a24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:10.766871 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbf5c1-0f8f-43da-9afe-5478de40a24a admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:10.767352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbf5c1-0f8f-43da-9afe-5478de40a24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:10.768401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbf5c1-0f8f-43da-9afe-5478de40a24a admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:10.769338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbf5c1-0f8f-43da-9afe-5478de40a24a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:38:10.769860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbf5c1-0f8f-43da-9afe-5478de40a24a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:10.771684 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbbf5c1-0f8f-43da-9afe-5478de40a24a admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:10.786551 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 942/1887] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:38:10.791213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3065d-60d1-49e4-860c-6b5a87292930 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:10.807687 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a3065d-60d1-49e4-860c-6b5a87292930 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:10.819698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f3541-6197-4e8b-bdf9-558632c24cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:10.831452 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f3541-6197-4e8b-bdf9-558632c24cbf admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:10.831889 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f3541-6197-4e8b-bdf9-558632c24cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:10.832315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f3541-6197-4e8b-bdf9-558632c24cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:10.833753 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f3541-6197-4e8b-bdf9-558632c24cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:10.835956 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f3541-6197-4e8b-bdf9-558632c24cbf admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:11.039536 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 946/1888] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:10 2022] POST /identity/v3/projects => generated 371 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:11.045114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbf5c1-0f8f-43da-9afe-5478de40a24a admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:11.058585 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbf5c1-0f8f-43da-9afe-5478de40a24a admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:11.128585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f3541-6197-4e8b-bdf9-558632c24cbf admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:11.130895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25225176-3eef-42d9-bd42-a04be49d5b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:11.131757 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25225176-3eef-42d9-bd42-a04be49d5b82 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:11.131757 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25225176-3eef-42d9-bd42-a04be49d5b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:11.132030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25225176-3eef-42d9-bd42-a04be49d5b82 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:11.133229 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25225176-3eef-42d9-bd42-a04be49d5b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:11.134760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-038f3541-6197-4e8b-bdf9-558632c24cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:11.136447 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25225176-3eef-42d9-bd42-a04be49d5b82 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:11.150546 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f3541-6197-4e8b-bdf9-558632c24cbf admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:11.156451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd81020-8d1e-4ec4-82b4-c8cd42ca85d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:11.157666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd81020-8d1e-4ec4-82b4-c8cd42ca85d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:11.158169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd81020-8d1e-4ec4-82b4-c8cd42ca85d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:11.158676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd81020-8d1e-4ec4-82b4-c8cd42ca85d2 admin admin] PATH_INFO: `/v3/projects/bf8e07dc277d40b8bc9a9b06eb8ccd5d` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:11.159978 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd81020-8d1e-4ec4-82b4-c8cd42ca85d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf8e07dc277d40b8bc9a9b06eb8ccd5d)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:11.162046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd81020-8d1e-4ec4-82b4-c8cd42ca85d2 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:11.224827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 943/1889] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:11 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:38:11.225653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25225176-3eef-42d9-bd42-a04be49d5b82 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:11.236312 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25225176-3eef-42d9-bd42-a04be49d5b82 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:11.241819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e8140-148f-421a-965b-37f8dee5e668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:11.242497 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e8140-148f-421a-965b-37f8dee5e668 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:11.242782 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e8140-148f-421a-965b-37f8dee5e668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:11.243061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e8140-148f-421a-965b-37f8dee5e668 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:11.243833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e8140-148f-421a-965b-37f8dee5e668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:11.245445 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e8140-148f-421a-965b-37f8dee5e668 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:11.257827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 944/1890] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:38:11.260913 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e8140-148f-421a-965b-37f8dee5e668 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:11.274955 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e8140-148f-421a-965b-37f8dee5e668 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:11.280049 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f350d2c-82e8-49ef-bc80-1bd7ce417cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:11.280885 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f350d2c-82e8-49ef-bc80-1bd7ce417cae admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:11.284908 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f350d2c-82e8-49ef-bc80-1bd7ce417cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:11.284908 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f350d2c-82e8-49ef-bc80-1bd7ce417cae admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:11.284908 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f350d2c-82e8-49ef-bc80-1bd7ce417cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:11.284908 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f350d2c-82e8-49ef-bc80-1bd7ce417cae admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:11.296027 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 945/1891] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:38:11.300744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f350d2c-82e8-49ef-bc80-1bd7ce417cae admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:11.312004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f350d2c-82e8-49ef-bc80-1bd7ce417cae admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:11.332119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ebd81020-8d1e-4ec4-82b4-c8cd42ca85d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf8e07dc277d40b8bc9a9b06eb8ccd5d', 'request_id': 'req-ebd81020-8d1e-4ec4-82b4-c8cd42ca85d2'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:11.341603 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:INSERT=6,keystone:SELECT=87,keystone:DELETE=7 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:11.360025 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ebd81020-8d1e-4ec4-82b4-c8cd42ca85d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf8e07dc277d40b8bc9a9b06eb8ccd5d', 'request_id': 'req-ebd81020-8d1e-4ec4-82b4-c8cd42ca85d2'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:11.374884 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ebd81020-8d1e-4ec4-82b4-c8cd42ca85d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf8e07dc277d40b8bc9a9b06eb8ccd5d', 'request_id': 'req-ebd81020-8d1e-4ec4-82b4-c8cd42ca85d2'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:11.384738 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd200751-9f1a-440a-ad69-728379d98a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:11.386114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd200751-9f1a-440a-ad69-728379d98a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:11.386469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd200751-9f1a-440a-ad69-728379d98a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:11.386820 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd200751-9f1a-440a-ad69-728379d98a12 admin admin] PATH_INFO: `/v3/projects/1cddd6e65016460f86475362da73a2ae/users/de39c3c89d9440ac8f655b420477c043/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:11.404023 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd200751-9f1a-440a-ad69-728379d98a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cddd6e65016460f86475362da73a2ae, user_id=de39c3c89d9440ac8f655b420477c043, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:11.406816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd200751-9f1a-440a-ad69-728379d98a12 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:11.471006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ebd81020-8d1e-4ec4-82b4-c8cd42ca85d2 admin admin] The token cache is being invalidate because project bf8e07dc277d40b8bc9a9b06eb8ccd5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:11.471239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ebd81020-8d1e-4ec4-82b4-c8cd42ca85d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:11.471866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ebd81020-8d1e-4ec4-82b4-c8cd42ca85d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:11.473464 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 947/1892] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:11 2022] DELETE /identity/v3/projects/bf8e07dc277d40b8bc9a9b06eb8ccd5d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:11.478152 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfeec4-59e3-494f-99cb-dd89122a301e None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:11.478699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfeec4-59e3-494f-99cb-dd89122a301e None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:11.478978 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfeec4-59e3-494f-99cb-dd89122a301e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:11.497678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-39dfeec4-59e3-494f-99cb-dd89122a301e None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:11.505832 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-39dfeec4-59e3-494f-99cb-dd89122a301e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:11.505966 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 946/1893] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:11 2022] PUT /identity/v3/projects/1cddd6e65016460f86475362da73a2ae/users/de39c3c89d9440ac8f655b420477c043/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:38:11.507508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a8b29-228d-40e0-a11e-da5d08bf1b27 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:11.507804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a8b29-228d-40e0-a11e-da5d08bf1b27 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:11.508125 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a8b29-228d-40e0-a11e-da5d08bf1b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:11.528302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-a04a8b29-228d-40e0-a11e-da5d08bf1b27 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:11.530186 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a04a8b29-228d-40e0-a11e-da5d08bf1b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:11.625159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 948/1894] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:38:11.635634 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82ac2-10b1-45f4-96e5-e60308427413 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:11.635634 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82ac2-10b1-45f4-96e5-e60308427413 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:11.635634 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82ac2-10b1-45f4-96e5-e60308427413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:11.684754 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 947/1895] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:11.699250 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-41a82ac2-10b1-45f4-96e5-e60308427413 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:11.700834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-41a82ac2-10b1-45f4-96e5-e60308427413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:11.706477 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:11.714428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a8b29-228d-40e0-a11e-da5d08bf1b27 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:11.715853 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a04a8b29-228d-40e0-a11e-da5d08bf1b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:11.725905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 949/1896] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:38:11.731746 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82ac2-10b1-45f4-96e5-e60308427413 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:11.762731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82ac2-10b1-45f4-96e5-e60308427413 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:11.768270 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdc5fc-ed22-40c8-9492-a9c1e5ace462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:11.769632 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdc5fc-ed22-40c8-9492-a9c1e5ace462 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:11.770125 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdc5fc-ed22-40c8-9492-a9c1e5ace462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:11.770550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cdc5fc-ed22-40c8-9492-a9c1e5ace462 admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:11.771670 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdc5fc-ed22-40c8-9492-a9c1e5ace462 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:38:11.772150 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdc5fc-ed22-40c8-9492-a9c1e5ace462 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:11.774120 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cdc5fc-ed22-40c8-9492-a9c1e5ace462 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:11.790322 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 950/1897] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:38:11.795419 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdc5fc-ed22-40c8-9492-a9c1e5ace462 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:11.824995 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cdc5fc-ed22-40c8-9492-a9c1e5ace462 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:11.830926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97280da1-9c80-41a1-ab98-7c391e7c0b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:11.831656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97280da1-9c80-41a1-ab98-7c391e7c0b2e admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:11.831946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97280da1-9c80-41a1-ab98-7c391e7c0b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:11.832285 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97280da1-9c80-41a1-ab98-7c391e7c0b2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:11.832989 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97280da1-9c80-41a1-ab98-7c391e7c0b2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:11.839091 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97280da1-9c80-41a1-ab98-7c391e7c0b2e admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:11.844947 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a8b29-228d-40e0-a11e-da5d08bf1b27 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:11.856875 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be3018-5b94-4348-966b-df1b8f1744ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:11.857705 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be3018-5b94-4348-966b-df1b8f1744ec service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:11.858000 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be3018-5b94-4348-966b-df1b8f1744ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:11.858442 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be3018-5b94-4348-966b-df1b8f1744ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:11.962184 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be3018-5b94-4348-966b-df1b8f1744ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:11.962184 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be3018-5b94-4348-966b-df1b8f1744ec service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:11.962184 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 948/1898] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:13.086716 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 951/1899] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:11 2022] POST /identity/v3/projects => generated 365 bytes in 1292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:13.087292 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be3018-5b94-4348-966b-df1b8f1744ec service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:13.100729 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be3018-5b94-4348-966b-df1b8f1744ec service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:13.178997 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b9095-c0d9-4219-9127-37aba055e0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:13.179688 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b9095-c0d9-4219-9127-37aba055e0df admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:13.179973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b9095-c0d9-4219-9127-37aba055e0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:13.180264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b9095-c0d9-4219-9127-37aba055e0df admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:13.181135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b9095-c0d9-4219-9127-37aba055e0df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:13.183748 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b9095-c0d9-4219-9127-37aba055e0df admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:13.347126 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 949/1900] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:13 2022] POST /identity/v3/users => generated 283 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:13.348551 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97280da1-9c80-41a1-ab98-7c391e7c0b2e admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:13.361188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97280da1-9c80-41a1-ab98-7c391e7c0b2e admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:13.380608 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf05e4c-7031-41f1-b059-981a69fb4e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:13.381466 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf05e4c-7031-41f1-b059-981a69fb4e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:13.382724 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf05e4c-7031-41f1-b059-981a69fb4e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:13.383277 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf05e4c-7031-41f1-b059-981a69fb4e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:13.384243 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf05e4c-7031-41f1-b059-981a69fb4e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:13.386629 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf05e4c-7031-41f1-b059-981a69fb4e8c admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:13.401734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 952/1901] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:13.422933 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b9095-c0d9-4219-9127-37aba055e0df admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:13.435103 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b9095-c0d9-4219-9127-37aba055e0df admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:13.440352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd301e91-9290-40ed-b12f-fa877d2d2774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:13.441069 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301e91-9290-40ed-b12f-fa877d2d2774 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:13.441357 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301e91-9290-40ed-b12f-fa877d2d2774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:13.448401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd301e91-9290-40ed-b12f-fa877d2d2774 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:13.448401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd301e91-9290-40ed-b12f-fa877d2d2774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:13.448401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd301e91-9290-40ed-b12f-fa877d2d2774 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:13.460593 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 950/1902] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:13.461760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf05e4c-7031-41f1-b059-981a69fb4e8c admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:13.472763 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf05e4c-7031-41f1-b059-981a69fb4e8c admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:13.481329 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95c5b6-3a38-47df-8051-3a31f34e2889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:13.482272 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95c5b6-3a38-47df-8051-3a31f34e2889 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:13.482557 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95c5b6-3a38-47df-8051-3a31f34e2889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:13.482831 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95c5b6-3a38-47df-8051-3a31f34e2889 admin admin] PATH_INFO: `/v3/projects/badd0bf599e549ae9d2b3fb8912a1465/users/5c7c526a3e0c47b0b8b3e6e87b3d7883/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:13.499358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95c5b6-3a38-47df-8051-3a31f34e2889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=badd0bf599e549ae9d2b3fb8912a1465, user_id=5c7c526a3e0c47b0b8b3e6e87b3d7883, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:13.502720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95c5b6-3a38-47df-8051-3a31f34e2889 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:13.641447 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 953/1903] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:13 2022] PUT /identity/v3/projects/badd0bf599e549ae9d2b3fb8912a1465/users/5c7c526a3e0c47b0b8b3e6e87b3d7883/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:38:13.661588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d115f1-fc6d-4538-a447-c70077640f8d None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:13.661588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d115f1-fc6d-4538-a447-c70077640f8d None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:13.661588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d115f1-fc6d-4538-a447-c70077640f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:13.680755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-45d115f1-fc6d-4538-a447-c70077640f8d None None] MFA Rules not processed for user `5c7c526a3e0c47b0b8b3e6e87b3d7883`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:13.682022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-45d115f1-fc6d-4538-a447-c70077640f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:13.748914 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 951/1904] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:13.757872 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95c5b6-3a38-47df-8051-3a31f34e2889 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:13.824733 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95c5b6-3a38-47df-8051-3a31f34e2889 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:13.830806 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117920c9-1fd1-49b0-ae44-2b19a4f62115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:13.831474 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117920c9-1fd1-49b0-ae44-2b19a4f62115 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:13.831763 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117920c9-1fd1-49b0-ae44-2b19a4f62115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:13.832045 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117920c9-1fd1-49b0-ae44-2b19a4f62115 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:13.832732 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117920c9-1fd1-49b0-ae44-2b19a4f62115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:13.835392 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117920c9-1fd1-49b0-ae44-2b19a4f62115 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:13.957134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 954/1905] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:13 2022] POST /identity/v3/projects => generated 363 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:13.958412 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d115f1-fc6d-4538-a447-c70077640f8d None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:13.969847 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d115f1-fc6d-4538-a447-c70077640f8d None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:14.031171 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733262e2-7ab6-4887-bdc2-2478faa7df47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:14.031945 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733262e2-7ab6-4887-bdc2-2478faa7df47 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:14.032232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733262e2-7ab6-4887-bdc2-2478faa7df47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:14.032513 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733262e2-7ab6-4887-bdc2-2478faa7df47 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:14.033915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733262e2-7ab6-4887-bdc2-2478faa7df47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:14.036063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733262e2-7ab6-4887-bdc2-2478faa7df47 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:14.147836 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:14.150208 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 952/1906] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:13 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:14.151013 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117920c9-1fd1-49b0-ae44-2b19a4f62115 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:14.174365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117920c9-1fd1-49b0-ae44-2b19a4f62115 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:14.179341 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6a711-d19f-4dfb-bdd3-4882d4588eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:14.180097 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6a711-d19f-4dfb-bdd3-4882d4588eee admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:14.180450 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6a711-d19f-4dfb-bdd3-4882d4588eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:14.181162 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6a711-d19f-4dfb-bdd3-4882d4588eee admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:14.181668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6a711-d19f-4dfb-bdd3-4882d4588eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:14.183347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6a711-d19f-4dfb-bdd3-4882d4588eee admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:14.200133 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 955/1907] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:38:14.209611 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733262e2-7ab6-4887-bdc2-2478faa7df47 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:14.215782 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733262e2-7ab6-4887-bdc2-2478faa7df47 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:14.221481 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0aa837-1a26-4c97-b432-3e59d30fbb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:14.222550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0aa837-1a26-4c97-b432-3e59d30fbb6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:14.222902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0aa837-1a26-4c97-b432-3e59d30fbb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:14.223185 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0aa837-1a26-4c97-b432-3e59d30fbb6c admin admin] PATH_INFO: `/v3/projects/8226b43e57324439bed514d849718c58/users/1f2300854b13465681892f0a71fdc8b7/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:14.231333 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:14.241201 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0aa837-1a26-4c97-b432-3e59d30fbb6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8226b43e57324439bed514d849718c58, user_id=1f2300854b13465681892f0a71fdc8b7, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:14.244075 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0aa837-1a26-4c97-b432-3e59d30fbb6c admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:14.333859 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 953/1908] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:14 2022] PUT /identity/v3/projects/8226b43e57324439bed514d849718c58/users/1f2300854b13465681892f0a71fdc8b7/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:14.341294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6a711-d19f-4dfb-bdd3-4882d4588eee admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:14.352457 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6a711-d19f-4dfb-bdd3-4882d4588eee admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:14.423156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476e252-297a-42f7-835b-8f4edb1ec577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:14.423934 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476e252-297a-42f7-835b-8f4edb1ec577 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:14.425652 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476e252-297a-42f7-835b-8f4edb1ec577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:14.431699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476e252-297a-42f7-835b-8f4edb1ec577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:14.431699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476e252-297a-42f7-835b-8f4edb1ec577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:14.431699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0476e252-297a-42f7-835b-8f4edb1ec577 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:14.445581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 956/1909] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:14.447693 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0aa837-1a26-4c97-b432-3e59d30fbb6c admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:14.462908 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0aa837-1a26-4c97-b432-3e59d30fbb6c admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:14.469686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebe4d8-1f18-46ce-9760-ffbd2cfd8fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:14.470618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebe4d8-1f18-46ce-9760-ffbd2cfd8fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:14.471542 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebe4d8-1f18-46ce-9760-ffbd2cfd8fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:14.472560 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebe4d8-1f18-46ce-9760-ffbd2cfd8fb8 admin admin] PATH_INFO: `/v3/projects/8226b43e57324439bed514d849718c58/users/1f2300854b13465681892f0a71fdc8b7/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:14.475350 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebe4d8-1f18-46ce-9760-ffbd2cfd8fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8226b43e57324439bed514d849718c58, user_id=1f2300854b13465681892f0a71fdc8b7, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:14.480111 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aebe4d8-1f18-46ce-9760-ffbd2cfd8fb8 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:14.495570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 954/1910] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:14 2022] PUT /identity/v3/projects/8226b43e57324439bed514d849718c58/users/1f2300854b13465681892f0a71fdc8b7/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:38:14.506525 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718236de-20d8-41b1-b023-08fff44f1088 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:14.506525 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718236de-20d8-41b1-b023-08fff44f1088 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:14.506687 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718236de-20d8-41b1-b023-08fff44f1088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:14.565127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-718236de-20d8-41b1-b023-08fff44f1088 None None] MFA Rules not processed for user `1f2300854b13465681892f0a71fdc8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:14.566804 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-718236de-20d8-41b1-b023-08fff44f1088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:14.650785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 957/1911] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:14 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:14.663741 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebe4d8-1f18-46ce-9760-ffbd2cfd8fb8 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:14.665555 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9aebe4d8-1f18-46ce-9760-ffbd2cfd8fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:14.777331 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aebe4d8-1f18-46ce-9760-ffbd2cfd8fb8 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:14.786104 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b86e8a-8df6-465b-b72f-f1258716a65a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:14.786841 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b86e8a-8df6-465b-b72f-f1258716a65a service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:14.787127 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b86e8a-8df6-465b-b72f-f1258716a65a service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:14.787405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b86e8a-8df6-465b-b72f-f1258716a65a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:14.805305 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b86e8a-8df6-465b-b72f-f1258716a65a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:14.809262 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b86e8a-8df6-465b-b72f-f1258716a65a service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:14.822450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 955/1912] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:14 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:14.918611 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:14.937384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccb56b-5707-41c4-912b-50140c2f61ec None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:14.937799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccb56b-5707-41c4-912b-50140c2f61ec None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:14.938091 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccb56b-5707-41c4-912b-50140c2f61ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:14.987158 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-7fccb56b-5707-41c4-912b-50140c2f61ec None None] MFA Rules not processed for user `de39c3c89d9440ac8f655b420477c043`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:14.987158 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-7fccb56b-5707-41c4-912b-50140c2f61ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:15.060649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 958/1913] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:15.072265 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b86e8a-8df6-465b-b72f-f1258716a65a service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:15.081234 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b86e8a-8df6-465b-b72f-f1258716a65a service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:15.085299 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c6d16-998f-4181-a536-b5b88d1bf679 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:15.086054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c6d16-998f-4181-a536-b5b88d1bf679 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:15.090392 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c6d16-998f-4181-a536-b5b88d1bf679 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:15.090392 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c6d16-998f-4181-a536-b5b88d1bf679 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:15.099743 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c6d16-998f-4181-a536-b5b88d1bf679 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:15.101492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c6d16-998f-4181-a536-b5b88d1bf679 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:15.102147 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccb56b-5707-41c4-912b-50140c2f61ec None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:15.105965 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-7fccb56b-5707-41c4-912b-50140c2f61ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:15.116771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccb56b-5707-41c4-912b-50140c2f61ec None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:15.117461 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 956/1914] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:15.121036 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bd7b2-25c1-40b9-bcae-76bf82bec7bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:15.121837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bd7b2-25c1-40b9-bcae-76bf82bec7bb service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:15.122586 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bd7b2-25c1-40b9-bcae-76bf82bec7bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:15.122586 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bd7b2-25c1-40b9-bcae-76bf82bec7bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:15.193014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bd7b2-25c1-40b9-bcae-76bf82bec7bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:15.194686 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bd7b2-25c1-40b9-bcae-76bf82bec7bb service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:15.204736 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 959/1915] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:38:15.587352 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:16.409590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:17.246408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:17.488367 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:18.157732 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:18.195546 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:19.180947 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aa293-5dfe-4e40-8496-9c509a903a3c None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:19.181423 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aa293-5dfe-4e40-8496-9c509a903a3c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:19.181516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aa293-5dfe-4e40-8496-9c509a903a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:19.186276 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:19.204720 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-377aa293-5dfe-4e40-8496-9c509a903a3c None None] MFA Rules not processed for user `de39c3c89d9440ac8f655b420477c043`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:19.206775 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-377aa293-5dfe-4e40-8496-9c509a903a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:19.223347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 957/1916] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:19.471946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:20.518261 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:20.570242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee6211-728c-4739-b955-f2d3407b7fe6 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:20.570801 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee6211-728c-4739-b955-f2d3407b7fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:20.572491 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee6211-728c-4739-b955-f2d3407b7fe6 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:20.574548 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 960/1917] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 08:38:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:38:20.601757 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:20.661836 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7635091-f5c8-42b4-9c23-a127030ed2c4 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:20.662312 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7635091-f5c8-42b4-9c23-a127030ed2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:20.662696 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7635091-f5c8-42b4-9c23-a127030ed2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:20.690474 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-a7635091-f5c8-42b4-9c23-a127030ed2c4 None None] MFA Rules not processed for user `b6670a010c034f7999c9445452c02473`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:20.691739 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a7635091-f5c8-42b4-9c23-a127030ed2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:20.840751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 958/1918] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 08:38:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:20.862409 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee6211-728c-4739-b955-f2d3407b7fe6 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:20.864165 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2fee6211-728c-4739-b955-f2d3407b7fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:20.885466 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee6211-728c-4739-b955-f2d3407b7fe6 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:20.901064 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55965df1-9afe-4147-aa2c-e3eafac38bc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:20.902460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55965df1-9afe-4147-aa2c-e3eafac38bc5 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:20.903080 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55965df1-9afe-4147-aa2c-e3eafac38bc5 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:20.903404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55965df1-9afe-4147-aa2c-e3eafac38bc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:20.915508 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55965df1-9afe-4147-aa2c-e3eafac38bc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:20.917390 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55965df1-9afe-4147-aa2c-e3eafac38bc5 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:20.929751 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 961/1919] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:22.086620 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:22.114852 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:22.414180 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:22.431389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:22.568718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:22.591574 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:22.694702 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:32.031643 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7635091-f5c8-42b4-9c23-a127030ed2c4 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:32.033837 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a7635091-f5c8-42b4-9c23-a127030ed2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:32.107768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7635091-f5c8-42b4-9c23-a127030ed2c4 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:32.114546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec6148-273d-43ed-93db-c8102c17a748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:32.115490 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec6148-273d-43ed-93db-c8102c17a748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:32.115776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec6148-273d-43ed-93db-c8102c17a748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:32.116056 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aec6148-273d-43ed-93db-c8102c17a748 admin admin] PATH_INFO: `/v3/users/303611ae87c046af8efc51986234d295` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:32.117474 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec6148-273d-43ed-93db-c8102c17a748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=303611ae87c046af8efc51986234d295)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:32.119482 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aec6148-273d-43ed-93db-c8102c17a748 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:32.146487 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:32.383022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4aec6148-273d-43ed-93db-c8102c17a748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '303611ae87c046af8efc51986234d295'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:32.396679 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4aec6148-273d-43ed-93db-c8102c17a748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '303611ae87c046af8efc51986234d295'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:32.404197 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4aec6148-273d-43ed-93db-c8102c17a748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '303611ae87c046af8efc51986234d295'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:32.405002 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4aec6148-273d-43ed-93db-c8102c17a748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '303611ae87c046af8efc51986234d295'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:32.405653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4aec6148-273d-43ed-93db-c8102c17a748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '303611ae87c046af8efc51986234d295'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:32.513644 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad1a7a-7f31-4f70-862d-0c91a86ca22c None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:32.514342 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad1a7a-7f31-4f70-862d-0c91a86ca22c None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:32.514434 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad1a7a-7f31-4f70-862d-0c91a86ca22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:32.522170 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 959/1920] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:32 2022] DELETE /identity/v3/users/303611ae87c046af8efc51986234d295 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:32.546877 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-afad1a7a-7f31-4f70-862d-0c91a86ca22c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:32.548525 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-afad1a7a-7f31-4f70-862d-0c91a86ca22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:32.735128 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 962/1921] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:32.757252 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec6148-273d-43ed-93db-c8102c17a748 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:32.759156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-4aec6148-273d-43ed-93db-c8102c17a748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:32.838787 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aec6148-273d-43ed-93db-c8102c17a748 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:32.843331 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6b7cd-353b-45c7-85ce-20ed5236ff8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:32.843987 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6b7cd-353b-45c7-85ce-20ed5236ff8d service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:32.844270 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6b7cd-353b-45c7-85ce-20ed5236ff8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:32.844576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6b7cd-353b-45c7-85ce-20ed5236ff8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:32.854634 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6b7cd-353b-45c7-85ce-20ed5236ff8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:32.856090 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6b7cd-353b-45c7-85ce-20ed5236ff8d service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:32.867371 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 960/1922] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:33.478848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad1a7a-7f31-4f70-862d-0c91a86ca22c None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:33.480459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-afad1a7a-7f31-4f70-862d-0c91a86ca22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:33.495482 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad1a7a-7f31-4f70-862d-0c91a86ca22c None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:33.502217 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b87be4-5875-48bd-a6aa-da68fa265708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:33.503636 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b87be4-5875-48bd-a6aa-da68fa265708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:33.504071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b87be4-5875-48bd-a6aa-da68fa265708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:33.504522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b87be4-5875-48bd-a6aa-da68fa265708 admin admin] PATH_INFO: `/v3/projects/bd45054d508f413c97dedb35791f7f34` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:33.506131 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b87be4-5875-48bd-a6aa-da68fa265708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd45054d508f413c97dedb35791f7f34)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:33.525082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b87be4-5875-48bd-a6aa-da68fa265708 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:33.656389 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-81b87be4-5875-48bd-a6aa-da68fa265708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd45054d508f413c97dedb35791f7f34', 'request_id': 'req-81b87be4-5875-48bd-a6aa-da68fa265708'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:33.665801 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-81b87be4-5875-48bd-a6aa-da68fa265708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd45054d508f413c97dedb35791f7f34', 'request_id': 'req-81b87be4-5875-48bd-a6aa-da68fa265708'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:33.673271 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-81b87be4-5875-48bd-a6aa-da68fa265708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd45054d508f413c97dedb35791f7f34', 'request_id': 'req-81b87be4-5875-48bd-a6aa-da68fa265708'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:33.830848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-81b87be4-5875-48bd-a6aa-da68fa265708 admin admin] The token cache is being invalidate because project bd45054d508f413c97dedb35791f7f34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:33.831417 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-81b87be4-5875-48bd-a6aa-da68fa265708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:33.832767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-81b87be4-5875-48bd-a6aa-da68fa265708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:33.841004 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 963/1923] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:33 2022] DELETE /identity/v3/projects/bd45054d508f413c97dedb35791f7f34 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:33.842324 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6b7cd-353b-45c7-85ce-20ed5236ff8d service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:33.885375 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6b7cd-353b-45c7-85ce-20ed5236ff8d service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:34.007640 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed8b48-054d-4432-b0ae-06d7900f2184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:34.008535 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed8b48-054d-4432-b0ae-06d7900f2184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:34.008821 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed8b48-054d-4432-b0ae-06d7900f2184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:34.009098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed8b48-054d-4432-b0ae-06d7900f2184 admin admin] PATH_INFO: `/v3/users/532864bcae4e4fbcb4d9dc8b0d8d4edd` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:34.010487 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed8b48-054d-4432-b0ae-06d7900f2184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=532864bcae4e4fbcb4d9dc8b0d8d4edd)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:34.013241 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed8b48-054d-4432-b0ae-06d7900f2184 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:34.101512 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b87be4-5875-48bd-a6aa-da68fa265708 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:34.103155 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-81b87be4-5875-48bd-a6aa-da68fa265708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:34.123345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b87be4-5875-48bd-a6aa-da68fa265708 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:34.128760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a5a09-7a09-4148-a938-524a6bb3a014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:34.129679 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5a09-7a09-4148-a938-524a6bb3a014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:34.129968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5a09-7a09-4148-a938-524a6bb3a014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:34.130251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a5a09-7a09-4148-a938-524a6bb3a014 admin admin] PATH_INFO: `/v3/users/5c7c526a3e0c47b0b8b3e6e87b3d7883` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:34.131491 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a5a09-7a09-4148-a938-524a6bb3a014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c7c526a3e0c47b0b8b3e6e87b3d7883)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:34.133713 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a5a09-7a09-4148-a938-524a6bb3a014 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:34.136859 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:34.245247 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:34.248875 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7aed8b48-054d-4432-b0ae-06d7900f2184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '532864bcae4e4fbcb4d9dc8b0d8d4edd'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:34.270285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7aed8b48-054d-4432-b0ae-06d7900f2184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '532864bcae4e4fbcb4d9dc8b0d8d4edd'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:34.280551 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7aed8b48-054d-4432-b0ae-06d7900f2184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '532864bcae4e4fbcb4d9dc8b0d8d4edd'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:34.281307 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7aed8b48-054d-4432-b0ae-06d7900f2184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '532864bcae4e4fbcb4d9dc8b0d8d4edd'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:34.281981 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7aed8b48-054d-4432-b0ae-06d7900f2184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '532864bcae4e4fbcb4d9dc8b0d8d4edd'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:34.338585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c35a5a09-7a09-4148-a938-524a6bb3a014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c7c526a3e0c47b0b8b3e6e87b3d7883'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:34.356015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c35a5a09-7a09-4148-a938-524a6bb3a014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c7c526a3e0c47b0b8b3e6e87b3d7883'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:34.372644 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c35a5a09-7a09-4148-a938-524a6bb3a014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c7c526a3e0c47b0b8b3e6e87b3d7883'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:34.373588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c35a5a09-7a09-4148-a938-524a6bb3a014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c7c526a3e0c47b0b8b3e6e87b3d7883'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:34.374426 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c35a5a09-7a09-4148-a938-524a6bb3a014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c7c526a3e0c47b0b8b3e6e87b3d7883'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:34.416149 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 961/1924] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:33 2022] DELETE /identity/v3/users/532864bcae4e4fbcb4d9dc8b0d8d4edd => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:34.506750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 964/1925] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:34 2022] DELETE /identity/v3/users/5c7c526a3e0c47b0b8b3e6e87b3d7883 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:34.511514 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31353a9a-ec5e-4776-8d6e-79dcbcbbb8c6 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:34.511787 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31353a9a-ec5e-4776-8d6e-79dcbcbbb8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:34.512066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31353a9a-ec5e-4776-8d6e-79dcbcbbb8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:34.559917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-31353a9a-ec5e-4776-8d6e-79dcbcbbb8c6 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:34.562109 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-31353a9a-ec5e-4776-8d6e-79dcbcbbb8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:34.669000 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 962/1926] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:38:34.679397 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a5a09-7a09-4148-a938-524a6bb3a014 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:34.680977 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-c35a5a09-7a09-4148-a938-524a6bb3a014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:34.747174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a5a09-7a09-4148-a938-524a6bb3a014 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:34.770621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9177dd-6410-4182-aef7-d2147b320318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:34.771464 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9177dd-6410-4182-aef7-d2147b320318 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:34.771750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9177dd-6410-4182-aef7-d2147b320318 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:34.772201 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9177dd-6410-4182-aef7-d2147b320318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:34.786249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9177dd-6410-4182-aef7-d2147b320318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:34.787900 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9177dd-6410-4182-aef7-d2147b320318 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:34.842872 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 965/1927] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:35.244478 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31353a9a-ec5e-4776-8d6e-79dcbcbbb8c6 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:35.246515 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-31353a9a-ec5e-4776-8d6e-79dcbcbbb8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:35.272704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31353a9a-ec5e-4776-8d6e-79dcbcbbb8c6 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:35.278783 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cde60-eb5e-496e-914d-d0089998e165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:35.279660 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cde60-eb5e-496e-914d-d0089998e165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:35.279949 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cde60-eb5e-496e-914d-d0089998e165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:35.280224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cde60-eb5e-496e-914d-d0089998e165 admin admin] PATH_INFO: `/v3/projects/ea10aaf49bc94c8b9a8f8b613c25f205` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:35.281427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cde60-eb5e-496e-914d-d0089998e165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea10aaf49bc94c8b9a8f8b613c25f205)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:35.285737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cde60-eb5e-496e-914d-d0089998e165 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:35.421757 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-825cde60-eb5e-496e-914d-d0089998e165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea10aaf49bc94c8b9a8f8b613c25f205', 'request_id': 'req-825cde60-eb5e-496e-914d-d0089998e165'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:35.427468 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-825cde60-eb5e-496e-914d-d0089998e165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea10aaf49bc94c8b9a8f8b613c25f205', 'request_id': 'req-825cde60-eb5e-496e-914d-d0089998e165'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:35.510933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9177dd-6410-4182-aef7-d2147b320318 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:35.512415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5b9177dd-6410-4182-aef7-d2147b320318 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:35.526076 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9177dd-6410-4182-aef7-d2147b320318 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:35.543210 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-825cde60-eb5e-496e-914d-d0089998e165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea10aaf49bc94c8b9a8f8b613c25f205', 'request_id': 'req-825cde60-eb5e-496e-914d-d0089998e165'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:35.558190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-825cde60-eb5e-496e-914d-d0089998e165 admin admin] The token cache is being invalidate because project ea10aaf49bc94c8b9a8f8b613c25f205 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:35.558488 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-825cde60-eb5e-496e-914d-d0089998e165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:35.559152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-825cde60-eb5e-496e-914d-d0089998e165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:35.561332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 963/1928] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:35 2022] DELETE /identity/v3/projects/ea10aaf49bc94c8b9a8f8b613c25f205 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:35.566833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9489d8-2eb9-4793-8901-511415657db1 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:35.567124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9489d8-2eb9-4793-8901-511415657db1 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:35.567408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9489d8-2eb9-4793-8901-511415657db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:35.586465 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-3d9489d8-2eb9-4793-8901-511415657db1 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:35.587816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-3d9489d8-2eb9-4793-8901-511415657db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:35.594061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f97b3-f4a5-47b8-a813-1d44f448f06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:35.594061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f97b3-f4a5-47b8-a813-1d44f448f06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:35.594061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f97b3-f4a5-47b8-a813-1d44f448f06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:35.594061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f97b3-f4a5-47b8-a813-1d44f448f06f admin admin] PATH_INFO: `/v3/projects/badd0bf599e549ae9d2b3fb8912a1465` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:35.594566 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f97b3-f4a5-47b8-a813-1d44f448f06f admin admin] RBAC: Authorizing `identity:delete_project(project_id=badd0bf599e549ae9d2b3fb8912a1465)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:35.595776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f97b3-f4a5-47b8-a813-1d44f448f06f admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:35.596208 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 964/1929] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:35.604663 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fbe4d-c3f0-41be-9648-882ab3a8c92d None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:35.604663 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fbe4d-c3f0-41be-9648-882ab3a8c92d None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:35.604950 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fbe4d-c3f0-41be-9648-882ab3a8c92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:35.628825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-b91fbe4d-c3f0-41be-9648-882ab3a8c92d None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:35.628825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b91fbe4d-c3f0-41be-9648-882ab3a8c92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:35.634496 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 965/1930] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:38:35.638609 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fbe4d-c3f0-41be-9648-882ab3a8c92d None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:35.648608 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fbe4d-c3f0-41be-9648-882ab3a8c92d None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:35.653324 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667745d4-4fa4-482b-bee2-603d40af497c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:35.660177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667745d4-4fa4-482b-bee2-603d40af497c admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:35.660177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667745d4-4fa4-482b-bee2-603d40af497c admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:35.660177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667745d4-4fa4-482b-bee2-603d40af497c admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:35.660177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667745d4-4fa4-482b-bee2-603d40af497c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:38:35.660177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667745d4-4fa4-482b-bee2-603d40af497c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:35.660177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667745d4-4fa4-482b-bee2-603d40af497c admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:35.679401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 966/1931] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:38:35.682850 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667745d4-4fa4-482b-bee2-603d40af497c admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:35.692848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667745d4-4fa4-482b-bee2-603d40af497c admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:35.697484 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a95ecb-17b4-427e-941b-0b9aa9b89a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:35.698128 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a95ecb-17b4-427e-941b-0b9aa9b89a52 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:35.698416 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a95ecb-17b4-427e-941b-0b9aa9b89a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:35.698696 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a95ecb-17b4-427e-941b-0b9aa9b89a52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:35.699370 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a95ecb-17b4-427e-941b-0b9aa9b89a52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:35.701300 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a95ecb-17b4-427e-941b-0b9aa9b89a52 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:35.716152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:35.719156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:35.739893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-030f97b3-f4a5-47b8-a813-1d44f448f06f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'badd0bf599e549ae9d2b3fb8912a1465', 'request_id': 'req-030f97b3-f4a5-47b8-a813-1d44f448f06f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:35.746358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-030f97b3-f4a5-47b8-a813-1d44f448f06f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'badd0bf599e549ae9d2b3fb8912a1465', 'request_id': 'req-030f97b3-f4a5-47b8-a813-1d44f448f06f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:35.752745 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-030f97b3-f4a5-47b8-a813-1d44f448f06f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'badd0bf599e549ae9d2b3fb8912a1465', 'request_id': 'req-030f97b3-f4a5-47b8-a813-1d44f448f06f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:35.820248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 967/1932] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:35 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:38:35.824621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a95ecb-17b4-427e-941b-0b9aa9b89a52 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:35.873161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-030f97b3-f4a5-47b8-a813-1d44f448f06f admin admin] The token cache is being invalidate because project badd0bf599e549ae9d2b3fb8912a1465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:35.873629 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-030f97b3-f4a5-47b8-a813-1d44f448f06f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:35.874372 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-030f97b3-f4a5-47b8-a813-1d44f448f06f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:35.876030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 966/1933] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:35 2022] DELETE /identity/v3/projects/badd0bf599e549ae9d2b3fb8912a1465 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:35.880754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f97b3-f4a5-47b8-a813-1d44f448f06f admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:35.882298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-030f97b3-f4a5-47b8-a813-1d44f448f06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:35.888043 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a95ecb-17b4-427e-941b-0b9aa9b89a52 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:35.894120 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a13fde-bbab-4153-b7df-7d8abbf8098d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:35.894808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a13fde-bbab-4153-b7df-7d8abbf8098d admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:35.895578 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a13fde-bbab-4153-b7df-7d8abbf8098d admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:35.895859 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a13fde-bbab-4153-b7df-7d8abbf8098d admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:35.896860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a13fde-bbab-4153-b7df-7d8abbf8098d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:35.899145 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a13fde-bbab-4153-b7df-7d8abbf8098d admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:35.986512 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f97b3-f4a5-47b8-a813-1d44f448f06f admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:35.991857 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bca23-73f9-48ad-a2f0-e2e804c71308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:35.992813 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bca23-73f9-48ad-a2f0-e2e804c71308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:35.993488 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bca23-73f9-48ad-a2f0-e2e804c71308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:35.993488 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bca23-73f9-48ad-a2f0-e2e804c71308 admin admin] PATH_INFO: `/v3/users/1f2300854b13465681892f0a71fdc8b7` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:35.994631 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bca23-73f9-48ad-a2f0-e2e804c71308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f2300854b13465681892f0a71fdc8b7)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:35.996569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bca23-73f9-48ad-a2f0-e2e804c71308 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:36.066883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 968/1934] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:35 2022] POST /identity/v3/users => generated 294 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:38:36.073262 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a13fde-bbab-4153-b7df-7d8abbf8098d admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:36.076242 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b1a13fde-bbab-4153-b7df-7d8abbf8098d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:36.095895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a13fde-bbab-4153-b7df-7d8abbf8098d admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:36.101952 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243c04b-9ecd-4435-9747-6622e12b0ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:36.102642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243c04b-9ecd-4435-9747-6622e12b0ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:36.102997 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243c04b-9ecd-4435-9747-6622e12b0ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:36.105403 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243c04b-9ecd-4435-9747-6622e12b0ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:36.105403 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243c04b-9ecd-4435-9747-6622e12b0ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:36.106818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243c04b-9ecd-4435-9747-6622e12b0ef9 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:36.124061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 969/1935] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:36.128521 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243c04b-9ecd-4435-9747-6622e12b0ef9 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:36.143290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243c04b-9ecd-4435-9747-6622e12b0ef9 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:36.148265 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebecf9-3501-4a23-be31-5e6f24065f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:36.148932 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebecf9-3501-4a23-be31-5e6f24065f71 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:36.149503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebecf9-3501-4a23-be31-5e6f24065f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:36.149835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebecf9-3501-4a23-be31-5e6f24065f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:36.150571 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebecf9-3501-4a23-be31-5e6f24065f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:36.152179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebecf9-3501-4a23-be31-5e6f24065f71 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:36.163404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 970/1936] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:36.167433 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebecf9-3501-4a23-be31-5e6f24065f71 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:36.179151 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebecf9-3501-4a23-be31-5e6f24065f71 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:36.184016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d73610-540c-4f01-9b02-c8f2dd1e8dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:36.184892 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d73610-540c-4f01-9b02-c8f2dd1e8dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:36.185177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d73610-540c-4f01-9b02-c8f2dd1e8dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:36.185449 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d73610-540c-4f01-9b02-c8f2dd1e8dbb admin admin] PATH_INFO: `/v3/projects/c42e7dd3dfe14165958f8ddc82e1bdf9/users/b95b76ebb44b48aabafbc48da09da0ba/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:36.201207 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d73610-540c-4f01-9b02-c8f2dd1e8dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42e7dd3dfe14165958f8ddc82e1bdf9, user_id=b95b76ebb44b48aabafbc48da09da0ba, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:36.204205 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d73610-540c-4f01-9b02-c8f2dd1e8dbb admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:36.222966 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-398bca23-73f9-48ad-a2f0-e2e804c71308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f2300854b13465681892f0a71fdc8b7'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:36.243150 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-398bca23-73f9-48ad-a2f0-e2e804c71308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f2300854b13465681892f0a71fdc8b7'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:36.250026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-398bca23-73f9-48ad-a2f0-e2e804c71308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f2300854b13465681892f0a71fdc8b7'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:36.250760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-398bca23-73f9-48ad-a2f0-e2e804c71308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f2300854b13465681892f0a71fdc8b7'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:36.251994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-398bca23-73f9-48ad-a2f0-e2e804c71308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f2300854b13465681892f0a71fdc8b7'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:36.331770 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 967/1937] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:35 2022] DELETE /identity/v3/users/1f2300854b13465681892f0a71fdc8b7 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:36.335081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 971/1938] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:36 2022] PUT /identity/v3/projects/c42e7dd3dfe14165958f8ddc82e1bdf9/users/b95b76ebb44b48aabafbc48da09da0ba/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:38:36.346045 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982031b-3121-42ef-aae2-9b86a79896de None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:36.346413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982031b-3121-42ef-aae2-9b86a79896de None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:36.346821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982031b-3121-42ef-aae2-9b86a79896de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:36.374808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-1982031b-3121-42ef-aae2-9b86a79896de None None] MFA Rules not processed for user `b95b76ebb44b48aabafbc48da09da0ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:36.376056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-1982031b-3121-42ef-aae2-9b86a79896de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:36.441126 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 968/1939] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:36.445689 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d73610-540c-4f01-9b02-c8f2dd1e8dbb admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:36.447393 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f1d73610-540c-4f01-9b02-c8f2dd1e8dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:36.515782 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d73610-540c-4f01-9b02-c8f2dd1e8dbb admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:36.603775 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fe6ca-04b9-4754-85a2-0472f89ba655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:36.604616 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fe6ca-04b9-4754-85a2-0472f89ba655 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:36.604898 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fe6ca-04b9-4754-85a2-0472f89ba655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:36.605173 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fe6ca-04b9-4754-85a2-0472f89ba655 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:36.605914 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fe6ca-04b9-4754-85a2-0472f89ba655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:36.607867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fe6ca-04b9-4754-85a2-0472f89ba655 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:36.710336 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 972/1940] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:36 2022] POST /identity/v3/projects => generated 387 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:36.714942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982031b-3121-42ef-aae2-9b86a79896de None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:36.728575 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1982031b-3121-42ef-aae2-9b86a79896de None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:36.794126 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4c312-5d80-4b1d-82ba-7c28f24a737d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:36.794868 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4c312-5d80-4b1d-82ba-7c28f24a737d admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:36.795173 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4c312-5d80-4b1d-82ba-7c28f24a737d admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:36.795460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4c312-5d80-4b1d-82ba-7c28f24a737d admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:36.796205 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4c312-5d80-4b1d-82ba-7c28f24a737d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:36.798477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4c312-5d80-4b1d-82ba-7c28f24a737d admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:36.837163 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:36.896727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:36.903092 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fe6ca-04b9-4754-85a2-0472f89ba655 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:36.907516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-bc8fe6ca-04b9-4754-85a2-0472f89ba655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:36.907700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 969/1941] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:36 2022] POST /identity/v3/users => generated 294 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:36.909303 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4c312-5d80-4b1d-82ba-7c28f24a737d admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:36.923555 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fe6ca-04b9-4754-85a2-0472f89ba655 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:36.929905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4c312-5d80-4b1d-82ba-7c28f24a737d admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:36.931776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ae084-25d1-4e5b-b988-fcda96a17ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:36.938403 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857c320-6062-41a1-9276-f1f1ef03ce34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:36.940168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ae084-25d1-4e5b-b988-fcda96a17ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:36.940469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ae084-25d1-4e5b-b988-fcda96a17ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:36.940803 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857c320-6062-41a1-9276-f1f1ef03ce34 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:36.941090 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857c320-6062-41a1-9276-f1f1ef03ce34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:36.941363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857c320-6062-41a1-9276-f1f1ef03ce34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:36.942806 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ae084-25d1-4e5b-b988-fcda96a17ca4 admin admin] PATH_INFO: `/v3/projects/8226b43e57324439bed514d849718c58` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:36.943573 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857c320-6062-41a1-9276-f1f1ef03ce34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:36.944591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ae084-25d1-4e5b-b988-fcda96a17ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8226b43e57324439bed514d849718c58)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:36.947341 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857c320-6062-41a1-9276-f1f1ef03ce34 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:36.947982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ae084-25d1-4e5b-b988-fcda96a17ca4 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:36.966353 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 970/1942] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:38:36.967333 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857c320-6062-41a1-9276-f1f1ef03ce34 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:36.980789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857c320-6062-41a1-9276-f1f1ef03ce34 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:36.987492 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa0605-27f8-4355-af4a-4b96596d108f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:36.988174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa0605-27f8-4355-af4a-4b96596d108f admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:36.988462 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa0605-27f8-4355-af4a-4b96596d108f admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:36.988771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa0605-27f8-4355-af4a-4b96596d108f admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:36.989738 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa0605-27f8-4355-af4a-4b96596d108f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:36.992256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa0605-27f8-4355-af4a-4b96596d108f admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:37.005375 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 971/1943] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:37.009944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa0605-27f8-4355-af4a-4b96596d108f admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:37.026436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa0605-27f8-4355-af4a-4b96596d108f admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:37.032190 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d23c946-9174-43c1-8753-4f8013c09c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:37.033809 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23c946-9174-43c1-8753-4f8013c09c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:37.034183 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23c946-9174-43c1-8753-4f8013c09c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:37.034619 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d23c946-9174-43c1-8753-4f8013c09c27 admin admin] PATH_INFO: `/v3/projects/7b25a0f88a6c44659b510e594e7e514c/users/c8589b2bc0464fdfb4b54a54fbf13776/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:37.076127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23c946-9174-43c1-8753-4f8013c09c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b25a0f88a6c44659b510e594e7e514c, user_id=c8589b2bc0464fdfb4b54a54fbf13776, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:37.081197 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d23c946-9174-43c1-8753-4f8013c09c27 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:37.104860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-0a1ae084-25d1-4e5b-b988-fcda96a17ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8226b43e57324439bed514d849718c58', 'request_id': 'req-0a1ae084-25d1-4e5b-b988-fcda96a17ca4'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:37.121725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-0a1ae084-25d1-4e5b-b988-fcda96a17ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8226b43e57324439bed514d849718c58', 'request_id': 'req-0a1ae084-25d1-4e5b-b988-fcda96a17ca4'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:37.169063 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 972/1944] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:37 2022] PUT /identity/v3/projects/7b25a0f88a6c44659b510e594e7e514c/users/c8589b2bc0464fdfb4b54a54fbf13776/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:38:37.180202 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317982a-e173-4b57-a693-6c16e81165c3 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:37.180536 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317982a-e173-4b57-a693-6c16e81165c3 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:37.180762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317982a-e173-4b57-a693-6c16e81165c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:37.195695 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-0a1ae084-25d1-4e5b-b988-fcda96a17ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8226b43e57324439bed514d849718c58', 'request_id': 'req-0a1ae084-25d1-4e5b-b988-fcda96a17ca4'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:37.218554 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-0a1ae084-25d1-4e5b-b988-fcda96a17ca4 admin admin] The token cache is being invalidate because project 8226b43e57324439bed514d849718c58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:37.218919 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-0a1ae084-25d1-4e5b-b988-fcda96a17ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:37.220116 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-0a1ae084-25d1-4e5b-b988-fcda96a17ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:37.220924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-e317982a-e173-4b57-a693-6c16e81165c3 None None] MFA Rules not processed for user `c8589b2bc0464fdfb4b54a54fbf13776`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:37.222377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e317982a-e173-4b57-a693-6c16e81165c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:37.223125 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 973/1945] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:36 2022] DELETE /identity/v3/projects/8226b43e57324439bed514d849718c58 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:38:37.230473 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a2834-7611-4b31-8ad1-d38ee303d9d4 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:37.231106 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a2834-7611-4b31-8ad1-d38ee303d9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:37.231446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a2834-7611-4b31-8ad1-d38ee303d9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:37.260279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-214a2834-7611-4b31-8ad1-d38ee303d9d4 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:37.261647 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-214a2834-7611-4b31-8ad1-d38ee303d9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:37.316968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 973/1946] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:38:37.323948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317982a-e173-4b57-a693-6c16e81165c3 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:37.325518 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e317982a-e173-4b57-a693-6c16e81165c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:37.347283 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 974/1947] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:38:37.349364 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca181c06-884c-4771-a362-dfc8c87926d7 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:37.349685 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca181c06-884c-4771-a362-dfc8c87926d7 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:37.349971 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca181c06-884c-4771-a362-dfc8c87926d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:37.372893 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-ca181c06-884c-4771-a362-dfc8c87926d7 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:37.374390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ca181c06-884c-4771-a362-dfc8c87926d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:37.383756 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 975/1948] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:37.388752 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca181c06-884c-4771-a362-dfc8c87926d7 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:37.399460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca181c06-884c-4771-a362-dfc8c87926d7 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:37.404518 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cdf96-1631-4b74-9742-dab998c7788a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:37.405182 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cdf96-1631-4b74-9742-dab998c7788a admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:37.405470 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cdf96-1631-4b74-9742-dab998c7788a admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:37.405780 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cdf96-1631-4b74-9742-dab998c7788a admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:37.406510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89cdf96-1631-4b74-9742-dab998c7788a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:38:37.406814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89cdf96-1631-4b74-9742-dab998c7788a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:37.408773 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89cdf96-1631-4b74-9742-dab998c7788a admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:37.415014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317982a-e173-4b57-a693-6c16e81165c3 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:37.420099 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9c7fd-f905-421e-8c78-e99ce75e07ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:37.420801 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9c7fd-f905-421e-8c78-e99ce75e07ac admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:37.421101 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9c7fd-f905-421e-8c78-e99ce75e07ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:37.421549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9c7fd-f905-421e-8c78-e99ce75e07ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:37.422067 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 976/1949] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:38:37.422240 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9c7fd-f905-421e-8c78-e99ce75e07ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:37.424833 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9c7fd-f905-421e-8c78-e99ce75e07ac admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:37.426944 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cdf96-1631-4b74-9742-dab998c7788a admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:37.438429 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cdf96-1631-4b74-9742-dab998c7788a admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:37.445095 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f93e5-b1a2-42eb-a682-d8842826e9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:37.445807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f93e5-b1a2-42eb-a682-d8842826e9a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:37.446090 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f93e5-b1a2-42eb-a682-d8842826e9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:37.446368 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f93e5-b1a2-42eb-a682-d8842826e9a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:37.447053 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f93e5-b1a2-42eb-a682-d8842826e9a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:37.449028 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f93e5-b1a2-42eb-a682-d8842826e9a1 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:37.534991 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 974/1950] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:37 2022] POST /identity/v3/projects => generated 385 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:38:37.538969 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9c7fd-f905-421e-8c78-e99ce75e07ac admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:37.551405 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:37.561488 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 977/1951] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:37 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:37.565906 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f93e5-b1a2-42eb-a682-d8842826e9a1 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:37.595810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:37.661016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9c7fd-f905-421e-8c78-e99ce75e07ac admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:37.671040 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a2789-4d7e-4cda-83d7-9d7a67410a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:37.671753 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a2789-4d7e-4cda-83d7-9d7a67410a58 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:37.672043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a2789-4d7e-4cda-83d7-9d7a67410a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:37.672421 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a2789-4d7e-4cda-83d7-9d7a67410a58 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:37.672637 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f93e5-b1a2-42eb-a682-d8842826e9a1 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:37.673677 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a2789-4d7e-4cda-83d7-9d7a67410a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:37.675771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a2789-4d7e-4cda-83d7-9d7a67410a58 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:37.678993 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bb414-363c-4353-b3cd-f813804085b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:37.679857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bb414-363c-4353-b3cd-f813804085b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:37.680138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bb414-363c-4353-b3cd-f813804085b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:37.680486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bb414-363c-4353-b3cd-f813804085b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:37.681205 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bb414-363c-4353-b3cd-f813804085b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:37.683716 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bb414-363c-4353-b3cd-f813804085b7 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:37.837317 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 978/1952] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:37 2022] POST /identity/v3/users => generated 287 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:38:37.837539 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 975/1953] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:37 2022] POST /identity/v3/users => generated 299 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:38:37.837972 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bb414-363c-4353-b3cd-f813804085b7 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:37.839416 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a2789-4d7e-4cda-83d7-9d7a67410a58 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:37.853834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a2789-4d7e-4cda-83d7-9d7a67410a58 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:37.856233 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bb414-363c-4353-b3cd-f813804085b7 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:37.864849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aea0c-11a5-4eb8-942b-da621db042fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:37.865681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aea0c-11a5-4eb8-942b-da621db042fb admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:37.866191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aea0c-11a5-4eb8-942b-da621db042fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:37.866444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aea0c-11a5-4eb8-942b-da621db042fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:37.867252 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715aea0c-11a5-4eb8-942b-da621db042fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:37.868667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb90986-4fd4-4d20-86f0-2917bed1fe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:37.873438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715aea0c-11a5-4eb8-942b-da621db042fb admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:37.873588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb90986-4fd4-4d20-86f0-2917bed1fe31 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:37.873588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb90986-4fd4-4d20-86f0-2917bed1fe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:37.873588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb90986-4fd4-4d20-86f0-2917bed1fe31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:37.873588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb90986-4fd4-4d20-86f0-2917bed1fe31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:37.874196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb90986-4fd4-4d20-86f0-2917bed1fe31 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:37.884706 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 979/1954] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:37.885990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aea0c-11a5-4eb8-942b-da621db042fb admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:37.897940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aea0c-11a5-4eb8-942b-da621db042fb admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:37.902098 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 976/1955] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:37.903332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb90986-4fd4-4d20-86f0-2917bed1fe31 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:37.911588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe910d-0f76-444d-9381-58865eb00aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:37.912666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe910d-0f76-444d-9381-58865eb00aff admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:37.913060 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe910d-0f76-444d-9381-58865eb00aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:37.913726 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe910d-0f76-444d-9381-58865eb00aff admin admin] PATH_INFO: `/v3/projects/18a1c2d3c9854885a82982bd2971913f/users/204136aa0dbc4ccd91f8900ea527d1c1/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:37.915317 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb90986-4fd4-4d20-86f0-2917bed1fe31 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:37.920386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac849f4-c83b-4927-809d-955428fe5e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:37.921068 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac849f4-c83b-4927-809d-955428fe5e7f admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:37.921358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac849f4-c83b-4927-809d-955428fe5e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:37.921674 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac849f4-c83b-4927-809d-955428fe5e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:37.922414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac849f4-c83b-4927-809d-955428fe5e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:37.924828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac849f4-c83b-4927-809d-955428fe5e7f admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:37.941346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 977/1956] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:37.946597 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac849f4-c83b-4927-809d-955428fe5e7f admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:37.954785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe910d-0f76-444d-9381-58865eb00aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a1c2d3c9854885a82982bd2971913f, user_id=204136aa0dbc4ccd91f8900ea527d1c1, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:37.957900 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe910d-0f76-444d-9381-58865eb00aff admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:37.972859 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac849f4-c83b-4927-809d-955428fe5e7f admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:37.978884 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92284c8a-0989-462f-a78c-938cbcd437b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:37.980051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92284c8a-0989-462f-a78c-938cbcd437b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:37.980443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92284c8a-0989-462f-a78c-938cbcd437b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:37.980856 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92284c8a-0989-462f-a78c-938cbcd437b1 admin admin] PATH_INFO: `/v3/projects/c531e29f56f74ee0b5cc28e029ad6f22/users/58c16bbb9baa47c5b64d2437fc37e904/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:38.003556 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92284c8a-0989-462f-a78c-938cbcd437b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c531e29f56f74ee0b5cc28e029ad6f22, user_id=58c16bbb9baa47c5b64d2437fc37e904, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:38.006477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92284c8a-0989-462f-a78c-938cbcd437b1 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:38.070504 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 980/1957] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:37 2022] PUT /identity/v3/projects/18a1c2d3c9854885a82982bd2971913f/users/204136aa0dbc4ccd91f8900ea527d1c1/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:38.074818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe910d-0f76-444d-9381-58865eb00aff admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:38.115573 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 978/1958] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:37 2022] PUT /identity/v3/projects/c531e29f56f74ee0b5cc28e029ad6f22/users/58c16bbb9baa47c5b64d2437fc37e904/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:38.117032 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ef7cb-2e8f-4ef5-a687-fdba72823b49 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:38.117410 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ef7cb-2e8f-4ef5-a687-fdba72823b49 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:38.117833 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ef7cb-2e8f-4ef5-a687-fdba72823b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:38.144527 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-225ef7cb-2e8f-4ef5-a687-fdba72823b49 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:38.144527 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-225ef7cb-2e8f-4ef5-a687-fdba72823b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:38.161210 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe910d-0f76-444d-9381-58865eb00aff admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:38.170959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:38.252078 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 979/1959] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:38.268090 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380878b-c692-4f20-bf93-69d4136667f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:38.268824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380878b-c692-4f20-bf93-69d4136667f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:38.269407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380878b-c692-4f20-bf93-69d4136667f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:38.269728 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380878b-c692-4f20-bf93-69d4136667f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:38.270459 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380878b-c692-4f20-bf93-69d4136667f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:38.272064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380878b-c692-4f20-bf93-69d4136667f7 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:38.295249 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 981/1960] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:38.298956 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ef7cb-2e8f-4ef5-a687-fdba72823b49 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:38.311047 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ef7cb-2e8f-4ef5-a687-fdba72823b49 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:38.316541 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd31366b-1364-41fa-8721-9561368dc10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:38.317455 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31366b-1364-41fa-8721-9561368dc10d admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:38.317872 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31366b-1364-41fa-8721-9561368dc10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:38.318252 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd31366b-1364-41fa-8721-9561368dc10d admin admin] PATH_INFO: `/v3/projects/18a1c2d3c9854885a82982bd2971913f/users/204136aa0dbc4ccd91f8900ea527d1c1/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:38.318989 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380878b-c692-4f20-bf93-69d4136667f7 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:38.320848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31366b-1364-41fa-8721-9561368dc10d admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a1c2d3c9854885a82982bd2971913f, user_id=204136aa0dbc4ccd91f8900ea527d1c1, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:38.322992 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-2380878b-c692-4f20-bf93-69d4136667f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:38.327311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd31366b-1364-41fa-8721-9561368dc10d admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:38.349850 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 980/1961] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:38 2022] PUT /identity/v3/projects/18a1c2d3c9854885a82982bd2971913f/users/204136aa0dbc4ccd91f8900ea527d1c1/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:38.352550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22685693-59b2-4c94-b410-2dea0e045ae9 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:38.352550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22685693-59b2-4c94-b410-2dea0e045ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:38.352550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22685693-59b2-4c94-b410-2dea0e045ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:38.385101 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-22685693-59b2-4c94-b410-2dea0e045ae9 None None] MFA Rules not processed for user `204136aa0dbc4ccd91f8900ea527d1c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:38.386365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-22685693-59b2-4c94-b410-2dea0e045ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:38.395667 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380878b-c692-4f20-bf93-69d4136667f7 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:38.455214 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0bb204-c596-485b-8a5e-5ec0ac83476e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:38.455955 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bb204-c596-485b-8a5e-5ec0ac83476e service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:38.456310 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bb204-c596-485b-8a5e-5ec0ac83476e service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:38.456776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bb204-c596-485b-8a5e-5ec0ac83476e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:38.472719 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:38.479645 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 981/1962] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:38.493360 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22685693-59b2-4c94-b410-2dea0e045ae9 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:38.496937 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-22685693-59b2-4c94-b410-2dea0e045ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:38.556649 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0bb204-c596-485b-8a5e-5ec0ac83476e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:38.558736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0bb204-c596-485b-8a5e-5ec0ac83476e service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:38.573472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 982/1963] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:38.586870 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22685693-59b2-4c94-b410-2dea0e045ae9 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:38.590867 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc8d75-4753-4c16-a850-c8fbadea5d41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:38.591824 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc8d75-4753-4c16-a850-c8fbadea5d41 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:38.591824 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc8d75-4753-4c16-a850-c8fbadea5d41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:38.592107 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc8d75-4753-4c16-a850-c8fbadea5d41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:38.611080 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc8d75-4753-4c16-a850-c8fbadea5d41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:38.612919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc8d75-4753-4c16-a850-c8fbadea5d41 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:38.624706 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 982/1964] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:38:39.980833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0bb204-c596-485b-8a5e-5ec0ac83476e service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:39.993877 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0bb204-c596-485b-8a5e-5ec0ac83476e service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:39.998165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a3eef-b496-44b6-afaa-af1c9f73d6c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:39.999040 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a3eef-b496-44b6-afaa-af1c9f73d6c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:39.999326 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a3eef-b496-44b6-afaa-af1c9f73d6c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:39.999601 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a3eef-b496-44b6-afaa-af1c9f73d6c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:40.002137 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7f6a3eef-b496-44b6-afaa-af1c9f73d6c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:40.056602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a509c-b5b7-4c8b-a5e4-e0745feb5c6d None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:40.057115 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a509c-b5b7-4c8b-a5e4-e0745feb5c6d None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:40.057207 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a509c-b5b7-4c8b-a5e4-e0745feb5c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:40.112877 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-334a509c-b5b7-4c8b-a5e4-e0745feb5c6d None None] MFA Rules not processed for user `58c16bbb9baa47c5b64d2437fc37e904`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:40.114747 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-334a509c-b5b7-4c8b-a5e4-e0745feb5c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:40.125305 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a3eef-b496-44b6-afaa-af1c9f73d6c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:40.131869 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6a3eef-b496-44b6-afaa-af1c9f73d6c4 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:40.169465 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 983/1965] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:40.192425 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:40.246516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 983/1966] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:40.251802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a3eef-b496-44b6-afaa-af1c9f73d6c4 service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:40.262940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6a3eef-b496-44b6-afaa-af1c9f73d6c4 service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:40.273621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431ce5b-9545-46c8-92c8-e78f4e818dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:40.273621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431ce5b-9545-46c8-92c8-e78f4e818dbb admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:40.273621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431ce5b-9545-46c8-92c8-e78f4e818dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:40.273621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431ce5b-9545-46c8-92c8-e78f4e818dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:40.274003 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431ce5b-9545-46c8-92c8-e78f4e818dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:40.274003 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431ce5b-9545-46c8-92c8-e78f4e818dbb admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:40.287138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:40.383456 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 984/1967] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:40 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:38:40.388696 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a509c-b5b7-4c8b-a5e4-e0745feb5c6d None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:40.401362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a509c-b5b7-4c8b-a5e4-e0745feb5c6d None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:40.465054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163d298-62f5-4906-b20b-ccbc4f9e0d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:40.465765 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163d298-62f5-4906-b20b-ccbc4f9e0d20 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:40.466055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163d298-62f5-4906-b20b-ccbc4f9e0d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:40.466334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163d298-62f5-4906-b20b-ccbc4f9e0d20 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:40.467126 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163d298-62f5-4906-b20b-ccbc4f9e0d20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:40.470934 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163d298-62f5-4906-b20b-ccbc4f9e0d20 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:40.600940 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 984/1968] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:40 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:40.605047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431ce5b-9545-46c8-92c8-e78f4e818dbb admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:40.616621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431ce5b-9545-46c8-92c8-e78f4e818dbb admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:40.621378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149c40e-dd7e-48a8-a9cb-3b14b2710934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:40.622107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149c40e-dd7e-48a8-a9cb-3b14b2710934 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:40.622394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149c40e-dd7e-48a8-a9cb-3b14b2710934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:40.622672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149c40e-dd7e-48a8-a9cb-3b14b2710934 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:40.623418 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149c40e-dd7e-48a8-a9cb-3b14b2710934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:40.625038 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149c40e-dd7e-48a8-a9cb-3b14b2710934 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:40.640032 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 985/1969] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:40.644271 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163d298-62f5-4906-b20b-ccbc4f9e0d20 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:40.654496 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163d298-62f5-4906-b20b-ccbc4f9e0d20 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:40.659367 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed0588-aed7-4d1d-9518-8cea00c3b7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:40.660254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed0588-aed7-4d1d-9518-8cea00c3b7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:40.660541 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed0588-aed7-4d1d-9518-8cea00c3b7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:40.660830 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed0588-aed7-4d1d-9518-8cea00c3b7b5 admin admin] PATH_INFO: `/v3/projects/5a187fa30e2f4bdf9f92f8399d143836/users/fa5bd127f4ef4c47a64ac203008e1e01/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:40.678168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed0588-aed7-4d1d-9518-8cea00c3b7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a187fa30e2f4bdf9f92f8399d143836, user_id=fa5bd127f4ef4c47a64ac203008e1e01, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:40.681226 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed0588-aed7-4d1d-9518-8cea00c3b7b5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:40.774716 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 985/1970] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:40 2022] PUT /identity/v3/projects/5a187fa30e2f4bdf9f92f8399d143836/users/fa5bd127f4ef4c47a64ac203008e1e01/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:40.779014 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149c40e-dd7e-48a8-a9cb-3b14b2710934 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:40.791339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149c40e-dd7e-48a8-a9cb-3b14b2710934 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:40.863606 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96aee98-2b9d-473f-b297-f30e09e3d6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:40.867436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aee98-2b9d-473f-b297-f30e09e3d6fd admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:40.867436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aee98-2b9d-473f-b297-f30e09e3d6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:40.867436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aee98-2b9d-473f-b297-f30e09e3d6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:40.867436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96aee98-2b9d-473f-b297-f30e09e3d6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:40.867436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96aee98-2b9d-473f-b297-f30e09e3d6fd admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:40.878105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 986/1971] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:38:40.882276 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed0588-aed7-4d1d-9518-8cea00c3b7b5 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:40.902291 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed0588-aed7-4d1d-9518-8cea00c3b7b5 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:40.913051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f917e7-834e-4892-a7b7-2b6258c4255f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:40.913051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f917e7-834e-4892-a7b7-2b6258c4255f admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:40.913051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f917e7-834e-4892-a7b7-2b6258c4255f admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:40.913051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f917e7-834e-4892-a7b7-2b6258c4255f admin admin] PATH_INFO: `/v3/projects/5a187fa30e2f4bdf9f92f8399d143836/users/fa5bd127f4ef4c47a64ac203008e1e01/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:40.914939 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f917e7-834e-4892-a7b7-2b6258c4255f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a187fa30e2f4bdf9f92f8399d143836, user_id=fa5bd127f4ef4c47a64ac203008e1e01, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:40.917937 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f917e7-834e-4892-a7b7-2b6258c4255f admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:40.961436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 986/1972] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:40 2022] PUT /identity/v3/projects/5a187fa30e2f4bdf9f92f8399d143836/users/fa5bd127f4ef4c47a64ac203008e1e01/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:38:42.402284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f14d3-bfd4-462d-a04e-c2891e872103 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:42.403135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f14d3-bfd4-462d-a04e-c2891e872103 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:42.403637 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f14d3-bfd4-462d-a04e-c2891e872103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:42.473578 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-156f14d3-bfd4-462d-a04e-c2891e872103 None None] MFA Rules not processed for user `fa5bd127f4ef4c47a64ac203008e1e01`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:42.473578 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-156f14d3-bfd4-462d-a04e-c2891e872103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:42.550358 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 987/1973] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:42.561798 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f917e7-834e-4892-a7b7-2b6258c4255f admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:42.564232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-49f917e7-834e-4892-a7b7-2b6258c4255f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:42.625051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f917e7-834e-4892-a7b7-2b6258c4255f admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:42.630902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e66e11-4f6e-49db-9807-6ca07cefe7f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:42.631584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e66e11-4f6e-49db-9807-6ca07cefe7f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:42.631872 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e66e11-4f6e-49db-9807-6ca07cefe7f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:42.632151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e66e11-4f6e-49db-9807-6ca07cefe7f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:42.665281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:42.687587 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e66e11-4f6e-49db-9807-6ca07cefe7f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:42.689752 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e66e11-4f6e-49db-9807-6ca07cefe7f9 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:42.698679 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 987/1974] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:45.626638 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f14d3-bfd4-462d-a04e-c2891e872103 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:45.636632 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f14d3-bfd4-462d-a04e-c2891e872103 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:45.643592 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da540c-065b-4f6d-b003-312e645573c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:45.644310 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da540c-065b-4f6d-b003-312e645573c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:45.644718 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da540c-065b-4f6d-b003-312e645573c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:45.645095 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da540c-065b-4f6d-b003-312e645573c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:45.654671 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da540c-065b-4f6d-b003-312e645573c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:45.656109 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da540c-065b-4f6d-b003-312e645573c4 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:45.666959 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 988/1975] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:38:46.441047 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e66e11-4f6e-49db-9807-6ca07cefe7f9 service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:46.447466 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e66e11-4f6e-49db-9807-6ca07cefe7f9 service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:46.451119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16b4b5-c88f-417a-b64e-c4330d6c82f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:46.451759 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16b4b5-c88f-417a-b64e-c4330d6c82f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:46.452044 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16b4b5-c88f-417a-b64e-c4330d6c82f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:46.452324 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16b4b5-c88f-417a-b64e-c4330d6c82f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:46.510526 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16b4b5-c88f-417a-b64e-c4330d6c82f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:46.511976 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16b4b5-c88f-417a-b64e-c4330d6c82f5 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:46.520893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 988/1976] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:50.752367 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da540c-065b-4f6d-b003-312e645573c4 service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:50.812746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:50.823648 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da540c-065b-4f6d-b003-312e645573c4 service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:50.828409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a4d64-84ed-4e79-968b-b7baa96e0771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:50.829716 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a4d64-84ed-4e79-968b-b7baa96e0771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:50.830099 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a4d64-84ed-4e79-968b-b7baa96e0771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:50.830377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a4d64-84ed-4e79-968b-b7baa96e0771 admin admin] PATH_INFO: `/v3/users/b95b76ebb44b48aabafbc48da09da0ba` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:50.831616 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a4d64-84ed-4e79-968b-b7baa96e0771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b95b76ebb44b48aabafbc48da09da0ba)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:50.833588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a4d64-84ed-4e79-968b-b7baa96e0771 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:51.050788 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ea2a4d64-84ed-4e79-968b-b7baa96e0771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b95b76ebb44b48aabafbc48da09da0ba'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:51.062821 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ea2a4d64-84ed-4e79-968b-b7baa96e0771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b95b76ebb44b48aabafbc48da09da0ba'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:51.071673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ea2a4d64-84ed-4e79-968b-b7baa96e0771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b95b76ebb44b48aabafbc48da09da0ba'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:51.072394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ea2a4d64-84ed-4e79-968b-b7baa96e0771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b95b76ebb44b48aabafbc48da09da0ba'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:51.073061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ea2a4d64-84ed-4e79-968b-b7baa96e0771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b95b76ebb44b48aabafbc48da09da0ba'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:51.133221 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 989/1977] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:50 2022] DELETE /identity/v3/users/b95b76ebb44b48aabafbc48da09da0ba => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:51.138190 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b0803-5086-4a8d-86c8-3e808b7195ca None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:51.138679 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b0803-5086-4a8d-86c8-3e808b7195ca None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:51.138799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b0803-5086-4a8d-86c8-3e808b7195ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:51.156080 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-607b0803-5086-4a8d-86c8-3e808b7195ca None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:51.157929 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-607b0803-5086-4a8d-86c8-3e808b7195ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:51.218854 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 989/1978] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:38:51.229928 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a4d64-84ed-4e79-968b-b7baa96e0771 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:51.231783 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ea2a4d64-84ed-4e79-968b-b7baa96e0771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:51.288141 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a4d64-84ed-4e79-968b-b7baa96e0771 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:51.292093 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02b63d-0450-411a-834d-f7cbcc0ccaa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:51.292751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02b63d-0450-411a-834d-f7cbcc0ccaa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:51.293041 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02b63d-0450-411a-834d-f7cbcc0ccaa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:51.293358 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02b63d-0450-411a-834d-f7cbcc0ccaa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:51.304046 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02b63d-0450-411a-834d-f7cbcc0ccaa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:51.305494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02b63d-0450-411a-834d-f7cbcc0ccaa0 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:51.315604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 990/1979] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:51.821100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b0803-5086-4a8d-86c8-3e808b7195ca None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:51.822547 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-607b0803-5086-4a8d-86c8-3e808b7195ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:51.837154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b0803-5086-4a8d-86c8-3e808b7195ca None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:51.842085 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea87ee-cbc4-4981-9630-73544763655e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:51.846128 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea87ee-cbc4-4981-9630-73544763655e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:51.846128 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea87ee-cbc4-4981-9630-73544763655e admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:51.846128 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea87ee-cbc4-4981-9630-73544763655e admin admin] PATH_INFO: `/v3/projects/c42e7dd3dfe14165958f8ddc82e1bdf9` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:51.846128 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea87ee-cbc4-4981-9630-73544763655e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42e7dd3dfe14165958f8ddc82e1bdf9)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:51.847762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea87ee-cbc4-4981-9630-73544763655e admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:51.957301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-bcea87ee-cbc4-4981-9630-73544763655e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42e7dd3dfe14165958f8ddc82e1bdf9', 'request_id': 'req-bcea87ee-cbc4-4981-9630-73544763655e'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:51.963536 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-bcea87ee-cbc4-4981-9630-73544763655e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42e7dd3dfe14165958f8ddc82e1bdf9', 'request_id': 'req-bcea87ee-cbc4-4981-9630-73544763655e'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:51.969820 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-bcea87ee-cbc4-4981-9630-73544763655e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42e7dd3dfe14165958f8ddc82e1bdf9', 'request_id': 'req-bcea87ee-cbc4-4981-9630-73544763655e'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:52.026267 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:52.032456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-bcea87ee-cbc4-4981-9630-73544763655e admin admin] The token cache is being invalidate because project c42e7dd3dfe14165958f8ddc82e1bdf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:52.032805 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-bcea87ee-cbc4-4981-9630-73544763655e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:52.033512 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-bcea87ee-cbc4-4981-9630-73544763655e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:52.038205 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 990/1980] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:51 2022] DELETE /identity/v3/projects/c42e7dd3dfe14165958f8ddc82e1bdf9 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:52.039630 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02b63d-0450-411a-834d-f7cbcc0ccaa0 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:52.051785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02b63d-0450-411a-834d-f7cbcc0ccaa0 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:52.134493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0250597-4961-49af-9326-64a7827a3e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:52.136010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0250597-4961-49af-9326-64a7827a3e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:52.136345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0250597-4961-49af-9326-64a7827a3e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:52.136727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0250597-4961-49af-9326-64a7827a3e05 admin admin] PATH_INFO: `/v3/users/c8589b2bc0464fdfb4b54a54fbf13776` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:52.138583 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0250597-4961-49af-9326-64a7827a3e05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8589b2bc0464fdfb4b54a54fbf13776)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:52.140944 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0250597-4961-49af-9326-64a7827a3e05 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:52.161254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:52.399154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a0250597-4961-49af-9326-64a7827a3e05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8589b2bc0464fdfb4b54a54fbf13776'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:52.411790 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a0250597-4961-49af-9326-64a7827a3e05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8589b2bc0464fdfb4b54a54fbf13776'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:52.418693 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a0250597-4961-49af-9326-64a7827a3e05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8589b2bc0464fdfb4b54a54fbf13776'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:52.419372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a0250597-4961-49af-9326-64a7827a3e05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8589b2bc0464fdfb4b54a54fbf13776'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:52.419979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a0250597-4961-49af-9326-64a7827a3e05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8589b2bc0464fdfb4b54a54fbf13776'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:52.481736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 991/1981] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:52 2022] DELETE /identity/v3/users/c8589b2bc0464fdfb4b54a54fbf13776 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:53.139594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea87ee-cbc4-4981-9630-73544763655e admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:53.141201 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-bcea87ee-cbc4-4981-9630-73544763655e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:53.158588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea87ee-cbc4-4981-9630-73544763655e admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:53.228692 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6d318-0daf-4738-81af-be081f346e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:53.231351 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6d318-0daf-4738-81af-be081f346e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:53.231666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6d318-0daf-4738-81af-be081f346e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:53.232367 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6d318-0daf-4738-81af-be081f346e10 admin admin] PATH_INFO: `/v3/projects/7b25a0f88a6c44659b510e594e7e514c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:53.233869 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6d318-0daf-4738-81af-be081f346e10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b25a0f88a6c44659b510e594e7e514c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:53.236409 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6d318-0daf-4738-81af-be081f346e10 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:53.374180 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-60f6d318-0daf-4738-81af-be081f346e10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b25a0f88a6c44659b510e594e7e514c', 'request_id': 'req-60f6d318-0daf-4738-81af-be081f346e10'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:53.381826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-60f6d318-0daf-4738-81af-be081f346e10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b25a0f88a6c44659b510e594e7e514c', 'request_id': 'req-60f6d318-0daf-4738-81af-be081f346e10'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:53.390126 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-60f6d318-0daf-4738-81af-be081f346e10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b25a0f88a6c44659b510e594e7e514c', 'request_id': 'req-60f6d318-0daf-4738-81af-be081f346e10'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:53.506119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-60f6d318-0daf-4738-81af-be081f346e10 admin admin] The token cache is being invalidate because project 7b25a0f88a6c44659b510e594e7e514c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:53.506417 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-60f6d318-0daf-4738-81af-be081f346e10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:53.507562 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-60f6d318-0daf-4738-81af-be081f346e10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:53.509160 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 991/1982] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:53 2022] DELETE /identity/v3/projects/7b25a0f88a6c44659b510e594e7e514c => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:53.513498 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0250597-4961-49af-9326-64a7827a3e05 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:53.515897 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a0250597-4961-49af-9326-64a7827a3e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:53.530289 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0250597-4961-49af-9326-64a7827a3e05 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:53.590057 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf03426-7e36-4c96-ab58-0a24a35fbbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:53.590938 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf03426-7e36-4c96-ab58-0a24a35fbbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:53.591219 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf03426-7e36-4c96-ab58-0a24a35fbbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:53.591526 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf03426-7e36-4c96-ab58-0a24a35fbbbf admin admin] PATH_INFO: `/v3/users/204136aa0dbc4ccd91f8900ea527d1c1` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:53.592756 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf03426-7e36-4c96-ab58-0a24a35fbbbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=204136aa0dbc4ccd91f8900ea527d1c1)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:53.595255 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf03426-7e36-4c96-ab58-0a24a35fbbbf admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:53.842884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-adf03426-7e36-4c96-ab58-0a24a35fbbbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '204136aa0dbc4ccd91f8900ea527d1c1'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:53.855388 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-adf03426-7e36-4c96-ab58-0a24a35fbbbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '204136aa0dbc4ccd91f8900ea527d1c1'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:53.862463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-adf03426-7e36-4c96-ab58-0a24a35fbbbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '204136aa0dbc4ccd91f8900ea527d1c1'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:53.863218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-adf03426-7e36-4c96-ab58-0a24a35fbbbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '204136aa0dbc4ccd91f8900ea527d1c1'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:53.863863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-adf03426-7e36-4c96-ab58-0a24a35fbbbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '204136aa0dbc4ccd91f8900ea527d1c1'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:53.962080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 992/1983] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:38:53 2022] DELETE /identity/v3/users/204136aa0dbc4ccd91f8900ea527d1c1 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:38:54.520436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6d318-0daf-4738-81af-be081f346e10 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:54.527401 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-60f6d318-0daf-4738-81af-be081f346e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:54.572463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6d318-0daf-4738-81af-be081f346e10 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:54.662267 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de331b1-d58a-4b2f-b76d-7cf76a80440f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:54.663155 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de331b1-d58a-4b2f-b76d-7cf76a80440f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:54.663497 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de331b1-d58a-4b2f-b76d-7cf76a80440f admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:54.663784 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de331b1-d58a-4b2f-b76d-7cf76a80440f admin admin] PATH_INFO: `/v3/projects/18a1c2d3c9854885a82982bd2971913f` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:54.665126 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de331b1-d58a-4b2f-b76d-7cf76a80440f admin admin] RBAC: Authorizing `identity:delete_project(project_id=18a1c2d3c9854885a82982bd2971913f)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:54.667356 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de331b1-d58a-4b2f-b76d-7cf76a80440f admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:54.773551 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:54.787149 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7de331b1-d58a-4b2f-b76d-7cf76a80440f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a1c2d3c9854885a82982bd2971913f', 'request_id': 'req-7de331b1-d58a-4b2f-b76d-7cf76a80440f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:54.793690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7de331b1-d58a-4b2f-b76d-7cf76a80440f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a1c2d3c9854885a82982bd2971913f', 'request_id': 'req-7de331b1-d58a-4b2f-b76d-7cf76a80440f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:54.799325 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7de331b1-d58a-4b2f-b76d-7cf76a80440f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a1c2d3c9854885a82982bd2971913f', 'request_id': 'req-7de331b1-d58a-4b2f-b76d-7cf76a80440f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:54.915486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7de331b1-d58a-4b2f-b76d-7cf76a80440f admin admin] The token cache is being invalidate because project 18a1c2d3c9854885a82982bd2971913f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:38:54.915710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7de331b1-d58a-4b2f-b76d-7cf76a80440f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:54.916335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7de331b1-d58a-4b2f-b76d-7cf76a80440f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:38:54.918180 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 992/1984] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:38:54 2022] DELETE /identity/v3/projects/18a1c2d3c9854885a82982bd2971913f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:54.924203 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7c533-47d0-4030-8403-d0a95729988c None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:54.924681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7c533-47d0-4030-8403-d0a95729988c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:54.924953 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7c533-47d0-4030-8403-d0a95729988c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:54.943160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-29f7c533-47d0-4030-8403-d0a95729988c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:54.944368 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-29f7c533-47d0-4030-8403-d0a95729988c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:54.953029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:55.019283 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 993/1985] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:55.028118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb1fbe-67da-4398-b3e5-fc4dd19a8d3c None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:55.028443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb1fbe-67da-4398-b3e5-fc4dd19a8d3c None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:55.029338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb1fbe-67da-4398-b3e5-fc4dd19a8d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:55.047039 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-75cb1fbe-67da-4398-b3e5-fc4dd19a8d3c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:55.048257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-75cb1fbe-67da-4398-b3e5-fc4dd19a8d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:55.056162 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 993/1986] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:55.060493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7c533-47d0-4030-8403-d0a95729988c None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:55.073447 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7c533-47d0-4030-8403-d0a95729988c None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:55.079419 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df897db3-a0ea-4dde-b11e-421f8aaf7b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:55.080094 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df897db3-a0ea-4dde-b11e-421f8aaf7b9a admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:55.086030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df897db3-a0ea-4dde-b11e-421f8aaf7b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:55.086030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df897db3-a0ea-4dde-b11e-421f8aaf7b9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:55.086030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df897db3-a0ea-4dde-b11e-421f8aaf7b9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:38:55.086030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df897db3-a0ea-4dde-b11e-421f8aaf7b9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:55.086030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df897db3-a0ea-4dde-b11e-421f8aaf7b9a admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:55.096055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 994/1987] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:38:55.100476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb1fbe-67da-4398-b3e5-fc4dd19a8d3c None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:55.110181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb1fbe-67da-4398-b3e5-fc4dd19a8d3c None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:55.114953 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081dd2a-d545-4b30-aeeb-4c08cbffd607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:55.115593 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081dd2a-d545-4b30-aeeb-4c08cbffd607 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:55.115875 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081dd2a-d545-4b30-aeeb-4c08cbffd607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:55.116155 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081dd2a-d545-4b30-aeeb-4c08cbffd607 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:55.116881 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081dd2a-d545-4b30-aeeb-4c08cbffd607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:55.118834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081dd2a-d545-4b30-aeeb-4c08cbffd607 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:55.228434 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 994/1988] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:55 2022] POST /identity/v3/projects => generated 407 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:55.232571 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df897db3-a0ea-4dde-b11e-421f8aaf7b9a admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:55.243695 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df897db3-a0ea-4dde-b11e-421f8aaf7b9a admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:55.311957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17305189-d5ef-450c-af76-d51f70b46bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:55.312625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17305189-d5ef-450c-af76-d51f70b46bbb admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:55.312905 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17305189-d5ef-450c-af76-d51f70b46bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:55.314264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17305189-d5ef-450c-af76-d51f70b46bbb admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:55.315026 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17305189-d5ef-450c-af76-d51f70b46bbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:55.317260 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17305189-d5ef-450c-af76-d51f70b46bbb admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:55.413891 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 995/1989] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:55 2022] POST /identity/v3/users => generated 304 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:55.418032 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081dd2a-d545-4b30-aeeb-4c08cbffd607 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:55.429800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081dd2a-d545-4b30-aeeb-4c08cbffd607 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:55.434491 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c832b-4ec7-432f-9f6a-5f01dc521b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:55.435154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c832b-4ec7-432f-9f6a-5f01dc521b8a admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:55.435439 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c832b-4ec7-432f-9f6a-5f01dc521b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:55.435721 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c832b-4ec7-432f-9f6a-5f01dc521b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:55.436447 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c832b-4ec7-432f-9f6a-5f01dc521b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:55.439072 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c832b-4ec7-432f-9f6a-5f01dc521b8a admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:55.450110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 995/1990] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:55.454489 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17305189-d5ef-450c-af76-d51f70b46bbb admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:55.464863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17305189-d5ef-450c-af76-d51f70b46bbb admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:55.473472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b2b331-6552-4e01-b4de-f2b6538629f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:55.474390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2b331-6552-4e01-b4de-f2b6538629f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:55.474691 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2b331-6552-4e01-b4de-f2b6538629f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:55.474969 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2b331-6552-4e01-b4de-f2b6538629f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:55.475727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2b331-6552-4e01-b4de-f2b6538629f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:55.477678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b2b331-6552-4e01-b4de-f2b6538629f1 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:55.494237 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 996/1991] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:55.502250 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c832b-4ec7-432f-9f6a-5f01dc521b8a admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:55.512889 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c832b-4ec7-432f-9f6a-5f01dc521b8a admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:55.518111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b84ab5-6c08-4079-bdb7-a6b25f569ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:55.519009 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b84ab5-6c08-4079-bdb7-a6b25f569ee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:55.519296 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b84ab5-6c08-4079-bdb7-a6b25f569ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:55.519571 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b84ab5-6c08-4079-bdb7-a6b25f569ee5 admin admin] PATH_INFO: `/v3/projects/2a4fd39c8189481d82ab8e51f5228d72/users/5583b595b4ae4e0382ed1854ff95817e/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:55.536653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b84ab5-6c08-4079-bdb7-a6b25f569ee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a4fd39c8189481d82ab8e51f5228d72, user_id=5583b595b4ae4e0382ed1854ff95817e, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:55.539650 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b84ab5-6c08-4079-bdb7-a6b25f569ee5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:55.597835 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 996/1992] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:55 2022] PUT /identity/v3/projects/2a4fd39c8189481d82ab8e51f5228d72/users/5583b595b4ae4e0382ed1854ff95817e/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:55.609502 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dacffb-0159-4a6d-8627-f2130ed03488 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:55.609728 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dacffb-0159-4a6d-8627-f2130ed03488 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:55.610559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dacffb-0159-4a6d-8627-f2130ed03488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:55.642570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-b0dacffb-0159-4a6d-8627-f2130ed03488 None None] MFA Rules not processed for user `5583b595b4ae4e0382ed1854ff95817e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:55.643791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b0dacffb-0159-4a6d-8627-f2130ed03488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:55.725798 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 997/1993] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:55 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:55.731142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b84ab5-6c08-4079-bdb7-a6b25f569ee5 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:55.849795 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b84ab5-6c08-4079-bdb7-a6b25f569ee5 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:55.857460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb220f-7df2-45f2-8949-13c672213358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:55.858292 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb220f-7df2-45f2-8949-13c672213358 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:55.858763 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb220f-7df2-45f2-8949-13c672213358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:55.858948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb220f-7df2-45f2-8949-13c672213358 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:55.859546 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb220f-7df2-45f2-8949-13c672213358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:55.861559 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb220f-7df2-45f2-8949-13c672213358 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:55.953343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 997/1994] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:38:55 2022] POST /identity/v3/projects => generated 407 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:38:55.957863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dacffb-0159-4a6d-8627-f2130ed03488 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:55.969097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dacffb-0159-4a6d-8627-f2130ed03488 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:55.972954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:56.029163 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4885a-5c93-4e4f-b4f5-cfae485b158b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:56.029877 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4885a-5c93-4e4f-b4f5-cfae485b158b admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:56.030175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4885a-5c93-4e4f-b4f5-cfae485b158b admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:56.030454 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4885a-5c93-4e4f-b4f5-cfae485b158b admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:56.031400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4885a-5c93-4e4f-b4f5-cfae485b158b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:56.033416 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4885a-5c93-4e4f-b4f5-cfae485b158b admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:56.161408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 998/1995] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:38:55 2022] POST /identity/v3/users => generated 310 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:38:56.163033 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb220f-7df2-45f2-8949-13c672213358 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:56.174153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb220f-7df2-45f2-8949-13c672213358 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:56.178949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f86d10-bb9b-4b92-a0ee-7999090b22c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:56.179634 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f86d10-bb9b-4b92-a0ee-7999090b22c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:56.179899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f86d10-bb9b-4b92-a0ee-7999090b22c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:56.180176 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f86d10-bb9b-4b92-a0ee-7999090b22c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:56.180898 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f86d10-bb9b-4b92-a0ee-7999090b22c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:56.182536 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f86d10-bb9b-4b92-a0ee-7999090b22c5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:56.194101 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 998/1996] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:56.198537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4885a-5c93-4e4f-b4f5-cfae485b158b admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:56.208627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4885a-5c93-4e4f-b4f5-cfae485b158b admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:56.213238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3771210-30a4-4819-a6b7-e7f1d17d8faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:56.214204 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3771210-30a4-4819-a6b7-e7f1d17d8faf admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:56.214492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3771210-30a4-4819-a6b7-e7f1d17d8faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:56.214770 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3771210-30a4-4819-a6b7-e7f1d17d8faf admin admin] PATH_INFO: `/v3/projects/b35923ceaaef4180bad195d97108fb3a/users/3d1222932cf74b679a0ff05362b691f3/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:56.230608 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3771210-30a4-4819-a6b7-e7f1d17d8faf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35923ceaaef4180bad195d97108fb3a, user_id=3d1222932cf74b679a0ff05362b691f3, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:56.233262 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3771210-30a4-4819-a6b7-e7f1d17d8faf admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:56.320623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 999/1997] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:56 2022] PUT /identity/v3/projects/b35923ceaaef4180bad195d97108fb3a/users/3d1222932cf74b679a0ff05362b691f3/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:56.324767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f86d10-bb9b-4b92-a0ee-7999090b22c5 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:56.334783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f86d10-bb9b-4b92-a0ee-7999090b22c5 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:56.361153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:38:56.391727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeedaae-7bdb-4639-90ca-f24e335f1dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:56.392398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeedaae-7bdb-4639-90ca-f24e335f1dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:56.392682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeedaae-7bdb-4639-90ca-f24e335f1dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:56.392961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeedaae-7bdb-4639-90ca-f24e335f1dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:56.393720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeedaae-7bdb-4639-90ca-f24e335f1dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:56.395314 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeedaae-7bdb-4639-90ca-f24e335f1dd4 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:56.405595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 999/1998] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:38:56.409811 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3771210-30a4-4819-a6b7-e7f1d17d8faf admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:56.420299 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3771210-30a4-4819-a6b7-e7f1d17d8faf admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:56.425768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b31c0-0b8b-46b4-817f-7cbf05aec63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:56.426652 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b31c0-0b8b-46b4-817f-7cbf05aec63a admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:56.426949 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b31c0-0b8b-46b4-817f-7cbf05aec63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:56.427226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b31c0-0b8b-46b4-817f-7cbf05aec63a admin admin] PATH_INFO: `/v3/projects/b35923ceaaef4180bad195d97108fb3a/users/3d1222932cf74b679a0ff05362b691f3/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:56.429223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b31c0-0b8b-46b4-817f-7cbf05aec63a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35923ceaaef4180bad195d97108fb3a, user_id=3d1222932cf74b679a0ff05362b691f3, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:56.431896 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376b31c0-0b8b-46b4-817f-7cbf05aec63a admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:56.443541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1000/1999] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:38:56 2022] PUT /identity/v3/projects/b35923ceaaef4180bad195d97108fb3a/users/3d1222932cf74b679a0ff05362b691f3/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:38:56.453837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa766758-75e0-40dd-8694-39536f97ee00 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:56.454113 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa766758-75e0-40dd-8694-39536f97ee00 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:56.454397 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa766758-75e0-40dd-8694-39536f97ee00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:56.480111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-fa766758-75e0-40dd-8694-39536f97ee00 None None] MFA Rules not processed for user `3d1222932cf74b679a0ff05362b691f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:56.481309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-fa766758-75e0-40dd-8694-39536f97ee00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:56.548219 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1000/2000] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:56 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:38:56.560017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b31c0-0b8b-46b4-817f-7cbf05aec63a admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:56.561708 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-376b31c0-0b8b-46b4-817f-7cbf05aec63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:56.626348 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376b31c0-0b8b-46b4-817f-7cbf05aec63a admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:56.630071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8085d7-c8cf-489b-b4de-8b2129023120 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:56.630718 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8085d7-c8cf-489b-b4de-8b2129023120 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:56.631004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8085d7-c8cf-489b-b4de-8b2129023120 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:56.631279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8085d7-c8cf-489b-b4de-8b2129023120 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:56.640225 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8085d7-c8cf-489b-b4de-8b2129023120 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:56.641794 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8085d7-c8cf-489b-b4de-8b2129023120 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:56.651354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1001/2001] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:56 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:57.046319 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa766758-75e0-40dd-8694-39536f97ee00 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:38:57.047953 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-fa766758-75e0-40dd-8694-39536f97ee00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:57.060719 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa766758-75e0-40dd-8694-39536f97ee00 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:38:57.064499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb879b66-a33d-4792-b9d2-e0f2289905e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:38:57.065589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb879b66-a33d-4792-b9d2-e0f2289905e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:57.065589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb879b66-a33d-4792-b9d2-e0f2289905e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:57.065794 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb879b66-a33d-4792-b9d2-e0f2289905e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:57.135381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb879b66-a33d-4792-b9d2-e0f2289905e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:38:57.136993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb879b66-a33d-4792-b9d2-e0f2289905e1 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:38:57.147563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1001/2002] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:38:57 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:38:57.167207 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c1f57-b0f5-459d-8711-dcbfc17c167e None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:38:57.167724 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c1f57-b0f5-459d-8711-dcbfc17c167e None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:38:57.167724 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c1f57-b0f5-459d-8711-dcbfc17c167e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:38:57.187295 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-0e3c1f57-b0f5-459d-8711-dcbfc17c167e None None] MFA Rules not processed for user `de39c3c89d9440ac8f655b420477c043`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:38:57.188779 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-0e3c1f57-b0f5-459d-8711-dcbfc17c167e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:38:57.247094 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1002/2003] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:38:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:04.712238 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb879b66-a33d-4792-b9d2-e0f2289905e1 service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:04.713724 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-fb879b66-a33d-4792-b9d2-e0f2289905e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:04.804031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:04.832610 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb879b66-a33d-4792-b9d2-e0f2289905e1 service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:04.839216 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677de9b2-895b-4066-b3d8-7afb8fb5cd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:04.840232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677de9b2-895b-4066-b3d8-7afb8fb5cd17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:04.840517 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677de9b2-895b-4066-b3d8-7afb8fb5cd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:04.846225 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677de9b2-895b-4066-b3d8-7afb8fb5cd17 admin admin] PATH_INFO: `/v3/users/e8da794aec2f4d80a79e7c16a611f6f8` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:04.846225 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677de9b2-895b-4066-b3d8-7afb8fb5cd17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8da794aec2f4d80a79e7c16a611f6f8)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:04.846225 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677de9b2-895b-4066-b3d8-7afb8fb5cd17 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:05.058335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-677de9b2-895b-4066-b3d8-7afb8fb5cd17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8da794aec2f4d80a79e7c16a611f6f8'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:05.074624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-677de9b2-895b-4066-b3d8-7afb8fb5cd17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8da794aec2f4d80a79e7c16a611f6f8'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:05.082902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-677de9b2-895b-4066-b3d8-7afb8fb5cd17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8da794aec2f4d80a79e7c16a611f6f8'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:05.083712 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-677de9b2-895b-4066-b3d8-7afb8fb5cd17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8da794aec2f4d80a79e7c16a611f6f8'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:05.084504 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-677de9b2-895b-4066-b3d8-7afb8fb5cd17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8da794aec2f4d80a79e7c16a611f6f8'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:05.140435 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1002/2004] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:04 2022] DELETE /identity/v3/users/e8da794aec2f4d80a79e7c16a611f6f8 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:05.403047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c1f57-b0f5-459d-8711-dcbfc17c167e None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:05.415011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c1f57-b0f5-459d-8711-dcbfc17c167e None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:05.420712 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:05.491516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6741d-7efe-485a-9fea-18eb3e9f360e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:05.492831 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6741d-7efe-485a-9fea-18eb3e9f360e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:05.493121 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6741d-7efe-485a-9fea-18eb3e9f360e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:05.493400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6741d-7efe-485a-9fea-18eb3e9f360e admin admin] PATH_INFO: `/v3/projects/3fe4ce072c504ca283f1168657dbff73` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:05.494679 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6741d-7efe-485a-9fea-18eb3e9f360e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fe4ce072c504ca283f1168657dbff73)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:05.496833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6741d-7efe-485a-9fea-18eb3e9f360e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:05.622862 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-bbf6741d-7efe-485a-9fea-18eb3e9f360e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fe4ce072c504ca283f1168657dbff73', 'request_id': 'req-bbf6741d-7efe-485a-9fea-18eb3e9f360e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:05.629623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-bbf6741d-7efe-485a-9fea-18eb3e9f360e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fe4ce072c504ca283f1168657dbff73', 'request_id': 'req-bbf6741d-7efe-485a-9fea-18eb3e9f360e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:05.702204 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-bbf6741d-7efe-485a-9fea-18eb3e9f360e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fe4ce072c504ca283f1168657dbff73', 'request_id': 'req-bbf6741d-7efe-485a-9fea-18eb3e9f360e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:05.715630 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-bbf6741d-7efe-485a-9fea-18eb3e9f360e admin admin] The token cache is being invalidate because project 3fe4ce072c504ca283f1168657dbff73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:05.716022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-bbf6741d-7efe-485a-9fea-18eb3e9f360e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:05.717027 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-bbf6741d-7efe-485a-9fea-18eb3e9f360e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:05.719008 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1003/2005] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:05 2022] DELETE /identity/v3/projects/3fe4ce072c504ca283f1168657dbff73 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:05.723814 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dc644-9661-4bfe-b036-4977edef6eb8 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:05.724346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dc644-9661-4bfe-b036-4977edef6eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:05.724553 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dc644-9661-4bfe-b036-4977edef6eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:05.751879 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-aa1dc644-9661-4bfe-b036-4977edef6eb8 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:05.753489 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-aa1dc644-9661-4bfe-b036-4977edef6eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:05.827463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1003/2006] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:05.836503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de980e-2353-4c8a-a5bc-9b758bc9b83c None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:05.836794 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de980e-2353-4c8a-a5bc-9b758bc9b83c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:05.837075 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de980e-2353-4c8a-a5bc-9b758bc9b83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:05.855901 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-f7de980e-2353-4c8a-a5bc-9b758bc9b83c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:05.857120 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f7de980e-2353-4c8a-a5bc-9b758bc9b83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:05.866186 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1004/2007] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:05.870443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1dc644-9661-4bfe-b036-4977edef6eb8 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:05.881969 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1dc644-9661-4bfe-b036-4977edef6eb8 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:05.886797 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98089505-31ff-49b4-8435-a54ac040fc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:05.887636 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98089505-31ff-49b4-8435-a54ac040fc49 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:05.888175 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98089505-31ff-49b4-8435-a54ac040fc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:05.888810 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98089505-31ff-49b4-8435-a54ac040fc49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:05.889747 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98089505-31ff-49b4-8435-a54ac040fc49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:39:05.890063 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98089505-31ff-49b4-8435-a54ac040fc49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:05.893698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98089505-31ff-49b4-8435-a54ac040fc49 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:05.911415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1004/2008] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:39:05.912825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de980e-2353-4c8a-a5bc-9b758bc9b83c None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:05.924102 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de980e-2353-4c8a-a5bc-9b758bc9b83c None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:05.942257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98089505-31ff-49b4-8435-a54ac040fc49 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:05.942599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d20df1-9a30-4ab4-9c0f-fcb1ea2da6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:05.943612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d20df1-9a30-4ab4-9c0f-fcb1ea2da6e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:05.944097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d20df1-9a30-4ab4-9c0f-fcb1ea2da6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:05.944573 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d20df1-9a30-4ab4-9c0f-fcb1ea2da6e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:05.945078 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-98089505-31ff-49b4-8435-a54ac040fc49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:05.945919 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d20df1-9a30-4ab4-9c0f-fcb1ea2da6e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:05.948050 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d20df1-9a30-4ab4-9c0f-fcb1ea2da6e8 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:05.959228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98089505-31ff-49b4-8435-a54ac040fc49 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:05.966675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ee255-ed48-432d-8c53-1c546bdfaa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:05.970531 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ee255-ed48-432d-8c53-1c546bdfaa60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:05.970828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ee255-ed48-432d-8c53-1c546bdfaa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:05.971114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ee255-ed48-432d-8c53-1c546bdfaa60 admin admin] PATH_INFO: `/v3/users/58c16bbb9baa47c5b64d2437fc37e904` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:05.972480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ee255-ed48-432d-8c53-1c546bdfaa60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58c16bbb9baa47c5b64d2437fc37e904)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:05.974468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ee255-ed48-432d-8c53-1c546bdfaa60 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:06.066035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1005/2009] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:05 2022] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:06.070302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d20df1-9a30-4ab4-9c0f-fcb1ea2da6e8 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:06.149750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d20df1-9a30-4ab4-9c0f-fcb1ea2da6e8 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:06.154577 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b702b-f7c9-47af-ab08-05bba47eecd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:06.155273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b702b-f7c9-47af-ab08-05bba47eecd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:06.155559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b702b-f7c9-47af-ab08-05bba47eecd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:06.155833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b702b-f7c9-47af-ab08-05bba47eecd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:06.156748 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b702b-f7c9-47af-ab08-05bba47eecd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:06.158635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b702b-f7c9-47af-ab08-05bba47eecd5 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:06.184805 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-049ee255-ed48-432d-8c53-1c546bdfaa60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58c16bbb9baa47c5b64d2437fc37e904'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:06.188991 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:06.206023 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-049ee255-ed48-432d-8c53-1c546bdfaa60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58c16bbb9baa47c5b64d2437fc37e904'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:06.209511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-049ee255-ed48-432d-8c53-1c546bdfaa60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58c16bbb9baa47c5b64d2437fc37e904'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:06.210293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-049ee255-ed48-432d-8c53-1c546bdfaa60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58c16bbb9baa47c5b64d2437fc37e904'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:06.211064 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-049ee255-ed48-432d-8c53-1c546bdfaa60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58c16bbb9baa47c5b64d2437fc37e904'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:06.282737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:06.292483 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1006/2010] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:06 2022] POST /identity/v3/users => generated 288 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:39:06.293328 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b702b-f7c9-47af-ab08-05bba47eecd5 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:06.295125 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-934b702b-f7c9-47af-ab08-05bba47eecd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:06.308704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b702b-f7c9-47af-ab08-05bba47eecd5 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:06.313947 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac128279-344f-456c-b303-87cf70e81d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:06.314775 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac128279-344f-456c-b303-87cf70e81d5d admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:06.315066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac128279-344f-456c-b303-87cf70e81d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:06.315425 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac128279-344f-456c-b303-87cf70e81d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:06.316222 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac128279-344f-456c-b303-87cf70e81d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:06.317091 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1005/2011] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:05 2022] DELETE /identity/v3/users/58c16bbb9baa47c5b64d2437fc37e904 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:06.317828 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac128279-344f-456c-b303-87cf70e81d5d admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:06.338077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1007/2012] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:39:06.339428 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ee255-ed48-432d-8c53-1c546bdfaa60 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:06.415381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ee255-ed48-432d-8c53-1c546bdfaa60 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:06.421110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab6573-4609-4253-91a8-5101df359e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:06.421822 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab6573-4609-4253-91a8-5101df359e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:06.422675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab6573-4609-4253-91a8-5101df359e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:06.422951 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab6573-4609-4253-91a8-5101df359e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:06.423680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab6573-4609-4253-91a8-5101df359e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:06.425291 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab6573-4609-4253-91a8-5101df359e26 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:06.436857 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1006/2013] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:39:06.441030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac128279-344f-456c-b303-87cf70e81d5d admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:06.451326 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac128279-344f-456c-b303-87cf70e81d5d admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:06.456143 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a557a68-b4bb-4397-90a7-4467854bc84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:06.457349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a557a68-b4bb-4397-90a7-4467854bc84b admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:06.457349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a557a68-b4bb-4397-90a7-4467854bc84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:06.457700 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a557a68-b4bb-4397-90a7-4467854bc84b admin admin] PATH_INFO: `/v3/projects/66075e773eca4ba4b72d7265e941fde6/users/b9ee38a03587412c93da307525e83851/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:06.475581 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a557a68-b4bb-4397-90a7-4467854bc84b admin admin] RBAC: Authorizing `identity:create_grant(project_id=66075e773eca4ba4b72d7265e941fde6, user_id=b9ee38a03587412c93da307525e83851, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:06.478542 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a557a68-b4bb-4397-90a7-4467854bc84b admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:06.556298 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1008/2014] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:06 2022] PUT /identity/v3/projects/66075e773eca4ba4b72d7265e941fde6/users/b9ee38a03587412c93da307525e83851/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:06.561382 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e208fd3-651d-4d38-8ed8-6d9bb73a7130 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:06.561703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e208fd3-651d-4d38-8ed8-6d9bb73a7130 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:06.561983 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e208fd3-651d-4d38-8ed8-6d9bb73a7130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:06.580750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-4e208fd3-651d-4d38-8ed8-6d9bb73a7130 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:06.581973 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4e208fd3-651d-4d38-8ed8-6d9bb73a7130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:06.606816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a557a68-b4bb-4397-90a7-4467854bc84b admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:06.608607 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-5a557a68-b4bb-4397-90a7-4467854bc84b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:06.650722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1007/2015] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:39:06.660834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e208fd3-651d-4d38-8ed8-6d9bb73a7130 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:06.662323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4e208fd3-651d-4d38-8ed8-6d9bb73a7130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:06.687958 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a557a68-b4bb-4397-90a7-4467854bc84b admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:06.693316 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe730d1-bfb3-4879-93a4-785c22dca20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:06.694245 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe730d1-bfb3-4879-93a4-785c22dca20f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:06.694510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe730d1-bfb3-4879-93a4-785c22dca20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:06.694790 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe730d1-bfb3-4879-93a4-785c22dca20f admin admin] PATH_INFO: `/v3/projects/c531e29f56f74ee0b5cc28e029ad6f22` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:06.696029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe730d1-bfb3-4879-93a4-785c22dca20f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c531e29f56f74ee0b5cc28e029ad6f22)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:06.697975 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe730d1-bfb3-4879-93a4-785c22dca20f admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:06.726203 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e208fd3-651d-4d38-8ed8-6d9bb73a7130 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:06.730390 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4a1e8-63cc-47b3-a2a7-729189bd2c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:06.731082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4a1e8-63cc-47b3-a2a7-729189bd2c0e service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:06.731427 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4a1e8-63cc-47b3-a2a7-729189bd2c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:06.731631 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4a1e8-63cc-47b3-a2a7-729189bd2c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:06.742088 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4a1e8-63cc-47b3-a2a7-729189bd2c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:06.743443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4a1e8-63cc-47b3-a2a7-729189bd2c0e service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:06.756450 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1008/2016] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:39:06.876195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ebe730d1-bfb3-4879-93a4-785c22dca20f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c531e29f56f74ee0b5cc28e029ad6f22', 'request_id': 'req-ebe730d1-bfb3-4879-93a4-785c22dca20f'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:06.882160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ebe730d1-bfb3-4879-93a4-785c22dca20f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c531e29f56f74ee0b5cc28e029ad6f22', 'request_id': 'req-ebe730d1-bfb3-4879-93a4-785c22dca20f'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:06.976630 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ebe730d1-bfb3-4879-93a4-785c22dca20f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c531e29f56f74ee0b5cc28e029ad6f22', 'request_id': 'req-ebe730d1-bfb3-4879-93a4-785c22dca20f'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:06.989163 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ebe730d1-bfb3-4879-93a4-785c22dca20f admin admin] The token cache is being invalidate because project c531e29f56f74ee0b5cc28e029ad6f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:06.989454 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ebe730d1-bfb3-4879-93a4-785c22dca20f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:06.990159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ebe730d1-bfb3-4879-93a4-785c22dca20f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:06.991730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1009/2017] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:06 2022] DELETE /identity/v3/projects/c531e29f56f74ee0b5cc28e029ad6f22 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:39:06.995861 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4a1e8-63cc-47b3-a2a7-729189bd2c0e service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:07.006129 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4a1e8-63cc-47b3-a2a7-729189bd2c0e service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:07.009770 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:07.062217 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737faa6-0264-46ac-aa83-1ef9d555a67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:07.063576 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737faa6-0264-46ac-aa83-1ef9d555a67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:07.063858 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737faa6-0264-46ac-aa83-1ef9d555a67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:07.064135 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737faa6-0264-46ac-aa83-1ef9d555a67f admin admin] PATH_INFO: `/v3/users/fa5bd127f4ef4c47a64ac203008e1e01` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:07.065361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737faa6-0264-46ac-aa83-1ef9d555a67f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa5bd127f4ef4c47a64ac203008e1e01)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:07.067310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737faa6-0264-46ac-aa83-1ef9d555a67f admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:07.256420 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6737faa6-0264-46ac-aa83-1ef9d555a67f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa5bd127f4ef4c47a64ac203008e1e01'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:07.269013 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6737faa6-0264-46ac-aa83-1ef9d555a67f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa5bd127f4ef4c47a64ac203008e1e01'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:07.276016 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6737faa6-0264-46ac-aa83-1ef9d555a67f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa5bd127f4ef4c47a64ac203008e1e01'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:07.276736 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6737faa6-0264-46ac-aa83-1ef9d555a67f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa5bd127f4ef4c47a64ac203008e1e01'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:07.277386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6737faa6-0264-46ac-aa83-1ef9d555a67f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa5bd127f4ef4c47a64ac203008e1e01'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:07.356944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1009/2018] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:06 2022] DELETE /identity/v3/users/fa5bd127f4ef4c47a64ac203008e1e01 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:07.736937 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe730d1-bfb3-4879-93a4-785c22dca20f admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:07.739109 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ebe730d1-bfb3-4879-93a4-785c22dca20f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:07.753090 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe730d1-bfb3-4879-93a4-785c22dca20f admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:07.805880 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:07.814956 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82603edd-7cf1-4be3-816f-ed99715e9095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:07.815834 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82603edd-7cf1-4be3-816f-ed99715e9095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:07.816117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82603edd-7cf1-4be3-816f-ed99715e9095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:07.816393 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82603edd-7cf1-4be3-816f-ed99715e9095 admin admin] PATH_INFO: `/v3/users/5583b595b4ae4e0382ed1854ff95817e` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:07.817669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82603edd-7cf1-4be3-816f-ed99715e9095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5583b595b4ae4e0382ed1854ff95817e)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:07.819544 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82603edd-7cf1-4be3-816f-ed99715e9095 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:07.888318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737faa6-0264-46ac-aa83-1ef9d555a67f admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:07.889834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-6737faa6-0264-46ac-aa83-1ef9d555a67f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:07.904133 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737faa6-0264-46ac-aa83-1ef9d555a67f admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:07.919771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8eb29d-5a42-40e2-8c63-22867a34afca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:07.921005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8eb29d-5a42-40e2-8c63-22867a34afca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:07.921313 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8eb29d-5a42-40e2-8c63-22867a34afca admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:07.921624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8eb29d-5a42-40e2-8c63-22867a34afca admin admin] PATH_INFO: `/v3/projects/5a187fa30e2f4bdf9f92f8399d143836` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:07.923471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8eb29d-5a42-40e2-8c63-22867a34afca admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a187fa30e2f4bdf9f92f8399d143836)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:07.930527 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8eb29d-5a42-40e2-8c63-22867a34afca admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:07.996904 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-82603edd-7cf1-4be3-816f-ed99715e9095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5583b595b4ae4e0382ed1854ff95817e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:08.026182 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-82603edd-7cf1-4be3-816f-ed99715e9095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5583b595b4ae4e0382ed1854ff95817e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:08.038328 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-82603edd-7cf1-4be3-816f-ed99715e9095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5583b595b4ae4e0382ed1854ff95817e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:08.039003 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-82603edd-7cf1-4be3-816f-ed99715e9095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5583b595b4ae4e0382ed1854ff95817e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:08.039788 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-82603edd-7cf1-4be3-816f-ed99715e9095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5583b595b4ae4e0382ed1854ff95817e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:08.059244 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7b8eb29d-5a42-40e2-8c63-22867a34afca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a187fa30e2f4bdf9f92f8399d143836', 'request_id': 'req-7b8eb29d-5a42-40e2-8c63-22867a34afca'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:08.065878 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7b8eb29d-5a42-40e2-8c63-22867a34afca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a187fa30e2f4bdf9f92f8399d143836', 'request_id': 'req-7b8eb29d-5a42-40e2-8c63-22867a34afca'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:08.071885 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7b8eb29d-5a42-40e2-8c63-22867a34afca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a187fa30e2f4bdf9f92f8399d143836', 'request_id': 'req-7b8eb29d-5a42-40e2-8c63-22867a34afca'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:08.155610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1010/2019] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:07 2022] DELETE /identity/v3/users/5583b595b4ae4e0382ed1854ff95817e => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:08.160694 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748a298-2470-4c1e-98af-63482f9b4840 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:08.160984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748a298-2470-4c1e-98af-63482f9b4840 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:08.161261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748a298-2470-4c1e-98af-63482f9b4840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:08.178242 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-8748a298-2470-4c1e-98af-63482f9b4840 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:08.179424 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-8748a298-2470-4c1e-98af-63482f9b4840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:08.234745 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7b8eb29d-5a42-40e2-8c63-22867a34afca admin admin] The token cache is being invalidate because project 5a187fa30e2f4bdf9f92f8399d143836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:08.235614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7b8eb29d-5a42-40e2-8c63-22867a34afca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:08.235730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7b8eb29d-5a42-40e2-8c63-22867a34afca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:08.237255 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1010/2020] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:07 2022] DELETE /identity/v3/projects/5a187fa30e2f4bdf9f92f8399d143836 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:39:08.242079 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590c581-c23d-4cf4-895e-af8124e27643 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:08.242441 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590c581-c23d-4cf4-895e-af8124e27643 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:08.242940 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590c581-c23d-4cf4-895e-af8124e27643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:08.258641 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1011/2021] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:39:08.269365 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748a298-2470-4c1e-98af-63482f9b4840 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:08.270055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-b590c581-c23d-4cf4-895e-af8124e27643 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:08.271325 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b590c581-c23d-4cf4-895e-af8124e27643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:08.273042 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-8748a298-2470-4c1e-98af-63482f9b4840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:08.283152 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1011/2022] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:08.301625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad94fb-21fb-47a3-8170-c03150abe918 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:08.301993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad94fb-21fb-47a3-8170-c03150abe918 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:08.302281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad94fb-21fb-47a3-8170-c03150abe918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:08.312617 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:08.341888 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-5aad94fb-21fb-47a3-8170-c03150abe918 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:08.343145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5aad94fb-21fb-47a3-8170-c03150abe918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:08.360214 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1012/2023] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:39:08.365093 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad94fb-21fb-47a3-8170-c03150abe918 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:08.369139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748a298-2470-4c1e-98af-63482f9b4840 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:08.373292 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0304a52-33f5-4c3f-aa0b-7e50498baa0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:08.374007 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0304a52-33f5-4c3f-aa0b-7e50498baa0b service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:08.374409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0304a52-33f5-4c3f-aa0b-7e50498baa0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:08.374709 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0304a52-33f5-4c3f-aa0b-7e50498baa0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:08.376740 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad94fb-21fb-47a3-8170-c03150abe918 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:08.383238 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031a970-76ff-41c8-be18-a941d545d8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:08.384112 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031a970-76ff-41c8-be18-a941d545d8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:08.384418 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031a970-76ff-41c8-be18-a941d545d8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:08.384680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031a970-76ff-41c8-be18-a941d545d8f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:08.385424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031a970-76ff-41c8-be18-a941d545d8f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:39:08.385764 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031a970-76ff-41c8-be18-a941d545d8f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:08.387386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c031a970-76ff-41c8-be18-a941d545d8f5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:08.387971 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0304a52-33f5-4c3f-aa0b-7e50498baa0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:08.390117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0304a52-33f5-4c3f-aa0b-7e50498baa0b service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:08.407699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1013/2024] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:39:08.410039 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031a970-76ff-41c8-be18-a941d545d8f5 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:08.422064 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031a970-76ff-41c8-be18-a941d545d8f5 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:08.424300 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1012/2025] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:39:08.428822 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d83fb-e515-47d5-a03e-b9a4b596c258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:08.429836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d83fb-e515-47d5-a03e-b9a4b596c258 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:08.430360 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d83fb-e515-47d5-a03e-b9a4b596c258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:08.430651 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d83fb-e515-47d5-a03e-b9a4b596c258 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:08.431689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d83fb-e515-47d5-a03e-b9a4b596c258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:08.434093 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d83fb-e515-47d5-a03e-b9a4b596c258 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:08.528723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1014/2026] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:08 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:08.530030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0304a52-33f5-4c3f-aa0b-7e50498baa0b service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:08.541180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0304a52-33f5-4c3f-aa0b-7e50498baa0b service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:08.555409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:08.626696 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62400c75-c0bf-4640-87aa-a5817ffde839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:08.627647 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62400c75-c0bf-4640-87aa-a5817ffde839 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:08.628136 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62400c75-c0bf-4640-87aa-a5817ffde839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:08.628601 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62400c75-c0bf-4640-87aa-a5817ffde839 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:08.629508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62400c75-c0bf-4640-87aa-a5817ffde839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:08.631981 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62400c75-c0bf-4640-87aa-a5817ffde839 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:08.743010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1013/2027] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:08 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:08.745706 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d83fb-e515-47d5-a03e-b9a4b596c258 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:08.757125 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d83fb-e515-47d5-a03e-b9a4b596c258 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:08.762645 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148c1f3-542f-4c1f-a70e-2749d2050d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:08.763319 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148c1f3-542f-4c1f-a70e-2749d2050d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:08.763755 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148c1f3-542f-4c1f-a70e-2749d2050d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:08.764038 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148c1f3-542f-4c1f-a70e-2749d2050d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:08.764755 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148c1f3-542f-4c1f-a70e-2749d2050d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:08.767058 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148c1f3-542f-4c1f-a70e-2749d2050d1c admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:08.778124 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1015/2028] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:08.784218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62400c75-c0bf-4640-87aa-a5817ffde839 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:08.796276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62400c75-c0bf-4640-87aa-a5817ffde839 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:08.802110 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda060a-479b-4164-b156-931e146b972b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:08.802909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda060a-479b-4164-b156-931e146b972b admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:08.803587 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda060a-479b-4164-b156-931e146b972b admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:08.803587 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda060a-479b-4164-b156-931e146b972b admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:08.805778 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda060a-479b-4164-b156-931e146b972b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:08.807372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda060a-479b-4164-b156-931e146b972b admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:08.821450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1014/2029] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:08.825814 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148c1f3-542f-4c1f-a70e-2749d2050d1c admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:08.847323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148c1f3-542f-4c1f-a70e-2749d2050d1c admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:08.853460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a5997-6833-497e-bc02-e7a82457906b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:08.854541 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a5997-6833-497e-bc02-e7a82457906b admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:08.854842 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a5997-6833-497e-bc02-e7a82457906b admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:08.855110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a5997-6833-497e-bc02-e7a82457906b admin admin] PATH_INFO: `/v3/projects/6e45f4cb4fe046dc82769d2a38bc238e/users/0d394dd2a759484088be97a086555904/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:08.874511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a5997-6833-497e-bc02-e7a82457906b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e45f4cb4fe046dc82769d2a38bc238e, user_id=0d394dd2a759484088be97a086555904, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:08.875846 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a5997-6833-497e-bc02-e7a82457906b admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:08.957473 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1016/2030] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:08 2022] PUT /identity/v3/projects/6e45f4cb4fe046dc82769d2a38bc238e/users/0d394dd2a759484088be97a086555904/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:08.968357 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afde1e-0c20-46ac-99a5-87651ef87991 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:08.969314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afde1e-0c20-46ac-99a5-87651ef87991 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:08.969739 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afde1e-0c20-46ac-99a5-87651ef87991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:09.004839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-b9afde1e-0c20-46ac-99a5-87651ef87991 None None] MFA Rules not processed for user `0d394dd2a759484088be97a086555904`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:09.006427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b9afde1e-0c20-46ac-99a5-87651ef87991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:09.088010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1015/2031] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:09.103658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a5997-6833-497e-bc02-e7a82457906b admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:09.106926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4f2a5997-6833-497e-bc02-e7a82457906b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:09.183399 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a5997-6833-497e-bc02-e7a82457906b admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:09.189886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469690e-4601-4ec2-89f3-d74d3e33b114 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:09.191433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469690e-4601-4ec2-89f3-d74d3e33b114 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:09.192361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469690e-4601-4ec2-89f3-d74d3e33b114 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:09.193022 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469690e-4601-4ec2-89f3-d74d3e33b114 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:09.206694 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469690e-4601-4ec2-89f3-d74d3e33b114 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:09.208279 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1469690e-4601-4ec2-89f3-d74d3e33b114 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:09.218301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1017/2032] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:09.241968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afde1e-0c20-46ac-99a5-87651ef87991 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:09.241968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b9afde1e-0c20-46ac-99a5-87651ef87991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:09.242906 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469690e-4601-4ec2-89f3-d74d3e33b114 service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:09.341142 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afde1e-0c20-46ac-99a5-87651ef87991 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:09.348117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8dd49d-ca31-4069-9995-f5e8019cd153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:09.349853 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dd49d-ca31-4069-9995-f5e8019cd153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:09.351157 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dd49d-ca31-4069-9995-f5e8019cd153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:09.351531 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dd49d-ca31-4069-9995-f5e8019cd153 admin admin] PATH_INFO: `/v3/projects/2a4fd39c8189481d82ab8e51f5228d72` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:09.353068 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8dd49d-ca31-4069-9995-f5e8019cd153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a4fd39c8189481d82ab8e51f5228d72)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:09.353807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469690e-4601-4ec2-89f3-d74d3e33b114 service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:09.355827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8dd49d-ca31-4069-9995-f5e8019cd153 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:09.358945 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bdefc-8b16-4299-a72e-6a5f7817edab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:09.359874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bdefc-8b16-4299-a72e-6a5f7817edab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:09.360165 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bdefc-8b16-4299-a72e-6a5f7817edab admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:09.360447 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bdefc-8b16-4299-a72e-6a5f7817edab admin admin] PATH_INFO: `/v3/users/0d394dd2a759484088be97a086555904` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:09.362464 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076bdefc-8b16-4299-a72e-6a5f7817edab admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d394dd2a759484088be97a086555904)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:09.364483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076bdefc-8b16-4299-a72e-6a5f7817edab admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:09.650819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ed8dd49d-ca31-4069-9995-f5e8019cd153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a4fd39c8189481d82ab8e51f5228d72', 'request_id': 'req-ed8dd49d-ca31-4069-9995-f5e8019cd153'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:09.663305 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ed8dd49d-ca31-4069-9995-f5e8019cd153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a4fd39c8189481d82ab8e51f5228d72', 'request_id': 'req-ed8dd49d-ca31-4069-9995-f5e8019cd153'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:09.746195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ed8dd49d-ca31-4069-9995-f5e8019cd153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a4fd39c8189481d82ab8e51f5228d72', 'request_id': 'req-ed8dd49d-ca31-4069-9995-f5e8019cd153'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:09.768122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ed8dd49d-ca31-4069-9995-f5e8019cd153 admin admin] The token cache is being invalidate because project 2a4fd39c8189481d82ab8e51f5228d72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:09.768430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ed8dd49d-ca31-4069-9995-f5e8019cd153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:09.770274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ed8dd49d-ca31-4069-9995-f5e8019cd153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:09.772672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1016/2033] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:09 2022] DELETE /identity/v3/projects/2a4fd39c8189481d82ab8e51f5228d72 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:09.772784 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-076bdefc-8b16-4299-a72e-6a5f7817edab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d394dd2a759484088be97a086555904'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:09.781556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8dd49d-ca31-4069-9995-f5e8019cd153 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:09.788681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ed8dd49d-ca31-4069-9995-f5e8019cd153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:09.798744 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-076bdefc-8b16-4299-a72e-6a5f7817edab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d394dd2a759484088be97a086555904'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:09.813243 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-076bdefc-8b16-4299-a72e-6a5f7817edab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d394dd2a759484088be97a086555904'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:09.816726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-076bdefc-8b16-4299-a72e-6a5f7817edab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d394dd2a759484088be97a086555904'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:09.818552 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-076bdefc-8b16-4299-a72e-6a5f7817edab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d394dd2a759484088be97a086555904'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:09.883945 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8dd49d-ca31-4069-9995-f5e8019cd153 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:09.888670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256774e-3c4a-416b-8f49-279d84b4c847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:09.889573 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256774e-3c4a-416b-8f49-279d84b4c847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:09.889860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256774e-3c4a-416b-8f49-279d84b4c847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:09.890132 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256774e-3c4a-416b-8f49-279d84b4c847 admin admin] PATH_INFO: `/v3/users/3d1222932cf74b679a0ff05362b691f3` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:09.891427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256774e-3c4a-416b-8f49-279d84b4c847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d1222932cf74b679a0ff05362b691f3)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:09.893372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256774e-3c4a-416b-8f49-279d84b4c847 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:09.915945 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1018/2034] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:09 2022] DELETE /identity/v3/users/0d394dd2a759484088be97a086555904 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:09.917500 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165856cd-52fc-4d92-a4ec-f94925b264d1 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:09.917923 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165856cd-52fc-4d92-a4ec-f94925b264d1 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:09.918272 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165856cd-52fc-4d92-a4ec-f94925b264d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:09.948268 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-165856cd-52fc-4d92-a4ec-f94925b264d1 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:09.950781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-165856cd-52fc-4d92-a4ec-f94925b264d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:10.035072 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1019/2035] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:10.044871 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165856cd-52fc-4d92-a4ec-f94925b264d1 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:10.047491 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-165856cd-52fc-4d92-a4ec-f94925b264d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:10.072917 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:10.116789 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-8256774e-3c4a-416b-8f49-279d84b4c847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d1222932cf74b679a0ff05362b691f3'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:10.122690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165856cd-52fc-4d92-a4ec-f94925b264d1 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:10.126490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba78c16-e404-4926-84d8-886866d65797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:10.127161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba78c16-e404-4926-84d8-886866d65797 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:10.127450 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba78c16-e404-4926-84d8-886866d65797 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:10.127734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba78c16-e404-4926-84d8-886866d65797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:10.137493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-8256774e-3c4a-416b-8f49-279d84b4c847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d1222932cf74b679a0ff05362b691f3'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:10.138091 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba78c16-e404-4926-84d8-886866d65797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:10.139622 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba78c16-e404-4926-84d8-886866d65797 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:10.146065 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-8256774e-3c4a-416b-8f49-279d84b4c847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d1222932cf74b679a0ff05362b691f3'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:10.147177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-8256774e-3c4a-416b-8f49-279d84b4c847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d1222932cf74b679a0ff05362b691f3'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:10.148042 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-8256774e-3c4a-416b-8f49-279d84b4c847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d1222932cf74b679a0ff05362b691f3'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:10.153711 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1020/2036] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:39:10.227969 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1017/2037] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:09 2022] DELETE /identity/v3/users/3d1222932cf74b679a0ff05362b691f3 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:10.612260 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:10.783928 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba78c16-e404-4926-84d8-886866d65797 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:10.786962 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-dba78c16-e404-4926-84d8-886866d65797 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:10.805565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba78c16-e404-4926-84d8-886866d65797 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:10.879350 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256774e-3c4a-416b-8f49-279d84b4c847 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:10.879350 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-8256774e-3c4a-416b-8f49-279d84b4c847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:10.914618 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cca84e-3cb8-4abc-afe4-7f5bdd19a095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:10.915506 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cca84e-3cb8-4abc-afe4-7f5bdd19a095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:10.915774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cca84e-3cb8-4abc-afe4-7f5bdd19a095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:10.916388 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cca84e-3cb8-4abc-afe4-7f5bdd19a095 admin admin] PATH_INFO: `/v3/projects/6e45f4cb4fe046dc82769d2a38bc238e` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:10.919399 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cca84e-3cb8-4abc-afe4-7f5bdd19a095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e45f4cb4fe046dc82769d2a38bc238e)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:10.921755 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cca84e-3cb8-4abc-afe4-7f5bdd19a095 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:10.986585 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256774e-3c4a-416b-8f49-279d84b4c847 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:10.994895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4df17-e7d7-4e0e-a710-1fc8f37ed045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:10.996398 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4df17-e7d7-4e0e-a710-1fc8f37ed045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:10.998232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4df17-e7d7-4e0e-a710-1fc8f37ed045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:10.998749 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4df17-e7d7-4e0e-a710-1fc8f37ed045 admin admin] PATH_INFO: `/v3/projects/b35923ceaaef4180bad195d97108fb3a` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:11.001091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4df17-e7d7-4e0e-a710-1fc8f37ed045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b35923ceaaef4180bad195d97108fb3a)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:11.003376 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4df17-e7d7-4e0e-a710-1fc8f37ed045 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:11.093852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f5cca84e-3cb8-4abc-afe4-7f5bdd19a095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e45f4cb4fe046dc82769d2a38bc238e', 'request_id': 'req-f5cca84e-3cb8-4abc-afe4-7f5bdd19a095'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:11.103713 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f5cca84e-3cb8-4abc-afe4-7f5bdd19a095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e45f4cb4fe046dc82769d2a38bc238e', 'request_id': 'req-f5cca84e-3cb8-4abc-afe4-7f5bdd19a095'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:11.111109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f5cca84e-3cb8-4abc-afe4-7f5bdd19a095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e45f4cb4fe046dc82769d2a38bc238e', 'request_id': 'req-f5cca84e-3cb8-4abc-afe4-7f5bdd19a095'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:11.128349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-fcc4df17-e7d7-4e0e-a710-1fc8f37ed045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b35923ceaaef4180bad195d97108fb3a', 'request_id': 'req-fcc4df17-e7d7-4e0e-a710-1fc8f37ed045'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:11.135255 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-fcc4df17-e7d7-4e0e-a710-1fc8f37ed045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b35923ceaaef4180bad195d97108fb3a', 'request_id': 'req-fcc4df17-e7d7-4e0e-a710-1fc8f37ed045'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:11.216335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f5cca84e-3cb8-4abc-afe4-7f5bdd19a095 admin admin] The token cache is being invalidate because project 6e45f4cb4fe046dc82769d2a38bc238e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:11.216869 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f5cca84e-3cb8-4abc-afe4-7f5bdd19a095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:11.217511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f5cca84e-3cb8-4abc-afe4-7f5bdd19a095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:11.222693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1021/2038] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:10 2022] DELETE /identity/v3/projects/6e45f4cb4fe046dc82769d2a38bc238e => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:11.224789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b7c27-6afc-41d2-bdd7-3d1fb6c3ff80 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:11.225165 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b7c27-6afc-41d2-bdd7-3d1fb6c3ff80 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:11.225504 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b7c27-6afc-41d2-bdd7-3d1fb6c3ff80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:11.246720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-e36b7c27-6afc-41d2-bdd7-3d1fb6c3ff80 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:11.248167 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e36b7c27-6afc-41d2-bdd7-3d1fb6c3ff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:11.293187 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-fcc4df17-e7d7-4e0e-a710-1fc8f37ed045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b35923ceaaef4180bad195d97108fb3a', 'request_id': 'req-fcc4df17-e7d7-4e0e-a710-1fc8f37ed045'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:11.314173 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-fcc4df17-e7d7-4e0e-a710-1fc8f37ed045 admin admin] The token cache is being invalidate because project b35923ceaaef4180bad195d97108fb3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:11.314507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-fcc4df17-e7d7-4e0e-a710-1fc8f37ed045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:11.315726 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-fcc4df17-e7d7-4e0e-a710-1fc8f37ed045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:11.325578 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1018/2039] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:10 2022] DELETE /identity/v3/projects/b35923ceaaef4180bad195d97108fb3a => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:11.325578 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ce1e7-8e63-40d2-9f89-bc16ff96af9b None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:11.325578 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ce1e7-8e63-40d2-9f89-bc16ff96af9b None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:11.325578 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ce1e7-8e63-40d2-9f89-bc16ff96af9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:11.354419 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-599ce1e7-8e63-40d2-9f89-bc16ff96af9b None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:11.355709 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-599ce1e7-8e63-40d2-9f89-bc16ff96af9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:11.357110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1022/2040] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:11.368974 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b7c27-6afc-41d2-bdd7-3d1fb6c3ff80 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:11.370422 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e36b7c27-6afc-41d2-bdd7-3d1fb6c3ff80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:11.390486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1019/2041] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:11.390486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87182dc-54b0-440a-9788-d26d6a579153 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:11.390486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87182dc-54b0-440a-9788-d26d6a579153 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:11.390486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87182dc-54b0-440a-9788-d26d6a579153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:11.390922 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b7c27-6afc-41d2-bdd7-3d1fb6c3ff80 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:11.400924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3237e0-4074-4147-82ca-be3cc460830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:11.401631 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3237e0-4074-4147-82ca-be3cc460830a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:11.402021 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3237e0-4074-4147-82ca-be3cc460830a admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:11.402230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3237e0-4074-4147-82ca-be3cc460830a admin admin] PATH_INFO: `/v3/users/0c3595b2c3fe454481309e4db3016699` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:11.403449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3237e0-4074-4147-82ca-be3cc460830a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c3595b2c3fe454481309e4db3016699)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:11.405854 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3237e0-4074-4147-82ca-be3cc460830a admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:11.424902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-c87182dc-54b0-440a-9788-d26d6a579153 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:11.426634 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c87182dc-54b0-440a-9788-d26d6a579153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:11.439380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1020/2042] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:11.441033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03277c-602a-4eaf-9c89-0622de80bba6 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:11.441638 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03277c-602a-4eaf-9c89-0622de80bba6 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:11.442102 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03277c-602a-4eaf-9c89-0622de80bba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:11.476214 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-be03277c-602a-4eaf-9c89-0622de80bba6 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:11.477448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-be03277c-602a-4eaf-9c89-0622de80bba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:11.489922 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1021/2043] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:11.489922 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03277c-602a-4eaf-9c89-0622de80bba6 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:11.500779 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03277c-602a-4eaf-9c89-0622de80bba6 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:11.505843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97cf82-27f1-48e4-98b5-55fc4e4c011d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:11.506514 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97cf82-27f1-48e4-98b5-55fc4e4c011d admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:11.506800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97cf82-27f1-48e4-98b5-55fc4e4c011d admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:11.507092 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97cf82-27f1-48e4-98b5-55fc4e4c011d admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:11.507826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97cf82-27f1-48e4-98b5-55fc4e4c011d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:39:11.508159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97cf82-27f1-48e4-98b5-55fc4e4c011d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:11.509924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de97cf82-27f1-48e4-98b5-55fc4e4c011d admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:11.523107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1022/2044] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:39:11.527368 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97cf82-27f1-48e4-98b5-55fc4e4c011d admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:11.542199 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97cf82-27f1-48e4-98b5-55fc4e4c011d admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:11.550187 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee9a07-0f0d-4cb8-9302-a40694c47284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:11.550933 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9a07-0f0d-4cb8-9302-a40694c47284 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:11.551242 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9a07-0f0d-4cb8-9302-a40694c47284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:11.551522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee9a07-0f0d-4cb8-9302-a40694c47284 admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:11.552936 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee9a07-0f0d-4cb8-9302-a40694c47284 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:39:11.553620 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee9a07-0f0d-4cb8-9302-a40694c47284 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:11.555657 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ee9a07-0f0d-4cb8-9302-a40694c47284 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:11.571795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1023/2045] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:39:11.572714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee9a07-0f0d-4cb8-9302-a40694c47284 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:11.583432 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee9a07-0f0d-4cb8-9302-a40694c47284 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:11.589736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f9aa6-a3fb-4dfd-b253-f686a8a02c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:11.590413 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f9aa6-a3fb-4dfd-b253-f686a8a02c04 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:11.590691 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f9aa6-a3fb-4dfd-b253-f686a8a02c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:11.590964 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f9aa6-a3fb-4dfd-b253-f686a8a02c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:11.591995 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f9aa6-a3fb-4dfd-b253-f686a8a02c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:11.595718 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f9aa6-a3fb-4dfd-b253-f686a8a02c04 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:11.618344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-de3237e0-4074-4147-82ca-be3cc460830a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c3595b2c3fe454481309e4db3016699'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:11.631862 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-de3237e0-4074-4147-82ca-be3cc460830a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c3595b2c3fe454481309e4db3016699'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:11.638799 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-de3237e0-4074-4147-82ca-be3cc460830a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c3595b2c3fe454481309e4db3016699'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:11.639575 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-de3237e0-4074-4147-82ca-be3cc460830a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c3595b2c3fe454481309e4db3016699'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:11.640193 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-de3237e0-4074-4147-82ca-be3cc460830a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c3595b2c3fe454481309e4db3016699'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:11.688767 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1024/2046] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:11 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:11.689562 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f9aa6-a3fb-4dfd-b253-f686a8a02c04 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:11.691676 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-182f9aa6-a3fb-4dfd-b253-f686a8a02c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:11.718120 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1023/2047] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:11 2022] DELETE /identity/v3/users/0c3595b2c3fe454481309e4db3016699 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:11.718120 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3237e0-4074-4147-82ca-be3cc460830a admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:11.722422 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-de3237e0-4074-4147-82ca-be3cc460830a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:11.821171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3237e0-4074-4147-82ca-be3cc460830a admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:11.971732 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba027e-1750-41c3-a1b8-88eb8879da3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:11.971732 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba027e-1750-41c3-a1b8-88eb8879da3c admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:11.971732 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba027e-1750-41c3-a1b8-88eb8879da3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:11.971732 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba027e-1750-41c3-a1b8-88eb8879da3c admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:12.008138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba027e-1750-41c3-a1b8-88eb8879da3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:12.008138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba027e-1750-41c3-a1b8-88eb8879da3c admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:12.009240 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f9aa6-a3fb-4dfd-b253-f686a8a02c04 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:12.009240 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f4674-8b14-4c1e-bed7-f983e5839115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:12.009240 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f4674-8b14-4c1e-bed7-f983e5839115 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:12.009240 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f4674-8b14-4c1e-bed7-f983e5839115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:12.010121 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f4674-8b14-4c1e-bed7-f983e5839115 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:12.010121 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f4674-8b14-4c1e-bed7-f983e5839115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:12.010121 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f4674-8b14-4c1e-bed7-f983e5839115 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:12.020127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1024/2048] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:11 2022] POST /identity/v3/users => generated 292 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:12.021844 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84ba27-0940-4353-810b-58fb681c27c5 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:12.022317 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84ba27-0940-4353-810b-58fb681c27c5 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:12.022819 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84ba27-0940-4353-810b-58fb681c27c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:12.044209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-3f84ba27-0940-4353-810b-58fb681c27c5 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:12.047573 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-3f84ba27-0940-4353-810b-58fb681c27c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:12.054927 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1025/2049] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:12.056095 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84ba27-0940-4353-810b-58fb681c27c5 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:12.069470 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84ba27-0940-4353-810b-58fb681c27c5 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:12.073171 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1025/2050] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:11 2022] POST /identity/v3/projects => generated 383 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:12.073171 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f4674-8b14-4c1e-bed7-f983e5839115 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:12.077301 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-fc2f4674-8b14-4c1e-bed7-f983e5839115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:12.170489 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f4674-8b14-4c1e-bed7-f983e5839115 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:12.171246 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:12.180029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fee074-c2b6-45ff-9c45-14c4c527fd91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:12.180877 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fee074-c2b6-45ff-9c45-14c4c527fd91 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:12.181256 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fee074-c2b6-45ff-9c45-14c4c527fd91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:12.181684 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fee074-c2b6-45ff-9c45-14c4c527fd91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:12.195662 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fee074-c2b6-45ff-9c45-14c4c527fd91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:12.197462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fee074-c2b6-45ff-9c45-14c4c527fd91 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:12.209973 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e026f14-dccc-4fb4-920c-ee814855f530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:12.213705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e026f14-dccc-4fb4-920c-ee814855f530 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:12.213705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e026f14-dccc-4fb4-920c-ee814855f530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:12.213705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e026f14-dccc-4fb4-920c-ee814855f530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:12.213705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e026f14-dccc-4fb4-920c-ee814855f530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:12.216093 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1026/2051] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:12.217122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fee074-c2b6-45ff-9c45-14c4c527fd91 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:12.217899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e026f14-dccc-4fb4-920c-ee814855f530 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:12.236673 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1026/2052] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:12.243273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e026f14-dccc-4fb4-920c-ee814855f530 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:12.251993 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fee074-c2b6-45ff-9c45-14c4c527fd91 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:12.261299 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e026f14-dccc-4fb4-920c-ee814855f530 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:12.268115 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69469f78-ae02-4018-ba6d-e4732ca611d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:12.271376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69469f78-ae02-4018-ba6d-e4732ca611d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:12.271376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69469f78-ae02-4018-ba6d-e4732ca611d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:12.271376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69469f78-ae02-4018-ba6d-e4732ca611d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:12.271376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69469f78-ae02-4018-ba6d-e4732ca611d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:12.274138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69469f78-ae02-4018-ba6d-e4732ca611d8 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:12.275757 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8ae7d-6f91-4f7d-970f-c888e2e60717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:12.276463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8ae7d-6f91-4f7d-970f-c888e2e60717 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:12.276777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8ae7d-6f91-4f7d-970f-c888e2e60717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:12.277053 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8ae7d-6f91-4f7d-970f-c888e2e60717 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:12.278369 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8ae7d-6f91-4f7d-970f-c888e2e60717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:12.280375 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8ae7d-6f91-4f7d-970f-c888e2e60717 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:12.290659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1027/2053] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:12.295140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69469f78-ae02-4018-ba6d-e4732ca611d8 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:12.307380 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69469f78-ae02-4018-ba6d-e4732ca611d8 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:12.313558 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcd47b-419f-49c7-96ee-d0288deb2917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:12.314584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcd47b-419f-49c7-96ee-d0288deb2917 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:12.314940 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcd47b-419f-49c7-96ee-d0288deb2917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:12.315293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcd47b-419f-49c7-96ee-d0288deb2917 admin admin] PATH_INFO: `/v3/projects/6d3e9b1572fe48febf6d187e26796d84/users/2401949a852d42a08da0eb0b8008efb1/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:12.336121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcd47b-419f-49c7-96ee-d0288deb2917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3e9b1572fe48febf6d187e26796d84, user_id=2401949a852d42a08da0eb0b8008efb1, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:12.339179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfcd47b-419f-49c7-96ee-d0288deb2917 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:12.430278 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1027/2054] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:12 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:12.431835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8ae7d-6f91-4f7d-970f-c888e2e60717 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:12.453685 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1028/2055] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:12 2022] PUT /identity/v3/projects/6d3e9b1572fe48febf6d187e26796d84/users/2401949a852d42a08da0eb0b8008efb1/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:39:12.463655 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8ae7d-6f91-4f7d-970f-c888e2e60717 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:12.467212 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d5b2a-e156-43a0-8350-ed6cdbe77d80 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:12.467504 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d5b2a-e156-43a0-8350-ed6cdbe77d80 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:12.467784 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d5b2a-e156-43a0-8350-ed6cdbe77d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:12.524978 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-bc4d5b2a-e156-43a0-8350-ed6cdbe77d80 None None] MFA Rules not processed for user `2401949a852d42a08da0eb0b8008efb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:12.526276 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-bc4d5b2a-e156-43a0-8350-ed6cdbe77d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:12.559977 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7257de3-f61e-4b56-ad21-97a96376377e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:12.560656 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7257de3-f61e-4b56-ad21-97a96376377e admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:12.560939 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7257de3-f61e-4b56-ad21-97a96376377e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:12.561518 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7257de3-f61e-4b56-ad21-97a96376377e admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:12.561985 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7257de3-f61e-4b56-ad21-97a96376377e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:12.564247 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7257de3-f61e-4b56-ad21-97a96376377e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:12.578647 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1028/2056] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:12.582899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7257de3-f61e-4b56-ad21-97a96376377e admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:12.604992 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7257de3-f61e-4b56-ad21-97a96376377e admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:12.611521 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f742f2-8074-4814-8e70-079e98d80c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:12.612310 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f742f2-8074-4814-8e70-079e98d80c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:12.612586 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f742f2-8074-4814-8e70-079e98d80c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:12.612889 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1029/2057] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:39:12.613142 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f742f2-8074-4814-8e70-079e98d80c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:12.613939 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f742f2-8074-4814-8e70-079e98d80c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:12.615547 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f742f2-8074-4814-8e70-079e98d80c57 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:12.621155 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d5b2a-e156-43a0-8350-ed6cdbe77d80 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:12.627084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1029/2058] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:12.629576 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-bc4d5b2a-e156-43a0-8350-ed6cdbe77d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:12.631072 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f742f2-8074-4814-8e70-079e98d80c57 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:12.644699 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f742f2-8074-4814-8e70-079e98d80c57 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:12.660249 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c2dcc-e215-4eaa-a8ea-7216c8244e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:12.661501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c2dcc-e215-4eaa-a8ea-7216c8244e85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:12.661707 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c2dcc-e215-4eaa-a8ea-7216c8244e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:12.661985 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c2dcc-e215-4eaa-a8ea-7216c8244e85 admin admin] PATH_INFO: `/v3/projects/c7d87eefe272456785461952e2c445cf/users/1b0d8d14160f4df3bca51efb3aa4ffa8/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:12.701583 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c2dcc-e215-4eaa-a8ea-7216c8244e85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d87eefe272456785461952e2c445cf, user_id=1b0d8d14160f4df3bca51efb3aa4ffa8, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:12.715835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3c2dcc-e215-4eaa-a8ea-7216c8244e85 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:12.726157 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d5b2a-e156-43a0-8350-ed6cdbe77d80 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:12.731798 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacb1d7-7c1a-47cf-917c-a1c0c835ae25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:12.731798 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacb1d7-7c1a-47cf-917c-a1c0c835ae25 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:12.731798 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacb1d7-7c1a-47cf-917c-a1c0c835ae25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:12.731798 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacb1d7-7c1a-47cf-917c-a1c0c835ae25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:12.742082 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:12.744328 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afacb1d7-7c1a-47cf-917c-a1c0c835ae25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:12.746409 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afacb1d7-7c1a-47cf-917c-a1c0c835ae25 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:12.773213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1030/2059] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:39:12.822928 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1030/2060] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:12 2022] PUT /identity/v3/projects/c7d87eefe272456785461952e2c445cf/users/1b0d8d14160f4df3bca51efb3aa4ffa8/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:12.834304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835152ae-b04b-4e51-ad24-b7eefb489409 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:12.834712 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835152ae-b04b-4e51-ad24-b7eefb489409 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:12.835099 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835152ae-b04b-4e51-ad24-b7eefb489409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:12.876477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-835152ae-b04b-4e51-ad24-b7eefb489409 None None] MFA Rules not processed for user `1b0d8d14160f4df3bca51efb3aa4ffa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:12.877994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-835152ae-b04b-4e51-ad24-b7eefb489409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:12.993005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1031/2061] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:12.995933 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c2dcc-e215-4eaa-a8ea-7216c8244e85 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:13.042956 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835152ae-b04b-4e51-ad24-b7eefb489409 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:13.049051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-835152ae-b04b-4e51-ad24-b7eefb489409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:13.132883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c2dcc-e215-4eaa-a8ea-7216c8244e85 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:13.147884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a7c23-61b2-495d-8b95-5e2c1261f069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:13.149796 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a7c23-61b2-495d-8b95-5e2c1261f069 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:13.150317 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a7c23-61b2-495d-8b95-5e2c1261f069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:13.151033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a7c23-61b2-495d-8b95-5e2c1261f069 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:13.153382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a7c23-61b2-495d-8b95-5e2c1261f069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:13.158268 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a7c23-61b2-495d-8b95-5e2c1261f069 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:13.161059 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835152ae-b04b-4e51-ad24-b7eefb489409 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:13.176026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc7fd1-2350-455c-b3d1-d44ecfa28b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:13.181688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc7fd1-2350-455c-b3d1-d44ecfa28b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:13.181688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc7fd1-2350-455c-b3d1-d44ecfa28b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:13.181688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc7fd1-2350-455c-b3d1-d44ecfa28b61 admin admin] PATH_INFO: `/v3/projects/f42f282d5d9148dc8ff115a54349d1e5` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:13.187843 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc7fd1-2350-455c-b3d1-d44ecfa28b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f42f282d5d9148dc8ff115a54349d1e5)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:13.190806 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc7fd1-2350-455c-b3d1-d44ecfa28b61 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:13.300830 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1031/2062] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:12 2022] POST /identity/v3/projects => generated 381 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:39:13.303714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a7c23-61b2-495d-8b95-5e2c1261f069 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:13.312214 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-1fdc7fd1-2350-455c-b3d1-d44ecfa28b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f42f282d5d9148dc8ff115a54349d1e5', 'request_id': 'req-1fdc7fd1-2350-455c-b3d1-d44ecfa28b61'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:13.319993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-1fdc7fd1-2350-455c-b3d1-d44ecfa28b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f42f282d5d9148dc8ff115a54349d1e5', 'request_id': 'req-1fdc7fd1-2350-455c-b3d1-d44ecfa28b61'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:13.328051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-1fdc7fd1-2350-455c-b3d1-d44ecfa28b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f42f282d5d9148dc8ff115a54349d1e5', 'request_id': 'req-1fdc7fd1-2350-455c-b3d1-d44ecfa28b61'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:13.402059 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a7c23-61b2-495d-8b95-5e2c1261f069 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:13.407357 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd209029-c871-416d-93ea-9c4258489648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:13.407919 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd209029-c871-416d-93ea-9c4258489648 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:13.408203 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd209029-c871-416d-93ea-9c4258489648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:13.408506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd209029-c871-416d-93ea-9c4258489648 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:13.409429 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd209029-c871-416d-93ea-9c4258489648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:13.411343 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd209029-c871-416d-93ea-9c4258489648 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:13.461985 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-1fdc7fd1-2350-455c-b3d1-d44ecfa28b61 admin admin] The token cache is being invalidate because project f42f282d5d9148dc8ff115a54349d1e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:13.462466 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-1fdc7fd1-2350-455c-b3d1-d44ecfa28b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:13.463721 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-1fdc7fd1-2350-455c-b3d1-d44ecfa28b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:13.470448 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1032/2063] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:13 2022] DELETE /identity/v3/projects/f42f282d5d9148dc8ff115a54349d1e5 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:13.470448 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58833799-3fbe-4c25-a51e-412a95adfb6d None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:13.470448 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58833799-3fbe-4c25-a51e-412a95adfb6d None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:13.470772 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58833799-3fbe-4c25-a51e-412a95adfb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:13.574754 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1032/2064] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:13 2022] POST /identity/v3/users => generated 297 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:13.575828 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053681f-0412-4086-bbf8-9f5db8b1f49a None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:13.576115 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053681f-0412-4086-bbf8-9f5db8b1f49a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:13.576388 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053681f-0412-4086-bbf8-9f5db8b1f49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:13.617114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-58833799-3fbe-4c25-a51e-412a95adfb6d None None] MFA Rules not processed for user `b9ee38a03587412c93da307525e83851`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:13.620061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-58833799-3fbe-4c25-a51e-412a95adfb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:13.646421 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-f053681f-0412-4086-bbf8-9f5db8b1f49a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:13.648833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f053681f-0412-4086-bbf8-9f5db8b1f49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:13.687542 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1033/2065] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:13.687542 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053681f-0412-4086-bbf8-9f5db8b1f49a None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:13.687542 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f053681f-0412-4086-bbf8-9f5db8b1f49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:13.713288 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053681f-0412-4086-bbf8-9f5db8b1f49a None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:13.736130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350abb9-f3f5-47e1-a90d-bf6cff86c30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:13.736665 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350abb9-f3f5-47e1-a90d-bf6cff86c30d admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:13.736893 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350abb9-f3f5-47e1-a90d-bf6cff86c30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:13.737163 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350abb9-f3f5-47e1-a90d-bf6cff86c30d admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:13.737992 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350abb9-f3f5-47e1-a90d-bf6cff86c30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:13.740352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350abb9-f3f5-47e1-a90d-bf6cff86c30d admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:13.758699 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1034/2066] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:13.760366 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4a070-e92b-4d4e-b2df-17daa82783fa None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:13.760653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4a070-e92b-4d4e-b2df-17daa82783fa None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:13.760926 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4a070-e92b-4d4e-b2df-17daa82783fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:13.779013 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1033/2067] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:13.779013 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58833799-3fbe-4c25-a51e-412a95adfb6d None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:13.794653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58833799-3fbe-4c25-a51e-412a95adfb6d None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:13.798967 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-24a4a070-e92b-4d4e-b2df-17daa82783fa None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:13.802789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46483ff6-fcef-4f4f-9614-89ccdbca358e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:13.803801 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46483ff6-fcef-4f4f-9614-89ccdbca358e admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:13.804449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46483ff6-fcef-4f4f-9614-89ccdbca358e admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:13.804449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46483ff6-fcef-4f4f-9614-89ccdbca358e admin admin] PATH_INFO: `/v3/projects/61abdd6a3bc94127a26990e862891115/users/c909d4b2aa624230b47b8c3ec98af262/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:13.808902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-24a4a070-e92b-4d4e-b2df-17daa82783fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:13.819485 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1035/2068] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:13.823705 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4a070-e92b-4d4e-b2df-17daa82783fa None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:13.840742 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46483ff6-fcef-4f4f-9614-89ccdbca358e admin admin] RBAC: Authorizing `identity:create_grant(project_id=61abdd6a3bc94127a26990e862891115, user_id=c909d4b2aa624230b47b8c3ec98af262, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:13.842331 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4a070-e92b-4d4e-b2df-17daa82783fa None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:13.843772 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46483ff6-fcef-4f4f-9614-89ccdbca358e admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:13.847523 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c393c2-18ee-4e96-88d1-54977a5aa412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:13.848916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c393c2-18ee-4e96-88d1-54977a5aa412 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:13.848916 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c393c2-18ee-4e96-88d1-54977a5aa412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:13.849068 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c393c2-18ee-4e96-88d1-54977a5aa412 admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:13.849920 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c393c2-18ee-4e96-88d1-54977a5aa412 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:39:13.850360 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c393c2-18ee-4e96-88d1-54977a5aa412 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:13.852040 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c393c2-18ee-4e96-88d1-54977a5aa412 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:13.868406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1036/2069] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:39:13.868406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c393c2-18ee-4e96-88d1-54977a5aa412 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:13.868406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-96c393c2-18ee-4e96-88d1-54977a5aa412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:13.910438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1034/2070] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:13 2022] PUT /identity/v3/projects/61abdd6a3bc94127a26990e862891115/users/c909d4b2aa624230b47b8c3ec98af262/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:13.914254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46483ff6-fcef-4f4f-9614-89ccdbca358e admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:13.952007 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c393c2-18ee-4e96-88d1-54977a5aa412 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:13.983588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46483ff6-fcef-4f4f-9614-89ccdbca358e admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:13.988823 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74376c78-2dfe-49b8-8bc9-0920679b8f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:13.989489 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74376c78-2dfe-49b8-8bc9-0920679b8f5f admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:13.994501 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74376c78-2dfe-49b8-8bc9-0920679b8f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:13.994501 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74376c78-2dfe-49b8-8bc9-0920679b8f5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:13.994501 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74376c78-2dfe-49b8-8bc9-0920679b8f5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:13.994501 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74376c78-2dfe-49b8-8bc9-0920679b8f5f admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:14.024254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7402c-548e-4971-98ba-3fda41e03cb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:14.024980 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7402c-548e-4971-98ba-3fda41e03cb6 service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:14.025454 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7402c-548e-4971-98ba-3fda41e03cb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:14.025767 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7402c-548e-4971-98ba-3fda41e03cb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:14.086425 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7402c-548e-4971-98ba-3fda41e03cb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:14.088040 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7402c-548e-4971-98ba-3fda41e03cb6 service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:14.098246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1037/2071] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:14.099148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7402c-548e-4971-98ba-3fda41e03cb6 service nova] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:14.110434 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1035/2072] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:13 2022] POST /identity/v3/projects => generated 357 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:14.114088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7402c-548e-4971-98ba-3fda41e03cb6 service nova] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:14.114191 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74376c78-2dfe-49b8-8bc9-0920679b8f5f admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:14.182872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96837b61-9581-41ec-a341-9af2fbfb086c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:14.183547 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96837b61-9581-41ec-a341-9af2fbfb086c admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:14.184034 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96837b61-9581-41ec-a341-9af2fbfb086c admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:14.184459 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96837b61-9581-41ec-a341-9af2fbfb086c admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:14.185410 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96837b61-9581-41ec-a341-9af2fbfb086c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:14.191372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96837b61-9581-41ec-a341-9af2fbfb086c admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:14.199338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1038/2073] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:14.203679 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96837b61-9581-41ec-a341-9af2fbfb086c admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:14.218627 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74376c78-2dfe-49b8-8bc9-0920679b8f5f admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:14.223592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af502893-0a64-4d7b-94a8-d18fd6dc643e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:14.223840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96837b61-9581-41ec-a341-9af2fbfb086c admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:14.224459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af502893-0a64-4d7b-94a8-d18fd6dc643e admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:14.224938 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af502893-0a64-4d7b-94a8-d18fd6dc643e admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:14.225397 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af502893-0a64-4d7b-94a8-d18fd6dc643e admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:14.226661 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af502893-0a64-4d7b-94a8-d18fd6dc643e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:14.229099 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd7eb1f-e295-48ee-9905-48ecc5c81b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:14.229324 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af502893-0a64-4d7b-94a8-d18fd6dc643e admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:14.230426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7eb1f-e295-48ee-9905-48ecc5c81b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:14.230718 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7eb1f-e295-48ee-9905-48ecc5c81b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:14.230998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd7eb1f-e295-48ee-9905-48ecc5c81b0a admin admin] PATH_INFO: `/v3/projects/61abdd6a3bc94127a26990e862891115/users/c909d4b2aa624230b47b8c3ec98af262/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:14.233220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7eb1f-e295-48ee-9905-48ecc5c81b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=61abdd6a3bc94127a26990e862891115, user_id=c909d4b2aa624230b47b8c3ec98af262, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:14.236841 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd7eb1f-e295-48ee-9905-48ecc5c81b0a admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:14.249325 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1039/2074] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:14 2022] PUT /identity/v3/projects/61abdd6a3bc94127a26990e862891115/users/c909d4b2aa624230b47b8c3ec98af262/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:39:14.261404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a17199-3e7c-4198-8a9a-8e7ee5a2046f None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:14.262374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a17199-3e7c-4198-8a9a-8e7ee5a2046f None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:14.262730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a17199-3e7c-4198-8a9a-8e7ee5a2046f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:14.291782 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-67a17199-3e7c-4198-8a9a-8e7ee5a2046f None None] MFA Rules not processed for user `c909d4b2aa624230b47b8c3ec98af262`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:14.293066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-67a17199-3e7c-4198-8a9a-8e7ee5a2046f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:14.300048 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:14.343037 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1036/2075] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:14 2022] POST /identity/v3/users => generated 279 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:39:14.347195 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af502893-0a64-4d7b-94a8-d18fd6dc643e admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:14.360860 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af502893-0a64-4d7b-94a8-d18fd6dc643e admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:14.373137 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1040/2076] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:39:14.386663 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a17199-3e7c-4198-8a9a-8e7ee5a2046f None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:14.388217 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-67a17199-3e7c-4198-8a9a-8e7ee5a2046f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:14.433289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4816e-03ce-4e16-a79b-e1e020bbb746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:14.441815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4816e-03ce-4e16-a79b-e1e020bbb746 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:14.441815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4816e-03ce-4e16-a79b-e1e020bbb746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:14.441815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4816e-03ce-4e16-a79b-e1e020bbb746 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:14.441815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4816e-03ce-4e16-a79b-e1e020bbb746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:14.441815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4816e-03ce-4e16-a79b-e1e020bbb746 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:14.452680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1037/2077] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:14.453689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4816e-03ce-4e16-a79b-e1e020bbb746 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:14.461645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a17199-3e7c-4198-8a9a-8e7ee5a2046f None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:14.468049 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4816e-03ce-4e16-a79b-e1e020bbb746 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:14.468179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf1a3ee-b516-4b83-ae7e-a9df5efc79d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:14.468179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1a3ee-b516-4b83-ae7e-a9df5efc79d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:14.468179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1a3ee-b516-4b83-ae7e-a9df5efc79d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:14.468179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf1a3ee-b516-4b83-ae7e-a9df5efc79d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:14.469482 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-5bf1a3ee-b516-4b83-ae7e-a9df5efc79d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:14.470381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813677f-e990-459a-b28b-d84e5b3ab884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:14.471050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813677f-e990-459a-b28b-d84e5b3ab884 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:14.471334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813677f-e990-459a-b28b-d84e5b3ab884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:14.471611 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3813677f-e990-459a-b28b-d84e5b3ab884 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:14.472337 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813677f-e990-459a-b28b-d84e5b3ab884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:14.474204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3813677f-e990-459a-b28b-d84e5b3ab884 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:14.486430 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1038/2078] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:14.491198 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813677f-e990-459a-b28b-d84e5b3ab884 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:14.505262 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3813677f-e990-459a-b28b-d84e5b3ab884 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:14.510395 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2e610-9a06-4a4f-914f-0aabb9bb589d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:14.511422 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2e610-9a06-4a4f-914f-0aabb9bb589d admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:14.511773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2e610-9a06-4a4f-914f-0aabb9bb589d admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:14.512054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2e610-9a06-4a4f-914f-0aabb9bb589d admin admin] PATH_INFO: `/v3/projects/dabecd37390f4ae3bf01d3b0ee680599/users/278a688960f14a058593b78f49a43cfb/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:14.538198 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2e610-9a06-4a4f-914f-0aabb9bb589d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dabecd37390f4ae3bf01d3b0ee680599, user_id=278a688960f14a058593b78f49a43cfb, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:14.541304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2e610-9a06-4a4f-914f-0aabb9bb589d admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:14.556371 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1a3ee-b516-4b83-ae7e-a9df5efc79d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:14.557640 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf1a3ee-b516-4b83-ae7e-a9df5efc79d1 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:14.567735 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1041/2079] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:39:14.644602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1039/2080] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:14 2022] PUT /identity/v3/projects/dabecd37390f4ae3bf01d3b0ee680599/users/278a688960f14a058593b78f49a43cfb/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:39:14.657884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fc368-d97e-4ed4-868d-972ea681f4e0 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:14.657884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fc368-d97e-4ed4-868d-972ea681f4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:14.657884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3fc368-d97e-4ed4-868d-972ea681f4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:14.709268 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-fa3fc368-d97e-4ed4-868d-972ea681f4e0 None None] MFA Rules not processed for user `278a688960f14a058593b78f49a43cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:14.710562 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-fa3fc368-d97e-4ed4-868d-972ea681f4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:14.866127 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:14.900142 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1042/2081] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:14 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:39:15.526075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2e610-9a06-4a4f-914f-0aabb9bb589d admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:15.595146 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2e610-9a06-4a4f-914f-0aabb9bb589d admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:15.598737 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447ba5b-3c34-4573-9d99-6669d83097c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:15.599377 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447ba5b-3c34-4573-9d99-6669d83097c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:15.599745 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447ba5b-3c34-4573-9d99-6669d83097c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:15.600044 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447ba5b-3c34-4573-9d99-6669d83097c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:15.608899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447ba5b-3c34-4573-9d99-6669d83097c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:15.612395 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447ba5b-3c34-4573-9d99-6669d83097c4 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:15.621785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1040/2082] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:15 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:15.636253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fc368-d97e-4ed4-868d-972ea681f4e0 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:15.709029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3fc368-d97e-4ed4-868d-972ea681f4e0 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:15.723613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69cec1-4e64-4564-a251-57ea31bfd774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:15.723613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69cec1-4e64-4564-a251-57ea31bfd774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:15.723613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69cec1-4e64-4564-a251-57ea31bfd774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:15.723613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69cec1-4e64-4564-a251-57ea31bfd774 admin admin] PATH_INFO: `/v3/users/278a688960f14a058593b78f49a43cfb` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:15.724009 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69cec1-4e64-4564-a251-57ea31bfd774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=278a688960f14a058593b78f49a43cfb)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:15.724009 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69cec1-4e64-4564-a251-57ea31bfd774 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:15.929438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-bd69cec1-4e64-4564-a251-57ea31bfd774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '278a688960f14a058593b78f49a43cfb'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:15.941966 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-bd69cec1-4e64-4564-a251-57ea31bfd774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '278a688960f14a058593b78f49a43cfb'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:15.950223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-bd69cec1-4e64-4564-a251-57ea31bfd774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '278a688960f14a058593b78f49a43cfb'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:15.951032 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-bd69cec1-4e64-4564-a251-57ea31bfd774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '278a688960f14a058593b78f49a43cfb'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:15.951691 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-bd69cec1-4e64-4564-a251-57ea31bfd774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '278a688960f14a058593b78f49a43cfb'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:16.030196 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1043/2083] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:15 2022] DELETE /identity/v3/users/278a688960f14a058593b78f49a43cfb => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:16.031419 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175af401-47c0-4f1e-bc9c-3badef355048 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:16.031829 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175af401-47c0-4f1e-bc9c-3badef355048 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:16.032338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175af401-47c0-4f1e-bc9c-3badef355048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:16.050918 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-175af401-47c0-4f1e-bc9c-3badef355048 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:16.052472 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-175af401-47c0-4f1e-bc9c-3badef355048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:16.125495 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1041/2084] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:39:16.136174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69cec1-4e64-4564-a251-57ea31bfd774 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:16.137853 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-bd69cec1-4e64-4564-a251-57ea31bfd774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:16.211186 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69cec1-4e64-4564-a251-57ea31bfd774 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:16.218132 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427601f-2e7b-4c3f-a8da-5882d93ac68f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:16.219050 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427601f-2e7b-4c3f-a8da-5882d93ac68f service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:16.219542 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427601f-2e7b-4c3f-a8da-5882d93ac68f service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:16.219963 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427601f-2e7b-4c3f-a8da-5882d93ac68f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:16.232832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427601f-2e7b-4c3f-a8da-5882d93ac68f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:16.234629 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427601f-2e7b-4c3f-a8da-5882d93ac68f service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:16.248297 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1044/2085] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:16.265042 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:16.803128 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:16.925028 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175af401-47c0-4f1e-bc9c-3badef355048 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:16.926708 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-175af401-47c0-4f1e-bc9c-3badef355048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:16.950542 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175af401-47c0-4f1e-bc9c-3badef355048 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:16.957276 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1294df-97cf-4084-be99-b5525c24880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:16.958419 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1294df-97cf-4084-be99-b5525c24880c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:16.958706 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1294df-97cf-4084-be99-b5525c24880c admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:16.958992 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1294df-97cf-4084-be99-b5525c24880c admin admin] PATH_INFO: `/v3/projects/dabecd37390f4ae3bf01d3b0ee680599` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:16.967925 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1294df-97cf-4084-be99-b5525c24880c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dabecd37390f4ae3bf01d3b0ee680599)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:16.971091 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1294df-97cf-4084-be99-b5525c24880c admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:17.104455 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5e1294df-97cf-4084-be99-b5525c24880c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dabecd37390f4ae3bf01d3b0ee680599', 'request_id': 'req-5e1294df-97cf-4084-be99-b5525c24880c'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:17.116133 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5e1294df-97cf-4084-be99-b5525c24880c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dabecd37390f4ae3bf01d3b0ee680599', 'request_id': 'req-5e1294df-97cf-4084-be99-b5525c24880c'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:17.123083 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5e1294df-97cf-4084-be99-b5525c24880c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dabecd37390f4ae3bf01d3b0ee680599', 'request_id': 'req-5e1294df-97cf-4084-be99-b5525c24880c'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:17.179408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237210bf-ccf8-473b-993b-fe283b5a896b None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:17.180061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237210bf-ccf8-473b-993b-fe283b5a896b None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:17.180480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237210bf-ccf8-473b-993b-fe283b5a896b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:17.198711 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5e1294df-97cf-4084-be99-b5525c24880c admin admin] The token cache is being invalidate because project dabecd37390f4ae3bf01d3b0ee680599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:17.199099 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5e1294df-97cf-4084-be99-b5525c24880c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:17.199849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5e1294df-97cf-4084-be99-b5525c24880c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:17.201457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-237210bf-ccf8-473b-993b-fe283b5a896b None None] MFA Rules not processed for user `b9ee38a03587412c93da307525e83851`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:17.205461 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1042/2086] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:16 2022] DELETE /identity/v3/projects/dabecd37390f4ae3bf01d3b0ee680599 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:17.207471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-237210bf-ccf8-473b-993b-fe283b5a896b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:17.207697 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5836a-c4f5-42d2-b843-a5a13c2a7c49 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:17.207993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5836a-c4f5-42d2-b843-a5a13c2a7c49 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:17.208276 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5836a-c4f5-42d2-b843-a5a13c2a7c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:17.236109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-2bd5836a-c4f5-42d2-b843-a5a13c2a7c49 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:17.237356 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2bd5836a-c4f5-42d2-b843-a5a13c2a7c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:17.291480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1045/2087] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:17.345958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1043/2088] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:17.355885 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e9374-732e-427a-8b4c-e46046ebb3eb None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:17.356176 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e9374-732e-427a-8b4c-e46046ebb3eb None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:17.356443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e9374-732e-427a-8b4c-e46046ebb3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:17.384690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-fc7e9374-732e-427a-8b4c-e46046ebb3eb None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:17.386222 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-fc7e9374-732e-427a-8b4c-e46046ebb3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:17.407118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1046/2089] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:17.408252 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5836a-c4f5-42d2-b843-a5a13c2a7c49 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:17.421118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5836a-c4f5-42d2-b843-a5a13c2a7c49 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:17.427655 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff6e9e-121b-4647-a4c3-4afd1a03c7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:17.428517 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff6e9e-121b-4647-a4c3-4afd1a03c7ea admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:17.428805 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff6e9e-121b-4647-a4c3-4afd1a03c7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:17.429565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff6e9e-121b-4647-a4c3-4afd1a03c7ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:17.429871 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff6e9e-121b-4647-a4c3-4afd1a03c7ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:39:17.430330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff6e9e-121b-4647-a4c3-4afd1a03c7ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:17.432310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff6e9e-121b-4647-a4c3-4afd1a03c7ea admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:17.446327 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1044/2090] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:39:17.450262 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e9374-732e-427a-8b4c-e46046ebb3eb None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:17.463347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e9374-732e-427a-8b4c-e46046ebb3eb None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:17.475551 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60806c4a-8b9f-4b04-b5b0-d68ee74dd376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:17.476245 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60806c4a-8b9f-4b04-b5b0-d68ee74dd376 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:17.476534 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60806c4a-8b9f-4b04-b5b0-d68ee74dd376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:17.476818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60806c4a-8b9f-4b04-b5b0-d68ee74dd376 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:17.477720 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60806c4a-8b9f-4b04-b5b0-d68ee74dd376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:17.479919 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60806c4a-8b9f-4b04-b5b0-d68ee74dd376 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:17.617562 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1047/2091] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:17 2022] POST /identity/v3/projects => generated 373 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:39:17.621082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff6e9e-121b-4647-a4c3-4afd1a03c7ea admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:17.641099 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff6e9e-121b-4647-a4c3-4afd1a03c7ea admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:17.736585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f747c-57fc-4c05-bd7c-251cd5a05fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:17.737704 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f747c-57fc-4c05-bd7c-251cd5a05fce admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:17.738038 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f747c-57fc-4c05-bd7c-251cd5a05fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:17.738271 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f747c-57fc-4c05-bd7c-251cd5a05fce admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:17.739088 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f747c-57fc-4c05-bd7c-251cd5a05fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:17.741062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f747c-57fc-4c05-bd7c-251cd5a05fce admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:17.966024 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1045/2092] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:17 2022] POST /identity/v3/users => generated 287 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:17.969950 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60806c4a-8b9f-4b04-b5b0-d68ee74dd376 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:17.982885 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60806c4a-8b9f-4b04-b5b0-d68ee74dd376 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:17.989427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfd149-4850-4022-81b7-0808c252e893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:17.995048 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfd149-4850-4022-81b7-0808c252e893 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:17.995048 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfd149-4850-4022-81b7-0808c252e893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:17.995048 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfd149-4850-4022-81b7-0808c252e893 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:17.995048 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfd149-4850-4022-81b7-0808c252e893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:17.995048 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfd149-4850-4022-81b7-0808c252e893 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:18.004709 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1048/2093] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:18.008914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f747c-57fc-4c05-bd7c-251cd5a05fce admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:18.027883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f747c-57fc-4c05-bd7c-251cd5a05fce admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:18.032929 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf8a4d-5db9-40c2-889c-8f5635c974e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:18.033693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf8a4d-5db9-40c2-889c-8f5635c974e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:18.034002 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf8a4d-5db9-40c2-889c-8f5635c974e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:18.034254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf8a4d-5db9-40c2-889c-8f5635c974e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:18.035009 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf8a4d-5db9-40c2-889c-8f5635c974e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:18.037002 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf8a4d-5db9-40c2-889c-8f5635c974e7 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:18.048197 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1046/2094] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:18.052723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfd149-4850-4022-81b7-0808c252e893 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:18.065112 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfd149-4850-4022-81b7-0808c252e893 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:18.070243 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb87cc-bee7-478a-acf8-7ba01b688d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:18.077372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb87cc-bee7-478a-acf8-7ba01b688d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:18.077372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb87cc-bee7-478a-acf8-7ba01b688d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:18.077372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb87cc-bee7-478a-acf8-7ba01b688d1b admin admin] PATH_INFO: `/v3/projects/636ae32196f14dccb1c18d1d0cda567e/users/6ebfe9fcf3ec4e35b31af625cc1c292e/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:18.088598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb87cc-bee7-478a-acf8-7ba01b688d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=636ae32196f14dccb1c18d1d0cda567e, user_id=6ebfe9fcf3ec4e35b31af625cc1c292e, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:18.095104 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb87cc-bee7-478a-acf8-7ba01b688d1b admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:18.097436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:18.127865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:18.162555 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1049/2095] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:18 2022] PUT /identity/v3/projects/636ae32196f14dccb1c18d1d0cda567e/users/6ebfe9fcf3ec4e35b31af625cc1c292e/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:39:18.175793 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedbd9f-32bb-4141-8710-80a4eaf0e7dc None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:18.176284 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedbd9f-32bb-4141-8710-80a4eaf0e7dc None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:18.176723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedbd9f-32bb-4141-8710-80a4eaf0e7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:18.211150 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-4fedbd9f-32bb-4141-8710-80a4eaf0e7dc None None] MFA Rules not processed for user `6ebfe9fcf3ec4e35b31af625cc1c292e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:18.212607 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4fedbd9f-32bb-4141-8710-80a4eaf0e7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:18.284602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1047/2096] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:18.289236 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb87cc-bee7-478a-acf8-7ba01b688d1b admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:18.349820 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb87cc-bee7-478a-acf8-7ba01b688d1b admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:18.354793 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc727e7-7852-40af-af33-685a04e19d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:18.355445 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc727e7-7852-40af-af33-685a04e19d2a admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:18.355732 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc727e7-7852-40af-af33-685a04e19d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:18.356011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc727e7-7852-40af-af33-685a04e19d2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:18.356702 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc727e7-7852-40af-af33-685a04e19d2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:18.358686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc727e7-7852-40af-af33-685a04e19d2a admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:18.465986 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1050/2097] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:18 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:18.470779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedbd9f-32bb-4141-8710-80a4eaf0e7dc None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:18.481937 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedbd9f-32bb-4141-8710-80a4eaf0e7dc None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:18.539410 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756553c-36d0-44ef-9253-15dbf35f723a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:18.540075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756553c-36d0-44ef-9253-15dbf35f723a admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:18.540359 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756553c-36d0-44ef-9253-15dbf35f723a admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:18.540637 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756553c-36d0-44ef-9253-15dbf35f723a admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:18.541317 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756553c-36d0-44ef-9253-15dbf35f723a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:18.543296 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756553c-36d0-44ef-9253-15dbf35f723a admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:18.618924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1048/2098] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:18 2022] POST /identity/v3/users => generated 294 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:18.625544 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc727e7-7852-40af-af33-685a04e19d2a admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:18.635839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc727e7-7852-40af-af33-685a04e19d2a admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:18.641106 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab5f46-b604-4ca7-ac58-0807345ddd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:18.641815 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab5f46-b604-4ca7-ac58-0807345ddd50 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:18.642103 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab5f46-b604-4ca7-ac58-0807345ddd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:18.642382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab5f46-b604-4ca7-ac58-0807345ddd50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:18.643113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab5f46-b604-4ca7-ac58-0807345ddd50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:18.644712 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab5f46-b604-4ca7-ac58-0807345ddd50 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:18.657289 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1051/2099] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:18.664779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756553c-36d0-44ef-9253-15dbf35f723a admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:18.675253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756553c-36d0-44ef-9253-15dbf35f723a admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:18.679913 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542c04e-2edf-4e16-9844-6b318fdefa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:18.680784 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c04e-2edf-4e16-9844-6b318fdefa22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:18.681066 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c04e-2edf-4e16-9844-6b318fdefa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:18.681345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c04e-2edf-4e16-9844-6b318fdefa22 admin admin] PATH_INFO: `/v3/projects/c403ea9d7157447f826c1776b8d84a2c/users/69cd402d7174439cab9aa9dea6bed232/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:18.687390 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:18.699639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542c04e-2edf-4e16-9844-6b318fdefa22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c403ea9d7157447f826c1776b8d84a2c, user_id=69cd402d7174439cab9aa9dea6bed232, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:18.703197 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542c04e-2edf-4e16-9844-6b318fdefa22 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:18.826382 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1049/2100] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:18 2022] PUT /identity/v3/projects/c403ea9d7157447f826c1776b8d84a2c/users/69cd402d7174439cab9aa9dea6bed232/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:18.831031 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab5f46-b604-4ca7-ac58-0807345ddd50 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:18.841772 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab5f46-b604-4ca7-ac58-0807345ddd50 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:18.909378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ede6b-b89c-4e0c-987c-b0ab392644bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:18.910109 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ede6b-b89c-4e0c-987c-b0ab392644bd admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:18.910544 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ede6b-b89c-4e0c-987c-b0ab392644bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:18.910828 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ede6b-b89c-4e0c-987c-b0ab392644bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:18.911919 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ede6b-b89c-4e0c-987c-b0ab392644bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:18.913641 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ede6b-b89c-4e0c-987c-b0ab392644bd admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:18.925587 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1052/2101] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:18.929352 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542c04e-2edf-4e16-9844-6b318fdefa22 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:18.940584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542c04e-2edf-4e16-9844-6b318fdefa22 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:18.946772 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aca44f-8583-427f-90ac-af46e993bb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:18.947699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aca44f-8583-427f-90ac-af46e993bb1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:18.947983 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aca44f-8583-427f-90ac-af46e993bb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:18.948345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aca44f-8583-427f-90ac-af46e993bb1a admin admin] PATH_INFO: `/v3/projects/c403ea9d7157447f826c1776b8d84a2c/users/69cd402d7174439cab9aa9dea6bed232/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:18.951367 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aca44f-8583-427f-90ac-af46e993bb1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c403ea9d7157447f826c1776b8d84a2c, user_id=69cd402d7174439cab9aa9dea6bed232, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:18.954891 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aca44f-8583-427f-90ac-af46e993bb1a admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:18.967645 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1050/2102] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:18 2022] PUT /identity/v3/projects/c403ea9d7157447f826c1776b8d84a2c/users/69cd402d7174439cab9aa9dea6bed232/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:18.978946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedcdd5-572f-4936-b1c7-4c95e8b0389c None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:18.979506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedcdd5-572f-4936-b1c7-4c95e8b0389c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:18.979506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedcdd5-572f-4936-b1c7-4c95e8b0389c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:19.006845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-3cedcdd5-572f-4936-b1c7-4c95e8b0389c None None] MFA Rules not processed for user `69cd402d7174439cab9aa9dea6bed232`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:19.012870 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-3cedcdd5-572f-4936-b1c7-4c95e8b0389c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:19.082791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1053/2103] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:19.094055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aca44f-8583-427f-90ac-af46e993bb1a admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:19.095966 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b2aca44f-8583-427f-90ac-af46e993bb1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:19.161264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aca44f-8583-427f-90ac-af46e993bb1a admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:19.165264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1651e19-20d2-473b-9d68-736fdf250098 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:19.166279 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1651e19-20d2-473b-9d68-736fdf250098 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:19.166279 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1651e19-20d2-473b-9d68-736fdf250098 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:19.166485 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1651e19-20d2-473b-9d68-736fdf250098 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:19.238095 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1651e19-20d2-473b-9d68-736fdf250098 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:19.239794 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1651e19-20d2-473b-9d68-736fdf250098 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:19.250871 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1051/2104] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:19.276077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:20.425697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:20.627729 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:21.110473 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:21.799669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:22.525585 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:22.564899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedcdd5-572f-4936-b1c7-4c95e8b0389c None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:22.660355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedcdd5-572f-4936-b1c7-4c95e8b0389c None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:22.665426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8f4ce-3008-49f6-bcc2-eb602d98cff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:22.666648 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8f4ce-3008-49f6-bcc2-eb602d98cff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:22.667065 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8f4ce-3008-49f6-bcc2-eb602d98cff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:22.667350 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8f4ce-3008-49f6-bcc2-eb602d98cff6 admin admin] PATH_INFO: `/v3/users/6ebfe9fcf3ec4e35b31af625cc1c292e` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:22.668903 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8f4ce-3008-49f6-bcc2-eb602d98cff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ebfe9fcf3ec4e35b31af625cc1c292e)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:22.670877 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8f4ce-3008-49f6-bcc2-eb602d98cff6 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:22.936504 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-3cc8f4ce-3008-49f6-bcc2-eb602d98cff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ebfe9fcf3ec4e35b31af625cc1c292e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:22.949741 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-3cc8f4ce-3008-49f6-bcc2-eb602d98cff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ebfe9fcf3ec4e35b31af625cc1c292e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:22.956509 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-3cc8f4ce-3008-49f6-bcc2-eb602d98cff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ebfe9fcf3ec4e35b31af625cc1c292e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:22.957249 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-3cc8f4ce-3008-49f6-bcc2-eb602d98cff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ebfe9fcf3ec4e35b31af625cc1c292e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:22.957938 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-3cc8f4ce-3008-49f6-bcc2-eb602d98cff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ebfe9fcf3ec4e35b31af625cc1c292e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:23.124277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1054/2105] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:22 2022] DELETE /identity/v3/users/6ebfe9fcf3ec4e35b31af625cc1c292e => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:23.129192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e21d56-1dd8-490a-a84e-f263730b6784 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:23.129729 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e21d56-1dd8-490a-a84e-f263730b6784 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:23.130152 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e21d56-1dd8-490a-a84e-f263730b6784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:23.150638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-a4e21d56-1dd8-490a-a84e-f263730b6784 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:23.152151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-a4e21d56-1dd8-490a-a84e-f263730b6784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:23.236809 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1052/2106] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:23.237758 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8f4ce-3008-49f6-bcc2-eb602d98cff6 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:23.239439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-3cc8f4ce-3008-49f6-bcc2-eb602d98cff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:23.305811 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8f4ce-3008-49f6-bcc2-eb602d98cff6 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:23.309683 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88096e-bb5e-418a-adce-5fa8e1e85134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:23.310351 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88096e-bb5e-418a-adce-5fa8e1e85134 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:23.310633 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88096e-bb5e-418a-adce-5fa8e1e85134 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:23.310909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88096e-bb5e-418a-adce-5fa8e1e85134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:23.320526 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88096e-bb5e-418a-adce-5fa8e1e85134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:23.323945 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88096e-bb5e-418a-adce-5fa8e1e85134 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:23.331951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1055/2107] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:39:23.361347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:23.576373 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:23.693559 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e21d56-1dd8-490a-a84e-f263730b6784 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:23.695328 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-a4e21d56-1dd8-490a-a84e-f263730b6784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:23.775794 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e21d56-1dd8-490a-a84e-f263730b6784 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:23.779996 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a07119-0498-4275-b410-33a61569b766 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:23.780695 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a07119-0498-4275-b410-33a61569b766 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:23.780981 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a07119-0498-4275-b410-33a61569b766 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:23.781311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a07119-0498-4275-b410-33a61569b766 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:23.784078 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-13a07119-0498-4275-b410-33a61569b766 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:23.825666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88096e-bb5e-418a-adce-5fa8e1e85134 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:23.828782 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ef88096e-bb5e-418a-adce-5fa8e1e85134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:23.857119 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88096e-bb5e-418a-adce-5fa8e1e85134 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:23.881508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066c3b7-84ce-4265-beef-06251464c996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:23.882443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066c3b7-84ce-4265-beef-06251464c996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:23.885872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066c3b7-84ce-4265-beef-06251464c996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:23.885872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066c3b7-84ce-4265-beef-06251464c996 admin admin] PATH_INFO: `/v3/users/2401949a852d42a08da0eb0b8008efb1` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:23.885872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066c3b7-84ce-4265-beef-06251464c996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2401949a852d42a08da0eb0b8008efb1)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:23.886401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066c3b7-84ce-4265-beef-06251464c996 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:23.899221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a07119-0498-4275-b410-33a61569b766 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:23.901235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a07119-0498-4275-b410-33a61569b766 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:23.913627 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1053/2108] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:24.035505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a07119-0498-4275-b410-33a61569b766 service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:24.037068 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-13a07119-0498-4275-b410-33a61569b766 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:24.052535 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a07119-0498-4275-b410-33a61569b766 service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:24.063228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaa267-9593-47ef-86c6-a3957a73103a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:24.064325 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaa267-9593-47ef-86c6-a3957a73103a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:24.065146 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaa267-9593-47ef-86c6-a3957a73103a admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:24.065146 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaa267-9593-47ef-86c6-a3957a73103a admin admin] PATH_INFO: `/v3/projects/636ae32196f14dccb1c18d1d0cda567e` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:24.066467 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbaa267-9593-47ef-86c6-a3957a73103a admin admin] RBAC: Authorizing `identity:delete_project(project_id=636ae32196f14dccb1c18d1d0cda567e)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:24.068817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbaa267-9593-47ef-86c6-a3957a73103a admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:24.169092 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f066c3b7-84ce-4265-beef-06251464c996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2401949a852d42a08da0eb0b8008efb1'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:24.191258 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f066c3b7-84ce-4265-beef-06251464c996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2401949a852d42a08da0eb0b8008efb1'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:24.198905 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f066c3b7-84ce-4265-beef-06251464c996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2401949a852d42a08da0eb0b8008efb1'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:24.200153 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f066c3b7-84ce-4265-beef-06251464c996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2401949a852d42a08da0eb0b8008efb1'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:24.201105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f066c3b7-84ce-4265-beef-06251464c996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2401949a852d42a08da0eb0b8008efb1'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:24.212346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-fbbaa267-9593-47ef-86c6-a3957a73103a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '636ae32196f14dccb1c18d1d0cda567e', 'request_id': 'req-fbbaa267-9593-47ef-86c6-a3957a73103a'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:24.219217 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-fbbaa267-9593-47ef-86c6-a3957a73103a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '636ae32196f14dccb1c18d1d0cda567e', 'request_id': 'req-fbbaa267-9593-47ef-86c6-a3957a73103a'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:24.226928 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-fbbaa267-9593-47ef-86c6-a3957a73103a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '636ae32196f14dccb1c18d1d0cda567e', 'request_id': 'req-fbbaa267-9593-47ef-86c6-a3957a73103a'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:24.262070 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:24.324505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1056/2109] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:23 2022] DELETE /identity/v3/users/2401949a852d42a08da0eb0b8008efb1 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:24.329254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacad60-84a4-4eec-9fb1-b0d197e8f224 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:24.330480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacad60-84a4-4eec-9fb1-b0d197e8f224 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:24.330886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacad60-84a4-4eec-9fb1-b0d197e8f224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:24.348488 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-4cacad60-84a4-4eec-9fb1-b0d197e8f224 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:24.349776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-4cacad60-84a4-4eec-9fb1-b0d197e8f224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:24.396975 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-fbbaa267-9593-47ef-86c6-a3957a73103a admin admin] The token cache is being invalidate because project 636ae32196f14dccb1c18d1d0cda567e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:24.397707 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-fbbaa267-9593-47ef-86c6-a3957a73103a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:24.398454 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-fbbaa267-9593-47ef-86c6-a3957a73103a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:24.403949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1054/2110] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:24 2022] DELETE /identity/v3/projects/636ae32196f14dccb1c18d1d0cda567e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:24.404903 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaa267-9593-47ef-86c6-a3957a73103a admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:24.408292 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-fbbaa267-9593-47ef-86c6-a3957a73103a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:24.428369 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1057/2111] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:39:24.438771 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacad60-84a4-4eec-9fb1-b0d197e8f224 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:24.440058 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-4cacad60-84a4-4eec-9fb1-b0d197e8f224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:24.502243 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaa267-9593-47ef-86c6-a3957a73103a admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:24.507045 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3a99f-31bb-4cce-b13f-b60c6c0b238a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:24.508200 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3a99f-31bb-4cce-b13f-b60c6c0b238a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:24.508553 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3a99f-31bb-4cce-b13f-b60c6c0b238a admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:24.508900 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3a99f-31bb-4cce-b13f-b60c6c0b238a admin admin] PATH_INFO: `/v3/users/69cd402d7174439cab9aa9dea6bed232` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:24.510256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3a99f-31bb-4cce-b13f-b60c6c0b238a admin admin] RBAC: Authorizing `identity:delete_user(user_id=69cd402d7174439cab9aa9dea6bed232)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:24.511497 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacad60-84a4-4eec-9fb1-b0d197e8f224 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:24.512460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3a99f-31bb-4cce-b13f-b60c6c0b238a admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:24.515761 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543c4bf-cc4e-4bb2-bb45-6a7fe1a2b7c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:24.516415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543c4bf-cc4e-4bb2-bb45-6a7fe1a2b7c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:24.517304 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543c4bf-cc4e-4bb2-bb45-6a7fe1a2b7c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:24.517646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543c4bf-cc4e-4bb2-bb45-6a7fe1a2b7c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:24.527352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543c4bf-cc4e-4bb2-bb45-6a7fe1a2b7c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:24.528787 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543c4bf-cc4e-4bb2-bb45-6a7fe1a2b7c0 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:24.539592 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1058/2112] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:39:24.675970 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:24.716900 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-cbe3a99f-31bb-4cce-b13f-b60c6c0b238a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69cd402d7174439cab9aa9dea6bed232'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:24.734466 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-cbe3a99f-31bb-4cce-b13f-b60c6c0b238a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69cd402d7174439cab9aa9dea6bed232'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:24.740941 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-cbe3a99f-31bb-4cce-b13f-b60c6c0b238a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69cd402d7174439cab9aa9dea6bed232'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:24.741737 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-cbe3a99f-31bb-4cce-b13f-b60c6c0b238a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69cd402d7174439cab9aa9dea6bed232'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:24.742348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-cbe3a99f-31bb-4cce-b13f-b60c6c0b238a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69cd402d7174439cab9aa9dea6bed232'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:24.847194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1055/2113] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:24 2022] DELETE /identity/v3/users/69cd402d7174439cab9aa9dea6bed232 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:25.097506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543c4bf-cc4e-4bb2-bb45-6a7fe1a2b7c0 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:25.099386 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-3543c4bf-cc4e-4bb2-bb45-6a7fe1a2b7c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:25.122311 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543c4bf-cc4e-4bb2-bb45-6a7fe1a2b7c0 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:25.228462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188a4a3-a50c-4a76-981d-d8cf57cad3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:25.230219 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188a4a3-a50c-4a76-981d-d8cf57cad3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:25.230505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188a4a3-a50c-4a76-981d-d8cf57cad3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:25.230934 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188a4a3-a50c-4a76-981d-d8cf57cad3f1 admin admin] PATH_INFO: `/v3/projects/6d3e9b1572fe48febf6d187e26796d84` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:25.232388 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188a4a3-a50c-4a76-981d-d8cf57cad3f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d3e9b1572fe48febf6d187e26796d84)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:25.235089 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188a4a3-a50c-4a76-981d-d8cf57cad3f1 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:25.415032 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-c188a4a3-a50c-4a76-981d-d8cf57cad3f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d3e9b1572fe48febf6d187e26796d84', 'request_id': 'req-c188a4a3-a50c-4a76-981d-d8cf57cad3f1'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:25.422910 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-c188a4a3-a50c-4a76-981d-d8cf57cad3f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d3e9b1572fe48febf6d187e26796d84', 'request_id': 'req-c188a4a3-a50c-4a76-981d-d8cf57cad3f1'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:25.499120 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-c188a4a3-a50c-4a76-981d-d8cf57cad3f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d3e9b1572fe48febf6d187e26796d84', 'request_id': 'req-c188a4a3-a50c-4a76-981d-d8cf57cad3f1'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:25.513365 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-c188a4a3-a50c-4a76-981d-d8cf57cad3f1 admin admin] The token cache is being invalidate because project 6d3e9b1572fe48febf6d187e26796d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:25.513696 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-c188a4a3-a50c-4a76-981d-d8cf57cad3f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:25.514356 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-c188a4a3-a50c-4a76-981d-d8cf57cad3f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:25.516707 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1059/2114] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:25 2022] DELETE /identity/v3/projects/6d3e9b1572fe48febf6d187e26796d84 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:25.533507 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:25.706450 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3a99f-31bb-4cce-b13f-b60c6c0b238a admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:25.710814 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-cbe3a99f-31bb-4cce-b13f-b60c6c0b238a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:25.748172 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3a99f-31bb-4cce-b13f-b60c6c0b238a admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:25.900442 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a618f3-dd0e-4346-aa38-5254589d5a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:25.902060 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a618f3-dd0e-4346-aa38-5254589d5a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:25.902519 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a618f3-dd0e-4346-aa38-5254589d5a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:25.903195 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a618f3-dd0e-4346-aa38-5254589d5a8b admin admin] PATH_INFO: `/v3/projects/c403ea9d7157447f826c1776b8d84a2c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:25.916209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a618f3-dd0e-4346-aa38-5254589d5a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c403ea9d7157447f826c1776b8d84a2c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:25.918240 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a618f3-dd0e-4346-aa38-5254589d5a8b admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:26.093798 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-68a618f3-dd0e-4346-aa38-5254589d5a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c403ea9d7157447f826c1776b8d84a2c', 'request_id': 'req-68a618f3-dd0e-4346-aa38-5254589d5a8b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:26.105861 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-68a618f3-dd0e-4346-aa38-5254589d5a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c403ea9d7157447f826c1776b8d84a2c', 'request_id': 'req-68a618f3-dd0e-4346-aa38-5254589d5a8b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:26.112988 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-68a618f3-dd0e-4346-aa38-5254589d5a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c403ea9d7157447f826c1776b8d84a2c', 'request_id': 'req-68a618f3-dd0e-4346-aa38-5254589d5a8b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:26.203644 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-68a618f3-dd0e-4346-aa38-5254589d5a8b admin admin] The token cache is being invalidate because project c403ea9d7157447f826c1776b8d84a2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:26.203945 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-68a618f3-dd0e-4346-aa38-5254589d5a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:26.205011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-68a618f3-dd0e-4346-aa38-5254589d5a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:26.206619 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1056/2115] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:25 2022] DELETE /identity/v3/projects/c403ea9d7157447f826c1776b8d84a2c => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:26.211644 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9ceee-14e0-4432-9759-2cba75b3939a None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:26.212527 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9ceee-14e0-4432-9759-2cba75b3939a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:26.213060 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9ceee-14e0-4432-9759-2cba75b3939a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:26.233447 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-60d9ceee-14e0-4432-9759-2cba75b3939a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:26.235348 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-60d9ceee-14e0-4432-9759-2cba75b3939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:26.345712 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1060/2116] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:26.355336 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d0256-eb61-4229-847c-c95ba51344e0 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:26.356029 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d0256-eb61-4229-847c-c95ba51344e0 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:26.356444 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d0256-eb61-4229-847c-c95ba51344e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:26.379363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-db6d0256-eb61-4229-847c-c95ba51344e0 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:26.381093 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-db6d0256-eb61-4229-847c-c95ba51344e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:26.392425 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1057/2117] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:26.396374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9ceee-14e0-4432-9759-2cba75b3939a None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:26.406459 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9ceee-14e0-4432-9759-2cba75b3939a None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:26.411901 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717f69b-c0a6-4b49-aca0-df55549a12f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:26.412624 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717f69b-c0a6-4b49-aca0-df55549a12f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:26.412921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717f69b-c0a6-4b49-aca0-df55549a12f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:26.413214 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717f69b-c0a6-4b49-aca0-df55549a12f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:26.413987 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717f69b-c0a6-4b49-aca0-df55549a12f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:39:26.414297 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717f69b-c0a6-4b49-aca0-df55549a12f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:26.416044 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717f69b-c0a6-4b49-aca0-df55549a12f6 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:26.442293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1061/2118] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:39:26.447685 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d0256-eb61-4229-847c-c95ba51344e0 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:26.462304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d0256-eb61-4229-847c-c95ba51344e0 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:26.465945 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8119406-274f-454d-bbfa-ae1376056d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:26.466874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8119406-274f-454d-bbfa-ae1376056d77 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:26.467172 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8119406-274f-454d-bbfa-ae1376056d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:26.467449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8119406-274f-454d-bbfa-ae1376056d77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:26.468244 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8119406-274f-454d-bbfa-ae1376056d77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:26.471495 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8119406-274f-454d-bbfa-ae1376056d77 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:26.609310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1058/2119] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:26 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:26.613359 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717f69b-c0a6-4b49-aca0-df55549a12f6 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:26.623908 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717f69b-c0a6-4b49-aca0-df55549a12f6 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:26.690965 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28834d5-1626-4daf-94a4-1bb8f24a14fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:26.691634 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28834d5-1626-4daf-94a4-1bb8f24a14fb admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:26.691923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28834d5-1626-4daf-94a4-1bb8f24a14fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:26.692204 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28834d5-1626-4daf-94a4-1bb8f24a14fb admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:26.692957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28834d5-1626-4daf-94a4-1bb8f24a14fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:26.694944 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28834d5-1626-4daf-94a4-1bb8f24a14fb admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:26.793210 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:26.830973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1062/2120] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:26 2022] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:26.832408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8119406-274f-454d-bbfa-ae1376056d77 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:26.843817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8119406-274f-454d-bbfa-ae1376056d77 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:26.848519 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcbae0-6e87-4c4a-8424-ab58ecb35dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:26.849179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcbae0-6e87-4c4a-8424-ab58ecb35dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:26.854633 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcbae0-6e87-4c4a-8424-ab58ecb35dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:26.854633 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcbae0-6e87-4c4a-8424-ab58ecb35dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:26.854633 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcbae0-6e87-4c4a-8424-ab58ecb35dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:26.854633 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcbae0-6e87-4c4a-8424-ab58ecb35dd2 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:26.865437 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1059/2121] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:26.869711 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28834d5-1626-4daf-94a4-1bb8f24a14fb admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:26.879779 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28834d5-1626-4daf-94a4-1bb8f24a14fb admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:26.884397 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c1791-355f-411b-8aa8-75f19d1197c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:26.885094 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c1791-355f-411b-8aa8-75f19d1197c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:26.885384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c1791-355f-411b-8aa8-75f19d1197c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:26.885686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c1791-355f-411b-8aa8-75f19d1197c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:26.886446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c1791-355f-411b-8aa8-75f19d1197c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:26.888039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c1791-355f-411b-8aa8-75f19d1197c4 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:26.899838 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1063/2122] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:26.906712 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcbae0-6e87-4c4a-8424-ab58ecb35dd2 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:26.914876 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcbae0-6e87-4c4a-8424-ab58ecb35dd2 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:26.919782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369357c2-5a2a-4b08-9693-a0d22b85ea17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:26.920675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369357c2-5a2a-4b08-9693-a0d22b85ea17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:26.920961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369357c2-5a2a-4b08-9693-a0d22b85ea17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:26.921413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369357c2-5a2a-4b08-9693-a0d22b85ea17 admin admin] PATH_INFO: `/v3/projects/bd0e1bb7100c48cf9d39df3dbd915ef0/users/95d97d5284c442f2bcd533614d7c42a2/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:26.936821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369357c2-5a2a-4b08-9693-a0d22b85ea17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd0e1bb7100c48cf9d39df3dbd915ef0, user_id=95d97d5284c442f2bcd533614d7c42a2, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:26.939491 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369357c2-5a2a-4b08-9693-a0d22b85ea17 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:27.045838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1060/2123] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:26 2022] PUT /identity/v3/projects/bd0e1bb7100c48cf9d39df3dbd915ef0/users/95d97d5284c442f2bcd533614d7c42a2/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:27.061128 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c0fec-2c32-4946-b820-abd7f17aef98 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:27.061421 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c0fec-2c32-4946-b820-abd7f17aef98 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:27.061794 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c0fec-2c32-4946-b820-abd7f17aef98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:27.088295 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-f80c0fec-2c32-4946-b820-abd7f17aef98 None None] MFA Rules not processed for user `95d97d5284c442f2bcd533614d7c42a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:27.089593 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f80c0fec-2c32-4946-b820-abd7f17aef98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:27.153810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1064/2124] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:27.164950 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369357c2-5a2a-4b08-9693-a0d22b85ea17 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:27.166727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-369357c2-5a2a-4b08-9693-a0d22b85ea17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:27.231463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369357c2-5a2a-4b08-9693-a0d22b85ea17 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:27.235249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533af2e7-3648-4794-9e7e-c81ed99218fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:27.235885 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533af2e7-3648-4794-9e7e-c81ed99218fc service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:27.236166 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533af2e7-3648-4794-9e7e-c81ed99218fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:27.236440 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533af2e7-3648-4794-9e7e-c81ed99218fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:27.246611 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:27.248942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533af2e7-3648-4794-9e7e-c81ed99218fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:27.252263 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533af2e7-3648-4794-9e7e-c81ed99218fc service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:27.260487 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1061/2125] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:31.594460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3f5ff-157b-40dc-9f0b-3d71bccbde69 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:31.594930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3f5ff-157b-40dc-9f0b-3d71bccbde69 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:31.595034 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3f5ff-157b-40dc-9f0b-3d71bccbde69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:31.612729 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-2fb3f5ff-157b-40dc-9f0b-3d71bccbde69 None None] MFA Rules not processed for user `22750d44d710439da1d18a78419b1adf`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:31.613975 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-2fb3f5ff-157b-40dc-9f0b-3d71bccbde69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:31.622938 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:31.670354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1065/2126] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 08:39:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:31.713035 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533af2e7-3648-4794-9e7e-c81ed99218fc service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:31.714475 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-533af2e7-3648-4794-9e7e-c81ed99218fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:31.786668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533af2e7-3648-4794-9e7e-c81ed99218fc service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:31.792231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a27c23-3dfb-44cd-80ad-6e85bb3c2163 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e349e5dfcd74406b922d3d1ce0fa5ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:31.793037 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a27c23-3dfb-44cd-80ad-6e85bb3c2163 service swift] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:31.793332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a27c23-3dfb-44cd-80ad-6e85bb3c2163 service swift] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:31.793745 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a27c23-3dfb-44cd-80ad-6e85bb3c2163 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:31.802736 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a27c23-3dfb-44cd-80ad-6e85bb3c2163 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:31.804340 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a27c23-3dfb-44cd-80ad-6e85bb3c2163 service swift] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:31.813268 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1062/2127] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 08:39:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:39:33.109646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3f5ff-157b-40dc-9f0b-3d71bccbde69 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:33.110815 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-2fb3f5ff-157b-40dc-9f0b-3d71bccbde69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:33.205704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3f5ff-157b-40dc-9f0b-3d71bccbde69 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:33.211179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ba363-c53d-4aa3-861d-b1c8832734c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:33.212073 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ba363-c53d-4aa3-861d-b1c8832734c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:33.214392 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ba363-c53d-4aa3-861d-b1c8832734c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:33.214392 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ba363-c53d-4aa3-861d-b1c8832734c0 admin admin] PATH_INFO: `/v3/users/1b0d8d14160f4df3bca51efb3aa4ffa8` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:33.216545 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ba363-c53d-4aa3-861d-b1c8832734c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b0d8d14160f4df3bca51efb3aa4ffa8)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:33.218809 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ba363-c53d-4aa3-861d-b1c8832734c0 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:34.035620 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-da7ba363-c53d-4aa3-861d-b1c8832734c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b0d8d14160f4df3bca51efb3aa4ffa8'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:34.051743 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-da7ba363-c53d-4aa3-861d-b1c8832734c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b0d8d14160f4df3bca51efb3aa4ffa8'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:34.062143 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-da7ba363-c53d-4aa3-861d-b1c8832734c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b0d8d14160f4df3bca51efb3aa4ffa8'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:34.062724 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-da7ba363-c53d-4aa3-861d-b1c8832734c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b0d8d14160f4df3bca51efb3aa4ffa8'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:34.065030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-da7ba363-c53d-4aa3-861d-b1c8832734c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b0d8d14160f4df3bca51efb3aa4ffa8'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:34.227056 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1066/2128] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:33 2022] DELETE /identity/v3/users/1b0d8d14160f4df3bca51efb3aa4ffa8 => generated 0 bytes in 1119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:34.231649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d44789-0c52-4b9f-bd5f-4708c8b94b93 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:34.233318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d44789-0c52-4b9f-bd5f-4708c8b94b93 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:34.233933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d44789-0c52-4b9f-bd5f-4708c8b94b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:34.257803 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-60d44789-0c52-4b9f-bd5f-4708c8b94b93 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:34.262400 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-60d44789-0c52-4b9f-bd5f-4708c8b94b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:34.268020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:34.366969 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1063/2129] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:34.375285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ba363-c53d-4aa3-861d-b1c8832734c0 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:34.377346 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-da7ba363-c53d-4aa3-861d-b1c8832734c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:34.455381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:34.473223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ba363-c53d-4aa3-861d-b1c8832734c0 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:34.476946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3075f-f92d-45ca-9dde-55aaeb219637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:34.477843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3075f-f92d-45ca-9dde-55aaeb219637 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:34.478482 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3075f-f92d-45ca-9dde-55aaeb219637 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:34.478825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3075f-f92d-45ca-9dde-55aaeb219637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:34.488951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3075f-f92d-45ca-9dde-55aaeb219637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:34.494167 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae3075f-f92d-45ca-9dde-55aaeb219637 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:34.500928 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1067/2130] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:35.178469 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d44789-0c52-4b9f-bd5f-4708c8b94b93 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:35.180533 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-60d44789-0c52-4b9f-bd5f-4708c8b94b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:35.198953 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d44789-0c52-4b9f-bd5f-4708c8b94b93 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:35.271416 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418442c5-d7a7-4a17-891b-846e7ad9908f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:35.277823 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418442c5-d7a7-4a17-891b-846e7ad9908f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:35.277823 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418442c5-d7a7-4a17-891b-846e7ad9908f admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:35.277823 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418442c5-d7a7-4a17-891b-846e7ad9908f admin admin] PATH_INFO: `/v3/projects/c7d87eefe272456785461952e2c445cf` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:35.277823 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418442c5-d7a7-4a17-891b-846e7ad9908f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d87eefe272456785461952e2c445cf)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:35.277823 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418442c5-d7a7-4a17-891b-846e7ad9908f admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:35.467672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-418442c5-d7a7-4a17-891b-846e7ad9908f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d87eefe272456785461952e2c445cf', 'request_id': 'req-418442c5-d7a7-4a17-891b-846e7ad9908f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:35.476132 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-418442c5-d7a7-4a17-891b-846e7ad9908f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d87eefe272456785461952e2c445cf', 'request_id': 'req-418442c5-d7a7-4a17-891b-846e7ad9908f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:35.482280 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-418442c5-d7a7-4a17-891b-846e7ad9908f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d87eefe272456785461952e2c445cf', 'request_id': 'req-418442c5-d7a7-4a17-891b-846e7ad9908f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:35.569879 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-418442c5-d7a7-4a17-891b-846e7ad9908f admin admin] The token cache is being invalidate because project c7d87eefe272456785461952e2c445cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:35.571301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-418442c5-d7a7-4a17-891b-846e7ad9908f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:35.571600 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-418442c5-d7a7-4a17-891b-846e7ad9908f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:35.575843 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1064/2131] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:35 2022] DELETE /identity/v3/projects/c7d87eefe272456785461952e2c445cf => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:35.580857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3075f-f92d-45ca-9dde-55aaeb219637 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:35.594532 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3075f-f92d-45ca-9dde-55aaeb219637 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:35.675979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cae06-ee11-4416-a070-fde6a22d0c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:35.677287 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cae06-ee11-4416-a070-fde6a22d0c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:35.677617 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cae06-ee11-4416-a070-fde6a22d0c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:35.677902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cae06-ee11-4416-a070-fde6a22d0c54 admin admin] PATH_INFO: `/v3/users/c909d4b2aa624230b47b8c3ec98af262` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:35.679469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cae06-ee11-4416-a070-fde6a22d0c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c909d4b2aa624230b47b8c3ec98af262)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:35.681937 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cae06-ee11-4416-a070-fde6a22d0c54 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:35.954052 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-c46cae06-ee11-4416-a070-fde6a22d0c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c909d4b2aa624230b47b8c3ec98af262'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:35.997735 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-c46cae06-ee11-4416-a070-fde6a22d0c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c909d4b2aa624230b47b8c3ec98af262'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:36.011523 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-c46cae06-ee11-4416-a070-fde6a22d0c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c909d4b2aa624230b47b8c3ec98af262'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:36.017695 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-c46cae06-ee11-4416-a070-fde6a22d0c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c909d4b2aa624230b47b8c3ec98af262'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:36.017695 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-c46cae06-ee11-4416-a070-fde6a22d0c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c909d4b2aa624230b47b8c3ec98af262'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:36.154521 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1068/2132] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:35 2022] DELETE /identity/v3/users/c909d4b2aa624230b47b8c3ec98af262 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:39:36.970891 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418442c5-d7a7-4a17-891b-846e7ad9908f admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:36.973807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-418442c5-d7a7-4a17-891b-846e7ad9908f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:36.989052 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418442c5-d7a7-4a17-891b-846e7ad9908f admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:37.056285 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f9f41-8d9b-42e3-b9db-f16680040c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:37.057156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f9f41-8d9b-42e3-b9db-f16680040c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:37.057439 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f9f41-8d9b-42e3-b9db-f16680040c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:37.057749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f9f41-8d9b-42e3-b9db-f16680040c33 admin admin] PATH_INFO: `/v3/projects/61abdd6a3bc94127a26990e862891115` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:37.058976 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f9f41-8d9b-42e3-b9db-f16680040c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61abdd6a3bc94127a26990e862891115)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:37.060938 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f9f41-8d9b-42e3-b9db-f16680040c33 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:37.165430 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:37.176928 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-476f9f41-8d9b-42e3-b9db-f16680040c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61abdd6a3bc94127a26990e862891115', 'request_id': 'req-476f9f41-8d9b-42e3-b9db-f16680040c33'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:37.184395 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-476f9f41-8d9b-42e3-b9db-f16680040c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61abdd6a3bc94127a26990e862891115', 'request_id': 'req-476f9f41-8d9b-42e3-b9db-f16680040c33'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:37.192599 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-476f9f41-8d9b-42e3-b9db-f16680040c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61abdd6a3bc94127a26990e862891115', 'request_id': 'req-476f9f41-8d9b-42e3-b9db-f16680040c33'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:37.299319 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-476f9f41-8d9b-42e3-b9db-f16680040c33 admin admin] The token cache is being invalidate because project 61abdd6a3bc94127a26990e862891115 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:37.305668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-476f9f41-8d9b-42e3-b9db-f16680040c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:37.305668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-476f9f41-8d9b-42e3-b9db-f16680040c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:37.305668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1065/2133] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:36 2022] DELETE /identity/v3/projects/61abdd6a3bc94127a26990e862891115 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:37.308210 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755e0a3-88ed-4272-95d7-79c812cf4c05 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:37.308703 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755e0a3-88ed-4272-95d7-79c812cf4c05 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:37.308827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755e0a3-88ed-4272-95d7-79c812cf4c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:37.330839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-c755e0a3-88ed-4272-95d7-79c812cf4c05 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:37.332539 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c755e0a3-88ed-4272-95d7-79c812cf4c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:37.394636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:37.403212 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1069/2134] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:39:37.412748 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7a690-e68d-44cb-b2b0-e2f612882811 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:37.412748 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7a690-e68d-44cb-b2b0-e2f612882811 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:37.413336 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7a690-e68d-44cb-b2b0-e2f612882811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:37.435386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-15f7a690-e68d-44cb-b2b0-e2f612882811 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:37.436811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-15f7a690-e68d-44cb-b2b0-e2f612882811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:37.489510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755e0a3-88ed-4272-95d7-79c812cf4c05 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:37.492167 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1066/2135] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:37.511300 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755e0a3-88ed-4272-95d7-79c812cf4c05 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:37.522512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dafe39-068a-4368-a132-4203c04f08f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:37.522682 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dafe39-068a-4368-a132-4203c04f08f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:37.523165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dafe39-068a-4368-a132-4203c04f08f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:37.524496 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dafe39-068a-4368-a132-4203c04f08f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:37.526252 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dafe39-068a-4368-a132-4203c04f08f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:39:37.527456 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dafe39-068a-4368-a132-4203c04f08f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:37.532202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dafe39-068a-4368-a132-4203c04f08f5 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:37.557458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1070/2136] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:39:37.564014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7a690-e68d-44cb-b2b0-e2f612882811 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:37.574286 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7a690-e68d-44cb-b2b0-e2f612882811 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:37.584203 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb0b20-cc59-4635-b7ec-71371d0dbe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:37.584945 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb0b20-cc59-4635-b7ec-71371d0dbe88 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:37.585228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb0b20-cc59-4635-b7ec-71371d0dbe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:37.585509 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb0b20-cc59-4635-b7ec-71371d0dbe88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:37.586300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb0b20-cc59-4635-b7ec-71371d0dbe88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:37.588353 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb0b20-cc59-4635-b7ec-71371d0dbe88 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:37.688935 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1067/2137] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:37 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:39:37.690272 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dafe39-068a-4368-a132-4203c04f08f5 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:37.707691 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dafe39-068a-4368-a132-4203c04f08f5 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:37.859927 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4180188-1028-4952-bfd5-55fdde4ca8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:37.860839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4180188-1028-4952-bfd5-55fdde4ca8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:37.861766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4180188-1028-4952-bfd5-55fdde4ca8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:37.862114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4180188-1028-4952-bfd5-55fdde4ca8d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:37.863614 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4180188-1028-4952-bfd5-55fdde4ca8d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:37.866821 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4180188-1028-4952-bfd5-55fdde4ca8d7 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:37.970723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1071/2138] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:37 2022] POST /identity/v3/users => generated 288 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:37.973177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb0b20-cc59-4635-b7ec-71371d0dbe88 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:37.988804 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb0b20-cc59-4635-b7ec-71371d0dbe88 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:37.995030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c04b9-1bc2-41b2-b6ff-2a9a53a269f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:37.995853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c04b9-1bc2-41b2-b6ff-2a9a53a269f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:37.996138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c04b9-1bc2-41b2-b6ff-2a9a53a269f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:37.997076 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c04b9-1bc2-41b2-b6ff-2a9a53a269f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:37.997961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c04b9-1bc2-41b2-b6ff-2a9a53a269f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:38.004562 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335c04b9-1bc2-41b2-b6ff-2a9a53a269f5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:38.012574 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1068/2139] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:38.016850 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4180188-1028-4952-bfd5-55fdde4ca8d7 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:38.031184 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4180188-1028-4952-bfd5-55fdde4ca8d7 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:38.062659 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b3d87-0fff-44db-b0d8-ddfd22e6aa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:38.063982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b3d87-0fff-44db-b0d8-ddfd22e6aa03 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:38.064279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b3d87-0fff-44db-b0d8-ddfd22e6aa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:38.064564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b3d87-0fff-44db-b0d8-ddfd22e6aa03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:38.065377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b3d87-0fff-44db-b0d8-ddfd22e6aa03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:38.071569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b3d87-0fff-44db-b0d8-ddfd22e6aa03 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:38.091761 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1072/2140] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:39:38.096341 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c04b9-1bc2-41b2-b6ff-2a9a53a269f5 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:38.111213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c04b9-1bc2-41b2-b6ff-2a9a53a269f5 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:38.122889 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139d63d-3478-4560-9415-98c2991cf969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:38.124384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139d63d-3478-4560-9415-98c2991cf969 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:38.125598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139d63d-3478-4560-9415-98c2991cf969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:38.126330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139d63d-3478-4560-9415-98c2991cf969 admin admin] PATH_INFO: `/v3/projects/82b7cc58c51146e3af562b2c68ec139b/users/d88e836115c947079bebf89f3a9518b3/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:38.150365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139d63d-3478-4560-9415-98c2991cf969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b7cc58c51146e3af562b2c68ec139b, user_id=d88e836115c947079bebf89f3a9518b3, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:38.157647 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139d63d-3478-4560-9415-98c2991cf969 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:38.227838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1069/2141] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:38 2022] PUT /identity/v3/projects/82b7cc58c51146e3af562b2c68ec139b/users/d88e836115c947079bebf89f3a9518b3/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:38.245235 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593a5e3-b6ef-4550-a6b7-e45a36db1d9c None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:38.245568 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593a5e3-b6ef-4550-a6b7-e45a36db1d9c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:38.245779 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593a5e3-b6ef-4550-a6b7-e45a36db1d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:38.307679 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-f593a5e3-b6ef-4550-a6b7-e45a36db1d9c None None] MFA Rules not processed for user `d88e836115c947079bebf89f3a9518b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:38.312132 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f593a5e3-b6ef-4550-a6b7-e45a36db1d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:38.445605 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1073/2142] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:38.446394 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139d63d-3478-4560-9415-98c2991cf969 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:38.557392 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139d63d-3478-4560-9415-98c2991cf969 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:38.565623 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf23d0-7888-4c6a-a635-4b517577c9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:38.566480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf23d0-7888-4c6a-a635-4b517577c9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:38.566851 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf23d0-7888-4c6a-a635-4b517577c9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:38.567234 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf23d0-7888-4c6a-a635-4b517577c9d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:38.568190 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf23d0-7888-4c6a-a635-4b517577c9d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:38.570291 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf23d0-7888-4c6a-a635-4b517577c9d5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:38.675300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1070/2143] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:38 2022] POST /identity/v3/projects => generated 377 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:38.678674 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593a5e3-b6ef-4550-a6b7-e45a36db1d9c None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:38.696371 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593a5e3-b6ef-4550-a6b7-e45a36db1d9c None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:38.831101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:38.838411 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bf32b-1caa-4f15-a235-0c33175aa847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:38.839255 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bf32b-1caa-4f15-a235-0c33175aa847 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:38.839569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bf32b-1caa-4f15-a235-0c33175aa847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:38.839849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bf32b-1caa-4f15-a235-0c33175aa847 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:38.840547 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657bf32b-1caa-4f15-a235-0c33175aa847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:38.843103 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657bf32b-1caa-4f15-a235-0c33175aa847 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:38.933411 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1074/2144] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:38 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:38.937667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf23d0-7888-4c6a-a635-4b517577c9d5 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:38.948599 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf23d0-7888-4c6a-a635-4b517577c9d5 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:38.956922 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671faf2-9b7c-4fa7-bb30-0dbe5cc0b6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:38.957829 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671faf2-9b7c-4fa7-bb30-0dbe5cc0b6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:38.958298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671faf2-9b7c-4fa7-bb30-0dbe5cc0b6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:38.958765 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671faf2-9b7c-4fa7-bb30-0dbe5cc0b6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:38.960185 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671faf2-9b7c-4fa7-bb30-0dbe5cc0b6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:38.962608 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671faf2-9b7c-4fa7-bb30-0dbe5cc0b6a2 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:38.994398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1071/2145] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:38.998134 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bf32b-1caa-4f15-a235-0c33175aa847 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:39.009352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bf32b-1caa-4f15-a235-0c33175aa847 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:39.015215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeeb06e-4f12-46df-a987-6ceab02c2b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:39.015898 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeb06e-4f12-46df-a987-6ceab02c2b88 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:39.016322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeb06e-4f12-46df-a987-6ceab02c2b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:39.016696 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeeb06e-4f12-46df-a987-6ceab02c2b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:39.017492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeeb06e-4f12-46df-a987-6ceab02c2b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:39.019251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeeb06e-4f12-46df-a987-6ceab02c2b88 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:39.046206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1075/2146] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:39.050223 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671faf2-9b7c-4fa7-bb30-0dbe5cc0b6a2 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:39.070462 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671faf2-9b7c-4fa7-bb30-0dbe5cc0b6a2 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:39.094225 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282e723-71b3-4069-a487-b50c80933bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:39.095400 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282e723-71b3-4069-a487-b50c80933bad admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:39.095788 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282e723-71b3-4069-a487-b50c80933bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:39.096130 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282e723-71b3-4069-a487-b50c80933bad admin admin] PATH_INFO: `/v3/projects/6ca4110c0d56417391eb7abf17da49e5/users/b652f71f2b86489e994130aac6bbf663/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:39.151151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282e723-71b3-4069-a487-b50c80933bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca4110c0d56417391eb7abf17da49e5, user_id=b652f71f2b86489e994130aac6bbf663, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:39.151151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282e723-71b3-4069-a487-b50c80933bad admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:39.341557 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1072/2147] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:39 2022] PUT /identity/v3/projects/6ca4110c0d56417391eb7abf17da49e5/users/b652f71f2b86489e994130aac6bbf663/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:39.409497 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87263c-5b45-4880-a4a5-aaef0c420797 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:39.409497 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87263c-5b45-4880-a4a5-aaef0c420797 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:39.409497 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87263c-5b45-4880-a4a5-aaef0c420797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:39.444821 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-6f87263c-5b45-4880-a4a5-aaef0c420797 None None] MFA Rules not processed for user `b652f71f2b86489e994130aac6bbf663`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:39.446105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-6f87263c-5b45-4880-a4a5-aaef0c420797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:39.525067 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1076/2148] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:39.529285 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282e723-71b3-4069-a487-b50c80933bad admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:39.543312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:39.628399 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282e723-71b3-4069-a487-b50c80933bad admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:39.633620 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ed175-5bb2-48c7-b7cb-3dfa00d561e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:39.634200 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ed175-5bb2-48c7-b7cb-3dfa00d561e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:39.634502 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ed175-5bb2-48c7-b7cb-3dfa00d561e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:39.634746 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ed175-5bb2-48c7-b7cb-3dfa00d561e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:39.635466 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ed175-5bb2-48c7-b7cb-3dfa00d561e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:39.637477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ed175-5bb2-48c7-b7cb-3dfa00d561e2 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:39.724300 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87263c-5b45-4880-a4a5-aaef0c420797 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:39.730789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1073/2149] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:39 2022] POST /identity/v3/projects => generated 375 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:39.738306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87263c-5b45-4880-a4a5-aaef0c420797 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:39.837367 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d2641-d2a5-4682-aaa8-ff0915a7536e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:39.838106 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d2641-d2a5-4682-aaa8-ff0915a7536e admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:39.838387 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d2641-d2a5-4682-aaa8-ff0915a7536e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:39.838663 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d2641-d2a5-4682-aaa8-ff0915a7536e admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:39.839369 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d2641-d2a5-4682-aaa8-ff0915a7536e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:39.849955 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d2641-d2a5-4682-aaa8-ff0915a7536e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:39.950449 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1077/2150] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:39 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:39.956667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ed175-5bb2-48c7-b7cb-3dfa00d561e2 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:39.981861 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ed175-5bb2-48c7-b7cb-3dfa00d561e2 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:40.026426 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569f71e-aecc-47fe-bc6e-82d007828212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:40.028538 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569f71e-aecc-47fe-bc6e-82d007828212 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:40.028538 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569f71e-aecc-47fe-bc6e-82d007828212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:40.028949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569f71e-aecc-47fe-bc6e-82d007828212 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:40.030575 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569f71e-aecc-47fe-bc6e-82d007828212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:40.032403 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569f71e-aecc-47fe-bc6e-82d007828212 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:40.061852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1074/2151] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:40.062060 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d2641-d2a5-4682-aaa8-ff0915a7536e admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:40.074953 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d2641-d2a5-4682-aaa8-ff0915a7536e admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:40.083902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a42253-c698-4889-86ad-ecd03c866f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:40.085991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a42253-c698-4889-86ad-ecd03c866f61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:40.086508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a42253-c698-4889-86ad-ecd03c866f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:40.087229 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a42253-c698-4889-86ad-ecd03c866f61 admin admin] PATH_INFO: `/v3/projects/1a41196b7d454adebaa68992d727315a/users/98bdc473d2ae48899d16b0ed1b663886/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:40.109252 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a42253-c698-4889-86ad-ecd03c866f61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a41196b7d454adebaa68992d727315a, user_id=98bdc473d2ae48899d16b0ed1b663886, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:40.112383 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a42253-c698-4889-86ad-ecd03c866f61 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:40.230687 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1078/2152] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:40 2022] PUT /identity/v3/projects/1a41196b7d454adebaa68992d727315a/users/98bdc473d2ae48899d16b0ed1b663886/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:39:40.245386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569f71e-aecc-47fe-bc6e-82d007828212 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:40.268988 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569f71e-aecc-47fe-bc6e-82d007828212 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:40.411908 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f606dbb-7fa3-4b88-934f-b684a1481fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:40.413083 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f606dbb-7fa3-4b88-934f-b684a1481fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:40.413744 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f606dbb-7fa3-4b88-934f-b684a1481fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:40.414253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f606dbb-7fa3-4b88-934f-b684a1481fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:40.415216 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f606dbb-7fa3-4b88-934f-b684a1481fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:40.417062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f606dbb-7fa3-4b88-934f-b684a1481fd5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:40.439079 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1075/2153] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:40.439221 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a42253-c698-4889-86ad-ecd03c866f61 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:40.451012 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a42253-c698-4889-86ad-ecd03c866f61 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:40.458074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd1b59-2e3b-4854-8352-3dc3c7c290a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:40.459123 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd1b59-2e3b-4854-8352-3dc3c7c290a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:40.459506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd1b59-2e3b-4854-8352-3dc3c7c290a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:40.459907 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd1b59-2e3b-4854-8352-3dc3c7c290a5 admin admin] PATH_INFO: `/v3/projects/1a41196b7d454adebaa68992d727315a/users/98bdc473d2ae48899d16b0ed1b663886/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:40.462752 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd1b59-2e3b-4854-8352-3dc3c7c290a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a41196b7d454adebaa68992d727315a, user_id=98bdc473d2ae48899d16b0ed1b663886, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:40.466660 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd1b59-2e3b-4854-8352-3dc3c7c290a5 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:40.481428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1079/2154] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:40 2022] PUT /identity/v3/projects/1a41196b7d454adebaa68992d727315a/users/98bdc473d2ae48899d16b0ed1b663886/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:40.492502 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1b729-e3b7-4058-a480-4bf191e17e77 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:40.493027 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1b729-e3b7-4058-a480-4bf191e17e77 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:40.493752 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1b729-e3b7-4058-a480-4bf191e17e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:40.537782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-74c1b729-e3b7-4058-a480-4bf191e17e77 None None] MFA Rules not processed for user `98bdc473d2ae48899d16b0ed1b663886`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:40.539084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-74c1b729-e3b7-4058-a480-4bf191e17e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:40.654454 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1076/2155] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:40 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:40.661494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd1b59-2e3b-4854-8352-3dc3c7c290a5 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:40.663546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b2dd1b59-2e3b-4854-8352-3dc3c7c290a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:40.702631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:40.759006 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd1b59-2e3b-4854-8352-3dc3c7c290a5 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:40.771132 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25d961-e4eb-44c3-acd3-f12c7d008cfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:40.771831 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25d961-e4eb-44c3-acd3-f12c7d008cfd service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:40.771831 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25d961-e4eb-44c3-acd3-f12c7d008cfd service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:40.772073 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25d961-e4eb-44c3-acd3-f12c7d008cfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:40.847986 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25d961-e4eb-44c3-acd3-f12c7d008cfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:40.850048 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25d961-e4eb-44c3-acd3-f12c7d008cfd service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:40.865680 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1080/2156] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:43.170019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1b729-e3b7-4058-a480-4bf191e17e77 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:43.184993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1b729-e3b7-4058-a480-4bf191e17e77 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:43.194928 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b03372-5e0c-4203-8067-197a9a72fea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:43.195956 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b03372-5e0c-4203-8067-197a9a72fea4 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:43.196614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b03372-5e0c-4203-8067-197a9a72fea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:43.197118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b03372-5e0c-4203-8067-197a9a72fea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:43.204660 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:43.294370 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b03372-5e0c-4203-8067-197a9a72fea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:43.294370 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b03372-5e0c-4203-8067-197a9a72fea4 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:43.308730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1077/2157] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:44.985049 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25d961-e4eb-44c3-acd3-f12c7d008cfd service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:44.986638 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-6a25d961-e4eb-44c3-acd3-f12c7d008cfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:45.066533 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25d961-e4eb-44c3-acd3-f12c7d008cfd service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:45.071546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fa4eb-4419-4003-bf06-bb1f92426f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:45.072579 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fa4eb-4419-4003-bf06-bb1f92426f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:45.072867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fa4eb-4419-4003-bf06-bb1f92426f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:45.073145 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fa4eb-4419-4003-bf06-bb1f92426f92 admin admin] PATH_INFO: `/v3/users/95d97d5284c442f2bcd533614d7c42a2` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:45.074399 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fa4eb-4419-4003-bf06-bb1f92426f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95d97d5284c442f2bcd533614d7c42a2)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:45.076343 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fa4eb-4419-4003-bf06-bb1f92426f92 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:45.195128 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b03372-5e0c-4203-8067-197a9a72fea4 service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:45.206038 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b03372-5e0c-4203-8067-197a9a72fea4 service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:45.210143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7fb61-2149-482c-8fc7-4dae226ee7d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:45.210928 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7fb61-2149-482c-8fc7-4dae226ee7d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:45.211156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7fb61-2149-482c-8fc7-4dae226ee7d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:45.211456 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7fb61-2149-482c-8fc7-4dae226ee7d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:45.222046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7fb61-2149-482c-8fc7-4dae226ee7d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:45.227370 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7fb61-2149-482c-8fc7-4dae226ee7d4 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:45.237157 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1078/2158] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:39:45.272854 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-b58fa4eb-4419-4003-bf06-bb1f92426f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95d97d5284c442f2bcd533614d7c42a2'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:45.297174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-b58fa4eb-4419-4003-bf06-bb1f92426f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95d97d5284c442f2bcd533614d7c42a2'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:45.303198 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:45.305367 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-b58fa4eb-4419-4003-bf06-bb1f92426f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95d97d5284c442f2bcd533614d7c42a2'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:45.306213 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-b58fa4eb-4419-4003-bf06-bb1f92426f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95d97d5284c442f2bcd533614d7c42a2'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:45.306833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-b58fa4eb-4419-4003-bf06-bb1f92426f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95d97d5284c442f2bcd533614d7c42a2'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:45.387375 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1081/2159] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:44 2022] DELETE /identity/v3/users/95d97d5284c442f2bcd533614d7c42a2 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:45.391843 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47df02-12a0-46b4-a7e3-2f4913e4ca6b None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:45.392135 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47df02-12a0-46b4-a7e3-2f4913e4ca6b None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:45.392414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47df02-12a0-46b4-a7e3-2f4913e4ca6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:45.412199 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-1a47df02-12a0-46b4-a7e3-2f4913e4ca6b None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:45.416391 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-1a47df02-12a0-46b4-a7e3-2f4913e4ca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:45.516329 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1079/2160] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:45.526442 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fa4eb-4419-4003-bf06-bb1f92426f92 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:45.529018 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b58fa4eb-4419-4003-bf06-bb1f92426f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:45.618403 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fa4eb-4419-4003-bf06-bb1f92426f92 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:45.622064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34663b-e64d-4124-be13-339de46381a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:45.622744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34663b-e64d-4124-be13-339de46381a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:45.623157 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34663b-e64d-4124-be13-339de46381a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:45.623938 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34663b-e64d-4124-be13-339de46381a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:45.634283 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34663b-e64d-4124-be13-339de46381a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:45.635979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34663b-e64d-4124-be13-339de46381a3 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:45.647678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1082/2161] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:46.132220 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47df02-12a0-46b4-a7e3-2f4913e4ca6b None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:46.133681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-1a47df02-12a0-46b4-a7e3-2f4913e4ca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:46.155577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47df02-12a0-46b4-a7e3-2f4913e4ca6b None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:46.161113 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306012f-6caa-443d-a23a-b342cd7c193b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:46.162055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306012f-6caa-443d-a23a-b342cd7c193b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:46.162336 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306012f-6caa-443d-a23a-b342cd7c193b admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:46.162607 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306012f-6caa-443d-a23a-b342cd7c193b admin admin] PATH_INFO: `/v3/projects/bd0e1bb7100c48cf9d39df3dbd915ef0` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:46.164239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306012f-6caa-443d-a23a-b342cd7c193b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd0e1bb7100c48cf9d39df3dbd915ef0)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:46.166335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306012f-6caa-443d-a23a-b342cd7c193b admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:46.341402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6306012f-6caa-443d-a23a-b342cd7c193b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd0e1bb7100c48cf9d39df3dbd915ef0', 'request_id': 'req-6306012f-6caa-443d-a23a-b342cd7c193b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:46.349834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6306012f-6caa-443d-a23a-b342cd7c193b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd0e1bb7100c48cf9d39df3dbd915ef0', 'request_id': 'req-6306012f-6caa-443d-a23a-b342cd7c193b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:46.356859 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6306012f-6caa-443d-a23a-b342cd7c193b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd0e1bb7100c48cf9d39df3dbd915ef0', 'request_id': 'req-6306012f-6caa-443d-a23a-b342cd7c193b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:46.466855 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6306012f-6caa-443d-a23a-b342cd7c193b admin admin] The token cache is being invalidate because project bd0e1bb7100c48cf9d39df3dbd915ef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:46.467258 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6306012f-6caa-443d-a23a-b342cd7c193b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:46.467910 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6306012f-6caa-443d-a23a-b342cd7c193b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:46.469475 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1080/2162] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:46 2022] DELETE /identity/v3/projects/bd0e1bb7100c48cf9d39df3dbd915ef0 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:46.475582 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421d1a8-c816-4e19-aa71-a1114deafeab None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:46.476077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421d1a8-c816-4e19-aa71-a1114deafeab None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:46.476337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421d1a8-c816-4e19-aa71-a1114deafeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:46.503810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-e421d1a8-c816-4e19-aa71-a1114deafeab None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:46.505403 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e421d1a8-c816-4e19-aa71-a1114deafeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:46.626084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1083/2163] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:46.631741 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abadb9-7f2b-4fd1-ad83-d25cd7b6c945 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:46.632305 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abadb9-7f2b-4fd1-ad83-d25cd7b6c945 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:46.632785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abadb9-7f2b-4fd1-ad83-d25cd7b6c945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:46.667068 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-79abadb9-7f2b-4fd1-ad83-d25cd7b6c945 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:46.668719 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-79abadb9-7f2b-4fd1-ad83-d25cd7b6c945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:46.679957 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1081/2164] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:46.684228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421d1a8-c816-4e19-aa71-a1114deafeab None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:46.718438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421d1a8-c816-4e19-aa71-a1114deafeab None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:46.724212 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1c4a4-83fd-4642-8fa4-aef7b9c46d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:46.725202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1c4a4-83fd-4642-8fa4-aef7b9c46d75 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:46.725687 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1c4a4-83fd-4642-8fa4-aef7b9c46d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:46.725966 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1c4a4-83fd-4642-8fa4-aef7b9c46d75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:46.726717 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1c4a4-83fd-4642-8fa4-aef7b9c46d75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:39:46.727024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1c4a4-83fd-4642-8fa4-aef7b9c46d75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:46.729002 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1c4a4-83fd-4642-8fa4-aef7b9c46d75 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:46.747320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1084/2165] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:39:46.749119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abadb9-7f2b-4fd1-ad83-d25cd7b6c945 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:46.765791 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abadb9-7f2b-4fd1-ad83-d25cd7b6c945 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:46.778809 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46063bbb-1fa7-40fa-b461-a8fd11e7926e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:46.779685 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46063bbb-1fa7-40fa-b461-a8fd11e7926e admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:46.780173 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46063bbb-1fa7-40fa-b461-a8fd11e7926e admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:46.780545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46063bbb-1fa7-40fa-b461-a8fd11e7926e admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:46.781368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46063bbb-1fa7-40fa-b461-a8fd11e7926e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:46.783483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46063bbb-1fa7-40fa-b461-a8fd11e7926e admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:46.788920 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:46.895607 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1082/2166] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:46 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:46.897010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1c4a4-83fd-4642-8fa4-aef7b9c46d75 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:46.925613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1c4a4-83fd-4642-8fa4-aef7b9c46d75 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:47.016275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd022a7e-9653-422c-a670-f24f97211817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:47.016965 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd022a7e-9653-422c-a670-f24f97211817 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:47.017250 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd022a7e-9653-422c-a670-f24f97211817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:47.017544 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd022a7e-9653-422c-a670-f24f97211817 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:47.022380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd022a7e-9653-422c-a670-f24f97211817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:47.027958 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd022a7e-9653-422c-a670-f24f97211817 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:47.156852 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1085/2167] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:46 2022] POST /identity/v3/users => generated 287 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:47.162306 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46063bbb-1fa7-40fa-b461-a8fd11e7926e admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:47.181345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46063bbb-1fa7-40fa-b461-a8fd11e7926e admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:47.187714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff5310-7050-460f-8065-ee5dc15120d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:47.188393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff5310-7050-460f-8065-ee5dc15120d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:47.188675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff5310-7050-460f-8065-ee5dc15120d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:47.188953 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff5310-7050-460f-8065-ee5dc15120d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:47.189728 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff5310-7050-460f-8065-ee5dc15120d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:47.191505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff5310-7050-460f-8065-ee5dc15120d1 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:47.223219 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1083/2168] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:47.224969 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd022a7e-9653-422c-a670-f24f97211817 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:47.253390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd022a7e-9653-422c-a670-f24f97211817 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:47.278733 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d23e6-e2c5-4ebe-a92b-e5c3bc4111ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:47.279628 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d23e6-e2c5-4ebe-a92b-e5c3bc4111ba admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:47.279915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d23e6-e2c5-4ebe-a92b-e5c3bc4111ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:47.280484 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d23e6-e2c5-4ebe-a92b-e5c3bc4111ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:47.280817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d23e6-e2c5-4ebe-a92b-e5c3bc4111ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:47.282475 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d23e6-e2c5-4ebe-a92b-e5c3bc4111ba admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:47.285469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:47.296855 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1086/2169] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:47.300816 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff5310-7050-460f-8065-ee5dc15120d1 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:47.315896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff5310-7050-460f-8065-ee5dc15120d1 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:47.344325 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49205a9-e24c-4f07-8bd3-26b3b90ccc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:47.345282 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49205a9-e24c-4f07-8bd3-26b3b90ccc89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:47.345589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49205a9-e24c-4f07-8bd3-26b3b90ccc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:47.349604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49205a9-e24c-4f07-8bd3-26b3b90ccc89 admin admin] PATH_INFO: `/v3/projects/342d4f7018c146e7be9d6a8b7fe0b2c4/users/d2e1ce292ea34b0c938f540b655d04aa/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:47.381504 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49205a9-e24c-4f07-8bd3-26b3b90ccc89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=342d4f7018c146e7be9d6a8b7fe0b2c4, user_id=d2e1ce292ea34b0c938f540b655d04aa, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:47.384188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49205a9-e24c-4f07-8bd3-26b3b90ccc89 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:47.480076 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1084/2170] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:47 2022] PUT /identity/v3/projects/342d4f7018c146e7be9d6a8b7fe0b2c4/users/d2e1ce292ea34b0c938f540b655d04aa/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:39:47.493667 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0b217-8850-40a1-ae7d-a7d01846175a None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:47.494276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0b217-8850-40a1-ae7d-a7d01846175a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:47.494591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa0b217-8850-40a1-ae7d-a7d01846175a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:47.524309 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-8fa0b217-8850-40a1-ae7d-a7d01846175a None None] MFA Rules not processed for user `d2e1ce292ea34b0c938f540b655d04aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:47.525677 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-8fa0b217-8850-40a1-ae7d-a7d01846175a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:47.611965 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1087/2171] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:47.619792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49205a9-e24c-4f07-8bd3-26b3b90ccc89 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:47.622129 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e49205a9-e24c-4f07-8bd3-26b3b90ccc89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:47.692288 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49205a9-e24c-4f07-8bd3-26b3b90ccc89 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:47.696418 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315de26-91d1-4c0f-a32e-4631d76b2b5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:47.697069 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315de26-91d1-4c0f-a32e-4631d76b2b5f service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:47.697352 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315de26-91d1-4c0f-a32e-4631d76b2b5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:47.697661 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315de26-91d1-4c0f-a32e-4631d76b2b5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:47.707343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4315de26-91d1-4c0f-a32e-4631d76b2b5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:47.710624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4315de26-91d1-4c0f-a32e-4631d76b2b5f service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:47.720396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1085/2172] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:49.620484 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df9162-476a-4bd9-8755-cf70e3677382 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:49.621032 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df9162-476a-4bd9-8755-cf70e3677382 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:49.621127 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df9162-476a-4bd9-8755-cf70e3677382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:49.649467 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-92df9162-476a-4bd9-8755-cf70e3677382 None None] MFA Rules not processed for user `d2e1ce292ea34b0c938f540b655d04aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:49.650869 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-92df9162-476a-4bd9-8755-cf70e3677382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:49.659225 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1088/2173] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:50.416490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315de26-91d1-4c0f-a32e-4631d76b2b5f service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:50.418062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4315de26-91d1-4c0f-a32e-4631d76b2b5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:50.500376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315de26-91d1-4c0f-a32e-4631d76b2b5f service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:50.513200 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c470cd-95d5-4745-8006-c14d547b4997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:50.513200 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c470cd-95d5-4745-8006-c14d547b4997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:50.513200 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c470cd-95d5-4745-8006-c14d547b4997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:50.513200 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c470cd-95d5-4745-8006-c14d547b4997 admin admin] PATH_INFO: `/v3/users/d88e836115c947079bebf89f3a9518b3` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:50.513954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c470cd-95d5-4745-8006-c14d547b4997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d88e836115c947079bebf89f3a9518b3)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:50.513954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c470cd-95d5-4745-8006-c14d547b4997 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:50.755778 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-96c470cd-95d5-4745-8006-c14d547b4997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd88e836115c947079bebf89f3a9518b3'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:50.778650 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:50.788996 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-96c470cd-95d5-4745-8006-c14d547b4997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd88e836115c947079bebf89f3a9518b3'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:50.801174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-96c470cd-95d5-4745-8006-c14d547b4997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd88e836115c947079bebf89f3a9518b3'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:50.801174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-96c470cd-95d5-4745-8006-c14d547b4997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd88e836115c947079bebf89f3a9518b3'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:50.801174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-96c470cd-95d5-4745-8006-c14d547b4997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd88e836115c947079bebf89f3a9518b3'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:50.946252 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1086/2174] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:50 2022] DELETE /identity/v3/users/d88e836115c947079bebf89f3a9518b3 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:50.950990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c64160-7fa5-4cca-8815-7192e6f50fc5 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:50.951600 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c64160-7fa5-4cca-8815-7192e6f50fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:50.951600 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c64160-7fa5-4cca-8815-7192e6f50fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:50.983133 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-d4c64160-7fa5-4cca-8815-7192e6f50fc5 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:50.984624 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-d4c64160-7fa5-4cca-8815-7192e6f50fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:51.061885 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1089/2175] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:51.072486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c470cd-95d5-4745-8006-c14d547b4997 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:51.074226 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-96c470cd-95d5-4745-8006-c14d547b4997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:51.176433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c470cd-95d5-4745-8006-c14d547b4997 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:51.180043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5f65e-4abf-4f7d-bda3-c69dd9f99c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:51.180781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5f65e-4abf-4f7d-bda3-c69dd9f99c0e service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:51.181056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5f65e-4abf-4f7d-bda3-c69dd9f99c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:51.181324 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5f65e-4abf-4f7d-bda3-c69dd9f99c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:51.192071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5f65e-4abf-4f7d-bda3-c69dd9f99c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:51.194544 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5f65e-4abf-4f7d-bda3-c69dd9f99c0e service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:51.205474 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1087/2176] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:51.850552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c64160-7fa5-4cca-8815-7192e6f50fc5 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:51.853819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-d4c64160-7fa5-4cca-8815-7192e6f50fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:51.914590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c64160-7fa5-4cca-8815-7192e6f50fc5 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:51.930117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97acebff-4db9-4e26-b87e-f8df43045c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:51.932211 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acebff-4db9-4e26-b87e-f8df43045c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:51.932505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acebff-4db9-4e26-b87e-f8df43045c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:51.933557 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97acebff-4db9-4e26-b87e-f8df43045c7e admin admin] PATH_INFO: `/v3/projects/82b7cc58c51146e3af562b2c68ec139b` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:51.938729 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acebff-4db9-4e26-b87e-f8df43045c7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=82b7cc58c51146e3af562b2c68ec139b)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:51.943167 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97acebff-4db9-4e26-b87e-f8df43045c7e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:52.142622 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-97acebff-4db9-4e26-b87e-f8df43045c7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82b7cc58c51146e3af562b2c68ec139b', 'request_id': 'req-97acebff-4db9-4e26-b87e-f8df43045c7e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.150468 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-97acebff-4db9-4e26-b87e-f8df43045c7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82b7cc58c51146e3af562b2c68ec139b', 'request_id': 'req-97acebff-4db9-4e26-b87e-f8df43045c7e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.240788 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-97acebff-4db9-4e26-b87e-f8df43045c7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82b7cc58c51146e3af562b2c68ec139b', 'request_id': 'req-97acebff-4db9-4e26-b87e-f8df43045c7e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.255110 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-97acebff-4db9-4e26-b87e-f8df43045c7e admin admin] The token cache is being invalidate because project 82b7cc58c51146e3af562b2c68ec139b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:52.255639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-97acebff-4db9-4e26-b87e-f8df43045c7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.256495 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-97acebff-4db9-4e26-b87e-f8df43045c7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.258632 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1090/2177] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:51 2022] DELETE /identity/v3/projects/82b7cc58c51146e3af562b2c68ec139b => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:52.262611 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5f65e-4abf-4f7d-bda3-c69dd9f99c0e service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:52.273464 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5f65e-4abf-4f7d-bda3-c69dd9f99c0e service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:52.343956 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326bec1-c12e-4fa7-8074-eaddabb7d89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:52.345102 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326bec1-c12e-4fa7-8074-eaddabb7d89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:52.345438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326bec1-c12e-4fa7-8074-eaddabb7d89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:52.345715 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326bec1-c12e-4fa7-8074-eaddabb7d89b admin admin] PATH_INFO: `/v3/users/b652f71f2b86489e994130aac6bbf663` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:52.347021 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326bec1-c12e-4fa7-8074-eaddabb7d89b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b652f71f2b86489e994130aac6bbf663)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:52.348977 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326bec1-c12e-4fa7-8074-eaddabb7d89b admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:52.609938 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2326bec1-c12e-4fa7-8074-eaddabb7d89b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b652f71f2b86489e994130aac6bbf663'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.630227 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2326bec1-c12e-4fa7-8074-eaddabb7d89b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b652f71f2b86489e994130aac6bbf663'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.633150 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ace84-ab42-442e-bebf-98010517db6f None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:52.633518 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ace84-ab42-442e-bebf-98010517db6f None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:52.633974 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ace84-ab42-442e-bebf-98010517db6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:52.639568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2326bec1-c12e-4fa7-8074-eaddabb7d89b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b652f71f2b86489e994130aac6bbf663'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.640477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2326bec1-c12e-4fa7-8074-eaddabb7d89b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b652f71f2b86489e994130aac6bbf663'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.647683 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2326bec1-c12e-4fa7-8074-eaddabb7d89b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b652f71f2b86489e994130aac6bbf663'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:52.648241 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:52.648433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:52.657662 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-3a5ace84-ab42-442e-bebf-98010517db6f None None] MFA Rules not processed for user `fb4b22bc322c419bab3445f7dfb186fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:52.658896 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-3a5ace84-ab42-442e-bebf-98010517db6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:52.714140 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1091/2178] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:39:52.759928 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1088/2179] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:52 2022] DELETE /identity/v3/users/b652f71f2b86489e994130aac6bbf663 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:53.411925 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ace84-ab42-442e-bebf-98010517db6f None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:53.414341 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-3a5ace84-ab42-442e-bebf-98010517db6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:53.430285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ace84-ab42-442e-bebf-98010517db6f None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:53.491163 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d19c6c-a6d1-48bb-873d-3227744ac00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:53.492056 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d19c6c-a6d1-48bb-873d-3227744ac00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:53.492342 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d19c6c-a6d1-48bb-873d-3227744ac00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:53.492615 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d19c6c-a6d1-48bb-873d-3227744ac00b admin admin] PATH_INFO: `/v3/projects/6ca4110c0d56417391eb7abf17da49e5` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:53.493897 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d19c6c-a6d1-48bb-873d-3227744ac00b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ca4110c0d56417391eb7abf17da49e5)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:53.495924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d19c6c-a6d1-48bb-873d-3227744ac00b admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:53.635840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-41d19c6c-a6d1-48bb-873d-3227744ac00b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ca4110c0d56417391eb7abf17da49e5', 'request_id': 'req-41d19c6c-a6d1-48bb-873d-3227744ac00b'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:53.643533 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-41d19c6c-a6d1-48bb-873d-3227744ac00b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ca4110c0d56417391eb7abf17da49e5', 'request_id': 'req-41d19c6c-a6d1-48bb-873d-3227744ac00b'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:53.712462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-41d19c6c-a6d1-48bb-873d-3227744ac00b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ca4110c0d56417391eb7abf17da49e5', 'request_id': 'req-41d19c6c-a6d1-48bb-873d-3227744ac00b'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:53.724766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-41d19c6c-a6d1-48bb-873d-3227744ac00b admin admin] The token cache is being invalidate because project 6ca4110c0d56417391eb7abf17da49e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:53.725059 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-41d19c6c-a6d1-48bb-873d-3227744ac00b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:53.726048 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-41d19c6c-a6d1-48bb-873d-3227744ac00b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:53.727726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2a416-e09c-4e2c-9aa8-58b0edd90de6 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:53.728750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2a416-e09c-4e2c-9aa8-58b0edd90de6 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:53.728750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2a416-e09c-4e2c-9aa8-58b0edd90de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:53.731749 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1092/2180] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:53 2022] DELETE /identity/v3/projects/6ca4110c0d56417391eb7abf17da49e5 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:53.735714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d19c6c-a6d1-48bb-873d-3227744ac00b admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:53.737236 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-41d19c6c-a6d1-48bb-873d-3227744ac00b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:53.762419 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-ebe2a416-e09c-4e2c-9aa8-58b0edd90de6 None None] MFA Rules not processed for user `22750d44d710439da1d18a78419b1adf`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:53.763646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ebe2a416-e09c-4e2c-9aa8-58b0edd90de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:53.800025 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:53.824420 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d19c6c-a6d1-48bb-873d-3227744ac00b admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:53.825111 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1089/2181] 10.222.0.57 () {58 vars in 967 bytes} [Thu Jul 21 08:39:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:39:53.829285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8fd57-4343-4c14-b23b-3f4e7e9d0fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:53.830198 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8fd57-4343-4c14-b23b-3f4e7e9d0fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:53.834972 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8fd57-4343-4c14-b23b-3f4e7e9d0fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:53.834972 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8fd57-4343-4c14-b23b-3f4e7e9d0fb5 admin admin] PATH_INFO: `/v3/users/98bdc473d2ae48899d16b0ed1b663886` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:53.834972 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8fd57-4343-4c14-b23b-3f4e7e9d0fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98bdc473d2ae48899d16b0ed1b663886)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:53.834972 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d8fd57-4343-4c14-b23b-3f4e7e9d0fb5 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:53.840494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2a416-e09c-4e2c-9aa8-58b0edd90de6 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:53.842575 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ebe2a416-e09c-4e2c-9aa8-58b0edd90de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:53.921988 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2a416-e09c-4e2c-9aa8-58b0edd90de6 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:53.926730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb235e29-5656-46fe-8ce8-c5ce7a7fe71a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e349e5dfcd74406b922d3d1ce0fa5ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:53.927384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb235e29-5656-46fe-8ce8-c5ce7a7fe71a service swift] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:53.927668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb235e29-5656-46fe-8ce8-c5ce7a7fe71a service swift] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:53.927999 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb235e29-5656-46fe-8ce8-c5ce7a7fe71a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:53.936591 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb235e29-5656-46fe-8ce8-c5ce7a7fe71a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:53.938248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb235e29-5656-46fe-8ce8-c5ce7a7fe71a service swift] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:53.946906 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1090/2182] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 08:39:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 08:39:54.093418 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-b8d8fd57-4343-4c14-b23b-3f4e7e9d0fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98bdc473d2ae48899d16b0ed1b663886'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:54.109402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-b8d8fd57-4343-4c14-b23b-3f4e7e9d0fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98bdc473d2ae48899d16b0ed1b663886'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:54.120775 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-b8d8fd57-4343-4c14-b23b-3f4e7e9d0fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98bdc473d2ae48899d16b0ed1b663886'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:54.121519 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-b8d8fd57-4343-4c14-b23b-3f4e7e9d0fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98bdc473d2ae48899d16b0ed1b663886'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:54.122162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-b8d8fd57-4343-4c14-b23b-3f4e7e9d0fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98bdc473d2ae48899d16b0ed1b663886'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:54.235425 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1093/2183] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:53 2022] DELETE /identity/v3/users/98bdc473d2ae48899d16b0ed1b663886 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:39:54.730247 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb235e29-5656-46fe-8ce8-c5ce7a7fe71a service swift] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:54.771553 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb235e29-5656-46fe-8ce8-c5ce7a7fe71a service swift] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:54.833068 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3ea9b-2683-4969-8e20-306530c23cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:54.833970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3ea9b-2683-4969-8e20-306530c23cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:54.834254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3ea9b-2683-4969-8e20-306530c23cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:54.834533 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3ea9b-2683-4969-8e20-306530c23cfd admin admin] PATH_INFO: `/v3/projects/1a41196b7d454adebaa68992d727315a` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:54.835712 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3ea9b-2683-4969-8e20-306530c23cfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a41196b7d454adebaa68992d727315a)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:54.837655 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3ea9b-2683-4969-8e20-306530c23cfd admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:54.978519 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:54.991597 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a0e3ea9b-2683-4969-8e20-306530c23cfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a41196b7d454adebaa68992d727315a', 'request_id': 'req-a0e3ea9b-2683-4969-8e20-306530c23cfd'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:54.998030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a0e3ea9b-2683-4969-8e20-306530c23cfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a41196b7d454adebaa68992d727315a', 'request_id': 'req-a0e3ea9b-2683-4969-8e20-306530c23cfd'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:55.004253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a0e3ea9b-2683-4969-8e20-306530c23cfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a41196b7d454adebaa68992d727315a', 'request_id': 'req-a0e3ea9b-2683-4969-8e20-306530c23cfd'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:55.075977 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a0e3ea9b-2683-4969-8e20-306530c23cfd admin admin] The token cache is being invalidate because project 1a41196b7d454adebaa68992d727315a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:39:55.076358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a0e3ea9b-2683-4969-8e20-306530c23cfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:55.077108 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a0e3ea9b-2683-4969-8e20-306530c23cfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:55.079643 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1091/2184] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:39:54 2022] DELETE /identity/v3/projects/1a41196b7d454adebaa68992d727315a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:55.086696 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12dbb0-67b4-44d8-b7d7-4ddcaa4770f2 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:55.087151 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12dbb0-67b4-44d8-b7d7-4ddcaa4770f2 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:55.087267 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b12dbb0-67b4-44d8-b7d7-4ddcaa4770f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:55.109726 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-3b12dbb0-67b4-44d8-b7d7-4ddcaa4770f2 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:55.111120 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-3b12dbb0-67b4-44d8-b7d7-4ddcaa4770f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:55.181251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1094/2185] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:55.189544 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1743f77-e3f5-4a1b-9135-628a7157c54c None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:55.190038 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1743f77-e3f5-4a1b-9135-628a7157c54c None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:55.190415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1743f77-e3f5-4a1b-9135-628a7157c54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:55.211632 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-b1743f77-e3f5-4a1b-9135-628a7157c54c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:55.212848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b1743f77-e3f5-4a1b-9135-628a7157c54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:55.221585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1092/2186] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:55.225787 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12dbb0-67b4-44d8-b7d7-4ddcaa4770f2 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:55.236883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b12dbb0-67b4-44d8-b7d7-4ddcaa4770f2 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:55.241910 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad79cd-27dd-4f14-88dc-d633a5a55456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:55.242648 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad79cd-27dd-4f14-88dc-d633a5a55456 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:55.242935 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad79cd-27dd-4f14-88dc-d633a5a55456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:55.243242 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad79cd-27dd-4f14-88dc-d633a5a55456 admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:55.244004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad79cd-27dd-4f14-88dc-d633a5a55456 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:39:55.244270 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad79cd-27dd-4f14-88dc-d633a5a55456 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:55.245940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad79cd-27dd-4f14-88dc-d633a5a55456 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:55.259574 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1095/2187] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:39:55.262107 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e214e6-6b46-4f6b-a472-5775c7f7e26d None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:55.262448 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e214e6-6b46-4f6b-a472-5775c7f7e26d None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:55.262912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e214e6-6b46-4f6b-a472-5775c7f7e26d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:55.264248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad79cd-27dd-4f14-88dc-d633a5a55456 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:55.275451 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad79cd-27dd-4f14-88dc-d633a5a55456 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:55.281240 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31644e72-60f2-4749-b678-682c3f2ef525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:55.281920 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31644e72-60f2-4749-b678-682c3f2ef525 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:55.282205 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31644e72-60f2-4749-b678-682c3f2ef525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:55.282479 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31644e72-60f2-4749-b678-682c3f2ef525 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:55.283042 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-73e214e6-6b46-4f6b-a472-5775c7f7e26d None None] MFA Rules not processed for user `22750d44d710439da1d18a78419b1adf`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:55.283168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31644e72-60f2-4749-b678-682c3f2ef525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:55.284222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-73e214e6-6b46-4f6b-a472-5775c7f7e26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:55.285073 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31644e72-60f2-4749-b678-682c3f2ef525 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:55.346514 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1093/2188] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 08:39:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:39:55.359865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e214e6-6b46-4f6b-a472-5775c7f7e26d None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:55.361291 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-73e214e6-6b46-4f6b-a472-5775c7f7e26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:55.409361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1096/2189] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:39:55 2022] POST /identity/v3/projects => generated 397 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:39:55.413177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31644e72-60f2-4749-b678-682c3f2ef525 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:55.433410 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e214e6-6b46-4f6b-a472-5775c7f7e26d None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:55.447278 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:55.495857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31644e72-60f2-4749-b678-682c3f2ef525 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:55.503558 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddedad0-2ee2-4c41-90ff-e1223a50ff38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:55.504210 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddedad0-2ee2-4c41-90ff-e1223a50ff38 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:55.504798 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddedad0-2ee2-4c41-90ff-e1223a50ff38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:55.505083 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddedad0-2ee2-4c41-90ff-e1223a50ff38 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:55.506335 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddedad0-2ee2-4c41-90ff-e1223a50ff38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:55.508271 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddedad0-2ee2-4c41-90ff-e1223a50ff38 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:55.535442 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:55.542935 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7549d-2dbf-491f-8a9f-2444ac5b5631 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e349e5dfcd74406b922d3d1ce0fa5ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:55.553505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7549d-2dbf-491f-8a9f-2444ac5b5631 service swift] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:55.553505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7549d-2dbf-491f-8a9f-2444ac5b5631 service swift] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:55.553505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7549d-2dbf-491f-8a9f-2444ac5b5631 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:55.623553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1097/2190] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:39:55 2022] POST /identity/v3/users => generated 299 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:39:55.623553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddedad0-2ee2-4c41-90ff-e1223a50ff38 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:55.631341 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddedad0-2ee2-4c41-90ff-e1223a50ff38 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:55.648941 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8b833-587d-4867-ad14-866d4f45ff5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:55.649654 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8b833-587d-4867-ad14-866d4f45ff5c admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:55.652935 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8b833-587d-4867-ad14-866d4f45ff5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:55.652935 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8b833-587d-4867-ad14-866d4f45ff5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:55.652935 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8b833-587d-4867-ad14-866d4f45ff5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:55.652935 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8b833-587d-4867-ad14-866d4f45ff5c admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:55.655204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7549d-2dbf-491f-8a9f-2444ac5b5631 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:55.656814 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7549d-2dbf-491f-8a9f-2444ac5b5631 service swift] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:55.666338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1094/2191] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 08:39:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 08:39:55.673167 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1098/2192] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:39:55.677875 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7549d-2dbf-491f-8a9f-2444ac5b5631 service swift] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:55.691804 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7549d-2dbf-491f-8a9f-2444ac5b5631 service swift] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:55.710219 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a6b30-a60a-4adb-b792-ae519b2ecb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:55.710219 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a6b30-a60a-4adb-b792-ae519b2ecb50 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:55.710219 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a6b30-a60a-4adb-b792-ae519b2ecb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:55.710219 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a6b30-a60a-4adb-b792-ae519b2ecb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:55.710852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a6b30-a60a-4adb-b792-ae519b2ecb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:55.712450 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a6b30-a60a-4adb-b792-ae519b2ecb50 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:55.726947 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1095/2193] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:39:55.731540 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8b833-587d-4867-ad14-866d4f45ff5c admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:55.741973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8b833-587d-4867-ad14-866d4f45ff5c admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:55.762591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739be3ca-996d-4a42-9580-cef01e4c79de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:55.764275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739be3ca-996d-4a42-9580-cef01e4c79de admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:55.764820 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739be3ca-996d-4a42-9580-cef01e4c79de admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:55.765091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739be3ca-996d-4a42-9580-cef01e4c79de admin admin] PATH_INFO: `/v3/projects/37617bed2e384984985ed0de3b894eaf/users/062405091de04ce1b5b90bf513af76ee/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:55.783675 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739be3ca-996d-4a42-9580-cef01e4c79de admin admin] RBAC: Authorizing `identity:create_grant(project_id=37617bed2e384984985ed0de3b894eaf, user_id=062405091de04ce1b5b90bf513af76ee, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:55.786751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739be3ca-996d-4a42-9580-cef01e4c79de admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:56.020288 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1099/2194] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:39:55 2022] PUT /identity/v3/projects/37617bed2e384984985ed0de3b894eaf/users/062405091de04ce1b5b90bf513af76ee/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:39:56.032000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f979de-7972-4301-8492-b3d55b0a150e None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:56.038509 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f979de-7972-4301-8492-b3d55b0a150e None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:56.038509 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f979de-7972-4301-8492-b3d55b0a150e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:56.074914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-a5f979de-7972-4301-8492-b3d55b0a150e None None] MFA Rules not processed for user `062405091de04ce1b5b90bf513af76ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:56.076674 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-a5f979de-7972-4301-8492-b3d55b0a150e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:56.181348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1096/2195] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:39:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:56.193761 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739be3ca-996d-4a42-9580-cef01e4c79de admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:56.196610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-739be3ca-996d-4a42-9580-cef01e4c79de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:56.291451 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739be3ca-996d-4a42-9580-cef01e4c79de admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:56.298797 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49baaef3-89ef-4a6a-9c59-184a27f89290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:56.299814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baaef3-89ef-4a6a-9c59-184a27f89290 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:56.300310 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baaef3-89ef-4a6a-9c59-184a27f89290 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:56.300795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49baaef3-89ef-4a6a-9c59-184a27f89290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:56.322444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49baaef3-89ef-4a6a-9c59-184a27f89290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:56.324419 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49baaef3-89ef-4a6a-9c59-184a27f89290 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:56.354014 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1100/2196] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:56 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:39:58.233565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57222f-db9e-4a62-bf10-f83bf75b0007 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:58.234130 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57222f-db9e-4a62-bf10-f83bf75b0007 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:58.234130 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57222f-db9e-4a62-bf10-f83bf75b0007 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:58.235651 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1097/2197] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 08:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:39:58.288607 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf108d-256a-42f1-ba04-1bad16e3e7ff None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:58.289160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf108d-256a-42f1-ba04-1bad16e3e7ff None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:58.289400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf108d-256a-42f1-ba04-1bad16e3e7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:58.321575 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-b2bf108d-256a-42f1-ba04-1bad16e3e7ff None None] MFA Rules not processed for user `4e38b7e84d6a43efbb4c1a52e2b3e681`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:39:58.323261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b2bf108d-256a-42f1-ba04-1bad16e3e7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:58.425825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1101/2198] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 08:39:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:39:58.466529 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57222f-db9e-4a62-bf10-f83bf75b0007 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:58.468876 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-9c57222f-db9e-4a62-bf10-f83bf75b0007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:58.507790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57222f-db9e-4a62-bf10-f83bf75b0007 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:58.526533 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a044b8-6afb-42c8-88b5-1a18e7f91770 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38b7e84d6a43efbb4c1a52e2b3e681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:58.527214 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a044b8-6afb-42c8-88b5-1a18e7f91770 service placement] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:58.527502 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a044b8-6afb-42c8-88b5-1a18e7f91770 service placement] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:58.527783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a044b8-6afb-42c8-88b5-1a18e7f91770 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:58.546444 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a044b8-6afb-42c8-88b5-1a18e7f91770 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:58.548077 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a044b8-6afb-42c8-88b5-1a18e7f91770 service placement] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:58.577535 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1098/2199] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:39:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:39:58.684982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf108d-256a-42f1-ba04-1bad16e3e7ff None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:39:58.686689 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b2bf108d-256a-42f1-ba04-1bad16e3e7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:39:58.733693 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:39:58.855502 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf108d-256a-42f1-ba04-1bad16e3e7ff None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:39:58.863694 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fba59-8b26-446e-bce0-18e950f684e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:39:58.866968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fba59-8b26-446e-bce0-18e950f684e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:39:58.866968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fba59-8b26-446e-bce0-18e950f684e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:39:58.866968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fba59-8b26-446e-bce0-18e950f684e1 admin admin] PATH_INFO: `/v3/users/de39c3c89d9440ac8f655b420477c043` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:39:58.867328 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fba59-8b26-446e-bce0-18e950f684e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de39c3c89d9440ac8f655b420477c043)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:39:58.869753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fba59-8b26-446e-bce0-18e950f684e1 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:39:59.138193 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-279fba59-8b26-446e-bce0-18e950f684e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de39c3c89d9440ac8f655b420477c043'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:59.176849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-279fba59-8b26-446e-bce0-18e950f684e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de39c3c89d9440ac8f655b420477c043'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:59.202516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-279fba59-8b26-446e-bce0-18e950f684e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de39c3c89d9440ac8f655b420477c043'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:59.203284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-279fba59-8b26-446e-bce0-18e950f684e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de39c3c89d9440ac8f655b420477c043'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:59.205859 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-279fba59-8b26-446e-bce0-18e950f684e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de39c3c89d9440ac8f655b420477c043'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:39:59.331152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1102/2200] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:39:58 2022] DELETE /identity/v3/users/de39c3c89d9440ac8f655b420477c043 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:40:00.323489 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a044b8-6afb-42c8-88b5-1a18e7f91770 service placement] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:00.336067 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a044b8-6afb-42c8-88b5-1a18e7f91770 service placement] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:00.488107 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea2e60-0f52-4535-bf65-88427e1be8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:00.489081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea2e60-0f52-4535-bf65-88427e1be8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:00.489364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea2e60-0f52-4535-bf65-88427e1be8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:00.489691 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea2e60-0f52-4535-bf65-88427e1be8b5 admin admin] PATH_INFO: `/v3/projects/1cddd6e65016460f86475362da73a2ae` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:00.491095 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea2e60-0f52-4535-bf65-88427e1be8b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cddd6e65016460f86475362da73a2ae)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:00.493257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea2e60-0f52-4535-bf65-88427e1be8b5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:00.508804 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:00.630103 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-51ea2e60-0f52-4535-bf65-88427e1be8b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cddd6e65016460f86475362da73a2ae', 'request_id': 'req-51ea2e60-0f52-4535-bf65-88427e1be8b5'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:00.640736 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-51ea2e60-0f52-4535-bf65-88427e1be8b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cddd6e65016460f86475362da73a2ae', 'request_id': 'req-51ea2e60-0f52-4535-bf65-88427e1be8b5'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:00.653294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-51ea2e60-0f52-4535-bf65-88427e1be8b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cddd6e65016460f86475362da73a2ae', 'request_id': 'req-51ea2e60-0f52-4535-bf65-88427e1be8b5'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:00.752023 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-51ea2e60-0f52-4535-bf65-88427e1be8b5 admin admin] The token cache is being invalidate because project 1cddd6e65016460f86475362da73a2ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:40:00.752592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-51ea2e60-0f52-4535-bf65-88427e1be8b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:00.753334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-51ea2e60-0f52-4535-bf65-88427e1be8b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:00.758946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1099/2201] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:40:00 2022] DELETE /identity/v3/projects/1cddd6e65016460f86475362da73a2ae => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:40:00.764187 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c9f78-f483-4912-8a50-168621a35894 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:00.765446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c9f78-f483-4912-8a50-168621a35894 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:00.765815 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c9f78-f483-4912-8a50-168621a35894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:00.784372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-d44c9f78-f483-4912-8a50-168621a35894 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:00.785744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-d44c9f78-f483-4912-8a50-168621a35894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:00.867753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1103/2202] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:00.876099 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b9412-5cec-40a1-bfb7-a5f07a9c78ce None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:00.877396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b9412-5cec-40a1-bfb7-a5f07a9c78ce None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:00.879252 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b9412-5cec-40a1-bfb7-a5f07a9c78ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:00.913190 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-cd7b9412-5cec-40a1-bfb7-a5f07a9c78ce None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:00.914471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-cd7b9412-5cec-40a1-bfb7-a5f07a9c78ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:00.923161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1100/2203] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:00.927150 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c9f78-f483-4912-8a50-168621a35894 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:00.938088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c9f78-f483-4912-8a50-168621a35894 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:00.946769 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf4c8b-5c51-426b-8f43-6d1d0c8e4fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:00.948236 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf4c8b-5c51-426b-8f43-6d1d0c8e4fbd admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:00.948673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf4c8b-5c51-426b-8f43-6d1d0c8e4fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:00.949035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf4c8b-5c51-426b-8f43-6d1d0c8e4fbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:00.949865 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf4c8b-5c51-426b-8f43-6d1d0c8e4fbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:40:00.950380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf4c8b-5c51-426b-8f43-6d1d0c8e4fbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:00.952749 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf4c8b-5c51-426b-8f43-6d1d0c8e4fbd admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:00.966123 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1104/2204] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:40:00.971271 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b9412-5cec-40a1-bfb7-a5f07a9c78ce None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:00.987478 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b9412-5cec-40a1-bfb7-a5f07a9c78ce None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:00.988258 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f4277-e6ab-4807-ac20-0678d7149f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:00.989152 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f4277-e6ab-4807-ac20-0678d7149f93 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:00.989649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f4277-e6ab-4807-ac20-0678d7149f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:00.990129 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f4277-e6ab-4807-ac20-0678d7149f93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:00.991262 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f4277-e6ab-4807-ac20-0678d7149f93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:00.993379 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f4277-e6ab-4807-ac20-0678d7149f93 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:01.108899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1101/2205] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:40:00 2022] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:40:01.112743 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf4c8b-5c51-426b-8f43-6d1d0c8e4fbd admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:01.127301 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf4c8b-5c51-426b-8f43-6d1d0c8e4fbd admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:01.156182 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:01.233990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b45a9-ef28-4a94-94ab-4ef2a2dffc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:01.233990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b45a9-ef28-4a94-94ab-4ef2a2dffc39 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:01.233990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b45a9-ef28-4a94-94ab-4ef2a2dffc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:01.233990 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b45a9-ef28-4a94-94ab-4ef2a2dffc39 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:01.234380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b45a9-ef28-4a94-94ab-4ef2a2dffc39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:01.235163 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b45a9-ef28-4a94-94ab-4ef2a2dffc39 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:01.355260 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1105/2206] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:40:01 2022] POST /identity/v3/users => generated 283 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:40:01.359098 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f4277-e6ab-4807-ac20-0678d7149f93 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:01.377197 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f4277-e6ab-4807-ac20-0678d7149f93 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:01.393795 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8902d-d67a-4504-b72d-a4a32acb4cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:01.396605 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8902d-d67a-4504-b72d-a4a32acb4cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:01.397085 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8902d-d67a-4504-b72d-a4a32acb4cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:01.397451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8902d-d67a-4504-b72d-a4a32acb4cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:01.398644 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8902d-d67a-4504-b72d-a4a32acb4cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:01.400398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8902d-d67a-4504-b72d-a4a32acb4cd0 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:01.416839 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1102/2207] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:40:01.420492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b45a9-ef28-4a94-94ab-4ef2a2dffc39 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:01.434534 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b45a9-ef28-4a94-94ab-4ef2a2dffc39 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:01.445895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bd925-cc40-4c01-a3ea-95f31aa6e3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:01.446799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bd925-cc40-4c01-a3ea-95f31aa6e3f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:01.447091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bd925-cc40-4c01-a3ea-95f31aa6e3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:01.447391 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bd925-cc40-4c01-a3ea-95f31aa6e3f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:01.448256 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905bd925-cc40-4c01-a3ea-95f31aa6e3f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:01.449900 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905bd925-cc40-4c01-a3ea-95f31aa6e3f8 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:01.474227 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1106/2208] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:40:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:40:01.479015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8902d-d67a-4504-b72d-a4a32acb4cd0 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:01.497197 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8902d-d67a-4504-b72d-a4a32acb4cd0 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:01.518044 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5dcd6-4b25-4622-a4ef-61216f5eaa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:01.519276 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5dcd6-4b25-4622-a4ef-61216f5eaa74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:01.519756 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5dcd6-4b25-4622-a4ef-61216f5eaa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:01.520198 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce5dcd6-4b25-4622-a4ef-61216f5eaa74 admin admin] PATH_INFO: `/v3/projects/a7f30ce7fe644f3aba60e965c711b824/users/e2a79909f7dd4ff39746ed65b67a35e2/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:01.542690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5dcd6-4b25-4622-a4ef-61216f5eaa74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7f30ce7fe644f3aba60e965c711b824, user_id=e2a79909f7dd4ff39746ed65b67a35e2, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:01.551360 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce5dcd6-4b25-4622-a4ef-61216f5eaa74 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:01.622563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1103/2209] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:40:01 2022] PUT /identity/v3/projects/a7f30ce7fe644f3aba60e965c711b824/users/e2a79909f7dd4ff39746ed65b67a35e2/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:40:01.632616 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82e8af-cf74-4e79-8f6c-2ae6828e7933 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:01.632914 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82e8af-cf74-4e79-8f6c-2ae6828e7933 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:01.633175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82e8af-cf74-4e79-8f6c-2ae6828e7933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:01.665022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-9a82e8af-cf74-4e79-8f6c-2ae6828e7933 None None] MFA Rules not processed for user `e2a79909f7dd4ff39746ed65b67a35e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:01.666370 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9a82e8af-cf74-4e79-8f6c-2ae6828e7933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:01.780117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1107/2210] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:40:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:01.788549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5dcd6-4b25-4622-a4ef-61216f5eaa74 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:01.790801 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-cce5dcd6-4b25-4622-a4ef-61216f5eaa74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:01.864085 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce5dcd6-4b25-4622-a4ef-61216f5eaa74 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:01.874492 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c0563-1509-498d-831e-7e4a2eb8883f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:01.875587 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c0563-1509-498d-831e-7e4a2eb8883f service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:01.875985 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c0563-1509-498d-831e-7e4a2eb8883f service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:01.876375 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c0563-1509-498d-831e-7e4a2eb8883f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:01.893155 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c0563-1509-498d-831e-7e4a2eb8883f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:01.896273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c0563-1509-498d-831e-7e4a2eb8883f service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:01.907453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1104/2211] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:40:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:40:02.206350 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef210c48-b66a-4163-8cc1-a9a8821b4a73 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:02.206643 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef210c48-b66a-4163-8cc1-a9a8821b4a73 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:02.207000 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef210c48-b66a-4163-8cc1-a9a8821b4a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:02.228157 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-ef210c48-b66a-4163-8cc1-a9a8821b4a73 None None] MFA Rules not processed for user `017d2074ad8742ca8bd156593c591b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:02.229394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ef210c48-b66a-4163-8cc1-a9a8821b4a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:02.344546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1108/2212] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:40:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:06.630731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c0563-1509-498d-831e-7e4a2eb8883f service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:06.632780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ad1c0563-1509-498d-831e-7e4a2eb8883f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:06.725729 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:06.758231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c0563-1509-498d-831e-7e4a2eb8883f service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:06.765419 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7efc9-de1a-46dd-aa2c-778d9996abf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:06.766623 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7efc9-de1a-46dd-aa2c-778d9996abf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:06.766986 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7efc9-de1a-46dd-aa2c-778d9996abf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:06.767614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7efc9-de1a-46dd-aa2c-778d9996abf3 admin admin] PATH_INFO: `/v3/users/062405091de04ce1b5b90bf513af76ee` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:06.768911 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7efc9-de1a-46dd-aa2c-778d9996abf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=062405091de04ce1b5b90bf513af76ee)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:06.771108 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7efc9-de1a-46dd-aa2c-778d9996abf3 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:07.070816 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-bbb7efc9-de1a-46dd-aa2c-778d9996abf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '062405091de04ce1b5b90bf513af76ee'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:07.084770 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-bbb7efc9-de1a-46dd-aa2c-778d9996abf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '062405091de04ce1b5b90bf513af76ee'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:07.093425 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-bbb7efc9-de1a-46dd-aa2c-778d9996abf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '062405091de04ce1b5b90bf513af76ee'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:07.094354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-bbb7efc9-de1a-46dd-aa2c-778d9996abf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '062405091de04ce1b5b90bf513af76ee'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:07.095328 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-bbb7efc9-de1a-46dd-aa2c-778d9996abf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '062405091de04ce1b5b90bf513af76ee'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:07.206279 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1105/2213] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:40:06 2022] DELETE /identity/v3/users/062405091de04ce1b5b90bf513af76ee => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:40:07.210906 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2942ea-d572-44be-b7f9-456b364004d1 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:07.211875 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2942ea-d572-44be-b7f9-456b364004d1 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:07.212157 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2942ea-d572-44be-b7f9-456b364004d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:07.231752 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-bd2942ea-d572-44be-b7f9-456b364004d1 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:07.233263 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-bd2942ea-d572-44be-b7f9-456b364004d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:07.269683 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:07.312718 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1109/2214] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:40:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:07.323030 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7efc9-de1a-46dd-aa2c-778d9996abf3 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:07.327932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-bbb7efc9-de1a-46dd-aa2c-778d9996abf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:07.414748 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7efc9-de1a-46dd-aa2c-778d9996abf3 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:07.419107 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f75f4-0443-4d5e-b4d8-44def9f69c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:07.420404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f75f4-0443-4d5e-b4d8-44def9f69c2e service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:07.420694 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f75f4-0443-4d5e-b4d8-44def9f69c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:07.420970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f75f4-0443-4d5e-b4d8-44def9f69c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:07.433209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f75f4-0443-4d5e-b4d8-44def9f69c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:07.434744 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f75f4-0443-4d5e-b4d8-44def9f69c2e service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:07.447072 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1106/2215] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:40:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:40:08.187738 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2942ea-d572-44be-b7f9-456b364004d1 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:08.189280 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-bd2942ea-d572-44be-b7f9-456b364004d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:08.202653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2942ea-d572-44be-b7f9-456b364004d1 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:08.207383 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd2587-c621-4e4e-b44f-f231dc25b466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:08.208431 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd2587-c621-4e4e-b44f-f231dc25b466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:08.208779 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd2587-c621-4e4e-b44f-f231dc25b466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:08.209119 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd2587-c621-4e4e-b44f-f231dc25b466 admin admin] PATH_INFO: `/v3/projects/37617bed2e384984985ed0de3b894eaf` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:08.210261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd2587-c621-4e4e-b44f-f231dc25b466 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37617bed2e384984985ed0de3b894eaf)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:08.212421 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd2587-c621-4e4e-b44f-f231dc25b466 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:08.385212 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6cfd2587-c621-4e4e-b44f-f231dc25b466 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37617bed2e384984985ed0de3b894eaf', 'request_id': 'req-6cfd2587-c621-4e4e-b44f-f231dc25b466'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:08.404539 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6cfd2587-c621-4e4e-b44f-f231dc25b466 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37617bed2e384984985ed0de3b894eaf', 'request_id': 'req-6cfd2587-c621-4e4e-b44f-f231dc25b466'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:08.487550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6cfd2587-c621-4e4e-b44f-f231dc25b466 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37617bed2e384984985ed0de3b894eaf', 'request_id': 'req-6cfd2587-c621-4e4e-b44f-f231dc25b466'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:08.512222 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6cfd2587-c621-4e4e-b44f-f231dc25b466 admin admin] The token cache is being invalidate because project 37617bed2e384984985ed0de3b894eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:40:08.512522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6cfd2587-c621-4e4e-b44f-f231dc25b466 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:08.515027 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6cfd2587-c621-4e4e-b44f-f231dc25b466 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:08.519231 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1110/2216] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:40:08 2022] DELETE /identity/v3/projects/37617bed2e384984985ed0de3b894eaf => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:40:17.442217 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=62,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:18.504285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=37,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:18.846121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70459d-fd6c-44b6-b88e-bc732f19846f None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:18.847226 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70459d-fd6c-44b6-b88e-bc732f19846f None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:18.847936 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70459d-fd6c-44b6-b88e-bc732f19846f None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:18.850029 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1107/2217] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 08:40:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:40:18.864854 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cf902-5f0c-42b7-8463-2309e0c19476 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:18.865505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cf902-5f0c-42b7-8463-2309e0c19476 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:18.874299 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cf902-5f0c-42b7-8463-2309e0c19476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:18.887124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-c53cf902-5f0c-42b7-8463-2309e0c19476 None None] MFA Rules not processed for user `b6670a010c034f7999c9445452c02473`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:18.888465 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c53cf902-5f0c-42b7-8463-2309e0c19476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:18.958863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1111/2218] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 08:40:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:18.970615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70459d-fd6c-44b6-b88e-bc732f19846f None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:18.972398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4f70459d-fd6c-44b6-b88e-bc732f19846f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:19.030288 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70459d-fd6c-44b6-b88e-bc732f19846f None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:19.034006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2eae7-475a-426c-9793-806d85f5343a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b27a4861d6b4ddfaca1a97efdaf008d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:19.034639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2eae7-475a-426c-9793-806d85f5343a service glance] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:19.034919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2eae7-475a-426c-9793-806d85f5343a service glance] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:19.035192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2eae7-475a-426c-9793-806d85f5343a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:19.045774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2eae7-475a-426c-9793-806d85f5343a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:19.047212 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2eae7-475a-426c-9793-806d85f5343a service glance] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:19.057993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1108/2219] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:40:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:40:19.288455 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40db87-6b2a-4933-aed5-2f65390233c0 None None] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:19.288747 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40db87-6b2a-4933-aed5-2f65390233c0 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:19.289029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40db87-6b2a-4933-aed5-2f65390233c0 None None] PATH_INFO: `/` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:19.290855 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1112/2220] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 08:40:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:40:19.296738 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257a1c5-574b-4512-9c92-fa5378e82b3f None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:19.297105 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257a1c5-574b-4512-9c92-fa5378e82b3f None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:19.297457 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257a1c5-574b-4512-9c92-fa5378e82b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:19.316664 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-c257a1c5-574b-4512-9c92-fa5378e82b3f None None] MFA Rules not processed for user `a25749f3a7c84c50b860538d1b661901`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:19.318007 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-c257a1c5-574b-4512-9c92-fa5378e82b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:19.375100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1109/2221] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 08:40:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:19.388924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40db87-6b2a-4933-aed5-2f65390233c0 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:19.393012 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-da40db87-6b2a-4933-aed5-2f65390233c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:19.406987 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40db87-6b2a-4933-aed5-2f65390233c0 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:19.414653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b2f3a-96d5-43b3-b706-63d70db832b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:19.414653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b2f3a-96d5-43b3-b706-63d70db832b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:19.414653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b2f3a-96d5-43b3-b706-63d70db832b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:19.414653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b2f3a-96d5-43b3-b706-63d70db832b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:19.424457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b2f3a-96d5-43b3-b706-63d70db832b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:19.425999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b2f3a-96d5-43b3-b706-63d70db832b0 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:19.434266 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1113/2222] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:40:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:40:19.520163 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce089cd-986a-45f7-9c9a-dc97fcf922c0 None None] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:19.520452 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce089cd-986a-45f7-9c9a-dc97fcf922c0 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:19.520740 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce089cd-986a-45f7-9c9a-dc97fcf922c0 None None] PATH_INFO: `/` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:19.522178 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1110/2223] 10.222.0.57 () {54 vars in 921 bytes} [Thu Jul 21 08:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 08:40:19.527466 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11663f5b-6284-4c78-9121-e1bcf24abd63 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:19.527936 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11663f5b-6284-4c78-9121-e1bcf24abd63 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:19.528096 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11663f5b-6284-4c78-9121-e1bcf24abd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:19.547651 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-11663f5b-6284-4c78-9121-e1bcf24abd63 None None] MFA Rules not processed for user `b6670a010c034f7999c9445452c02473`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:19.548875 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-11663f5b-6284-4c78-9121-e1bcf24abd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:19.558518 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1114/2224] 10.222.0.57 () {58 vars in 1018 bytes} [Thu Jul 21 08:40:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:19.569567 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce089cd-986a-45f7-9c9a-dc97fcf922c0 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:19.580257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce089cd-986a-45f7-9c9a-dc97fcf922c0 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:19.583913 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ee067-1c14-4e4f-8947-23771dcc270f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:19.584545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ee067-1c14-4e4f-8947-23771dcc270f service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:19.584860 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ee067-1c14-4e4f-8947-23771dcc270f service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:19.585139 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ee067-1c14-4e4f-8947-23771dcc270f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:19.596021 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ee067-1c14-4e4f-8947-23771dcc270f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:19.597472 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ee067-1c14-4e4f-8947-23771dcc270f service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:19.608446 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1111/2225] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:40:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:40:25.576853 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e89ea-5282-4a18-bf97-f63a36bea51a None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:25.577353 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e89ea-5282-4a18-bf97-f63a36bea51a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:25.577456 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e89ea-5282-4a18-bf97-f63a36bea51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:25.609654 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-538e89ea-5282-4a18-bf97-f63a36bea51a None None] MFA Rules not processed for user `22750d44d710439da1d18a78419b1adf`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:25.611919 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-538e89ea-5282-4a18-bf97-f63a36bea51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:25.688175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1115/2226] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 08:40:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:25.702446 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ee067-1c14-4e4f-8947-23771dcc270f service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:25.704010 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-303ee067-1c14-4e4f-8947-23771dcc270f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:25.818002 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ee067-1c14-4e4f-8947-23771dcc270f service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:25.823188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43965f60-2d60-4fdc-8a1d-9c281f40acc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e349e5dfcd74406b922d3d1ce0fa5ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:25.823838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43965f60-2d60-4fdc-8a1d-9c281f40acc8 service swift] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:25.824178 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43965f60-2d60-4fdc-8a1d-9c281f40acc8 service swift] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:25.824453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43965f60-2d60-4fdc-8a1d-9c281f40acc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:25.833336 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43965f60-2d60-4fdc-8a1d-9c281f40acc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:25.835244 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43965f60-2d60-4fdc-8a1d-9c281f40acc8 service swift] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:25.844431 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1112/2227] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 08:40:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 08:40:26.902786 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89a47-ec20-4df2-b24d-9a14505ed970 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:26.903268 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89a47-ec20-4df2-b24d-9a14505ed970 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:26.903454 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a89a47-ec20-4df2-b24d-9a14505ed970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:26.923504 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-f1a89a47-ec20-4df2-b24d-9a14505ed970 None None] MFA Rules not processed for user `22750d44d710439da1d18a78419b1adf`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:26.924915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f1a89a47-ec20-4df2-b24d-9a14505ed970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:26.932297 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1116/2228] 10.222.0.57 () {58 vars in 967 bytes} [Thu Jul 21 08:40:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:26.948421 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43965f60-2d60-4fdc-8a1d-9c281f40acc8 service swift] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:26.959887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43965f60-2d60-4fdc-8a1d-9c281f40acc8 service swift] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:26.967809 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978035e3-738f-461f-b5cf-68b5f041a471 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e349e5dfcd74406b922d3d1ce0fa5ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:26.968837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978035e3-738f-461f-b5cf-68b5f041a471 service swift] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:26.969332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978035e3-738f-461f-b5cf-68b5f041a471 service swift] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:26.969936 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978035e3-738f-461f-b5cf-68b5f041a471 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:26.980124 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978035e3-738f-461f-b5cf-68b5f041a471 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:26.987204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978035e3-738f-461f-b5cf-68b5f041a471 service swift] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:26.995178 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1113/2229] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 08:40:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:40:27.667445 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485866d9-bd04-4841-8ea9-5b5e95aeca93 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:27.667908 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485866d9-bd04-4841-8ea9-5b5e95aeca93 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:27.668342 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485866d9-bd04-4841-8ea9-5b5e95aeca93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:27.697229 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-485866d9-bd04-4841-8ea9-5b5e95aeca93 None None] MFA Rules not processed for user `22750d44d710439da1d18a78419b1adf`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:27.699029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-485866d9-bd04-4841-8ea9-5b5e95aeca93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:27.707864 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1117/2230] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 08:40:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:27.722998 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978035e3-738f-461f-b5cf-68b5f041a471 service swift] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:27.734556 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978035e3-738f-461f-b5cf-68b5f041a471 service swift] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:27.741555 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0e039-cfa3-4c80-b236-11836d9f6a34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e349e5dfcd74406b922d3d1ce0fa5ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:27.744093 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0e039-cfa3-4c80-b236-11836d9f6a34 service swift] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:27.744093 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0e039-cfa3-4c80-b236-11836d9f6a34 service swift] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:27.744093 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0e039-cfa3-4c80-b236-11836d9f6a34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:27.753335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0e039-cfa3-4c80-b236-11836d9f6a34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:27.755044 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0e039-cfa3-4c80-b236-11836d9f6a34 service swift] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:27.766940 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1114/2231] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 08:40:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:40:28.329702 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5a82a-f4ba-42f4-b5bd-30945bab2f1a None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:28.330176 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5a82a-f4ba-42f4-b5bd-30945bab2f1a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:28.330274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5a82a-f4ba-42f4-b5bd-30945bab2f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:28.347485 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-d3b5a82a-f4ba-42f4-b5bd-30945bab2f1a None None] MFA Rules not processed for user `22750d44d710439da1d18a78419b1adf`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:28.348663 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-d3b5a82a-f4ba-42f4-b5bd-30945bab2f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:28.356020 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1118/2232] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 08:40:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:28.369410 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0e039-cfa3-4c80-b236-11836d9f6a34 service swift] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:28.375519 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:28.381251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0e039-cfa3-4c80-b236-11836d9f6a34 service swift] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:28.386368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22006347-bff8-4913-a84e-b3cea28ba12d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e349e5dfcd74406b922d3d1ce0fa5ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:28.387008 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22006347-bff8-4913-a84e-b3cea28ba12d service swift] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:28.387292 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22006347-bff8-4913-a84e-b3cea28ba12d service swift] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:28.391959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22006347-bff8-4913-a84e-b3cea28ba12d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:28.395633 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22006347-bff8-4913-a84e-b3cea28ba12d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:28.397220 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22006347-bff8-4913-a84e-b3cea28ba12d service swift] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:28.405754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1115/2233] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 08:40:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 08:40:33.838765 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e64720-4095-4015-a48e-c95b9dc04a5d None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:33.838765 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e64720-4095-4015-a48e-c95b9dc04a5d None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:33.839458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e64720-4095-4015-a48e-c95b9dc04a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:33.866122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-f3e64720-4095-4015-a48e-c95b9dc04a5d None None] MFA Rules not processed for user `22750d44d710439da1d18a78419b1adf`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:33.867516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f3e64720-4095-4015-a48e-c95b9dc04a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:33.877296 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1119/2234] 10.222.0.57 () {58 vars in 967 bytes} [Thu Jul 21 08:40:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:40:33.907258 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22006347-bff8-4913-a84e-b3cea28ba12d service swift] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:33.921947 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22006347-bff8-4913-a84e-b3cea28ba12d service swift] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:33.929086 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f31cbf-3b01-4261-ad65-05daf36d2330 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e349e5dfcd74406b922d3d1ce0fa5ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:33.929804 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f31cbf-3b01-4261-ad65-05daf36d2330 service swift] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:33.930086 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f31cbf-3b01-4261-ad65-05daf36d2330 service swift] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:33.930361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f31cbf-3b01-4261-ad65-05daf36d2330 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:33.940026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f31cbf-3b01-4261-ad65-05daf36d2330 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:33.943085 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f31cbf-3b01-4261-ad65-05daf36d2330 service swift] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:33.955023 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1116/2235] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 08:40:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:40:36.993631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e64720-4095-4015-a48e-c95b9dc04a5d None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:36.995082 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f3e64720-4095-4015-a48e-c95b9dc04a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:37.065168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:37.083716 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e64720-4095-4015-a48e-c95b9dc04a5d None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:37.088973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67da48-f5c3-4560-bc52-113d76e0c472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:37.090147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67da48-f5c3-4560-bc52-113d76e0c472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:37.090683 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67da48-f5c3-4560-bc52-113d76e0c472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:37.091204 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67da48-f5c3-4560-bc52-113d76e0c472 admin admin] PATH_INFO: `/v3/users/d2e1ce292ea34b0c938f540b655d04aa` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:37.092672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67da48-f5c3-4560-bc52-113d76e0c472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2e1ce292ea34b0c938f540b655d04aa)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:37.095191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67da48-f5c3-4560-bc52-113d76e0c472 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:37.317244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-be67da48-f5c3-4560-bc52-113d76e0c472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2e1ce292ea34b0c938f540b655d04aa'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:37.330689 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-be67da48-f5c3-4560-bc52-113d76e0c472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2e1ce292ea34b0c938f540b655d04aa'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:37.350451 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-be67da48-f5c3-4560-bc52-113d76e0c472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2e1ce292ea34b0c938f540b655d04aa'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:37.351009 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-be67da48-f5c3-4560-bc52-113d76e0c472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2e1ce292ea34b0c938f540b655d04aa'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:37.354655 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-be67da48-f5c3-4560-bc52-113d76e0c472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2e1ce292ea34b0c938f540b655d04aa'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:37.463494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1120/2236] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:40:36 2022] DELETE /identity/v3/users/d2e1ce292ea34b0c938f540b655d04aa => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:40:37.468088 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0701ada-5472-4475-a84e-d00167820a18 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:37.468986 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0701ada-5472-4475-a84e-d00167820a18 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:37.469647 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0701ada-5472-4475-a84e-d00167820a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:37.491815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-e0701ada-5472-4475-a84e-d00167820a18 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:37.493436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e0701ada-5472-4475-a84e-d00167820a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:37.563109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1117/2237] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:37.573282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67da48-f5c3-4560-bc52-113d76e0c472 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:37.574853 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-be67da48-f5c3-4560-bc52-113d76e0c472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:37.640082 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67da48-f5c3-4560-bc52-113d76e0c472 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:37.644245 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37aacf-4d59-4f26-9280-5311afab0669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:37.644892 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37aacf-4d59-4f26-9280-5311afab0669 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:37.645171 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37aacf-4d59-4f26-9280-5311afab0669 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:37.645443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37aacf-4d59-4f26-9280-5311afab0669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:37.656652 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37aacf-4d59-4f26-9280-5311afab0669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:37.663620 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37aacf-4d59-4f26-9280-5311afab0669 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:37.668941 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1121/2238] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:40:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:40:37.999929 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0701ada-5472-4475-a84e-d00167820a18 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:38.001414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e0701ada-5472-4475-a84e-d00167820a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:38.015592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0701ada-5472-4475-a84e-d00167820a18 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:38.024299 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb318032-5638-45ac-8653-8f05500dd6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:38.024299 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb318032-5638-45ac-8653-8f05500dd6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:38.024299 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb318032-5638-45ac-8653-8f05500dd6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:38.024299 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb318032-5638-45ac-8653-8f05500dd6cf admin admin] PATH_INFO: `/v3/projects/342d4f7018c146e7be9d6a8b7fe0b2c4` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:38.024606 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb318032-5638-45ac-8653-8f05500dd6cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=342d4f7018c146e7be9d6a8b7fe0b2c4)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:38.026369 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb318032-5638-45ac-8653-8f05500dd6cf admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:38.146117 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-eb318032-5638-45ac-8653-8f05500dd6cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '342d4f7018c146e7be9d6a8b7fe0b2c4', 'request_id': 'req-eb318032-5638-45ac-8653-8f05500dd6cf'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:38.152527 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-eb318032-5638-45ac-8653-8f05500dd6cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '342d4f7018c146e7be9d6a8b7fe0b2c4', 'request_id': 'req-eb318032-5638-45ac-8653-8f05500dd6cf'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:38.158521 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-eb318032-5638-45ac-8653-8f05500dd6cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '342d4f7018c146e7be9d6a8b7fe0b2c4', 'request_id': 'req-eb318032-5638-45ac-8653-8f05500dd6cf'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:38.250169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-eb318032-5638-45ac-8653-8f05500dd6cf admin admin] The token cache is being invalidate because project 342d4f7018c146e7be9d6a8b7fe0b2c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:40:38.250618 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-eb318032-5638-45ac-8653-8f05500dd6cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:38.251357 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-eb318032-5638-45ac-8653-8f05500dd6cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:38.253150 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1118/2239] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:40:37 2022] DELETE /identity/v3/projects/342d4f7018c146e7be9d6a8b7fe0b2c4 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:40:47.664193 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:48.245568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=65,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:48.507094 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37aacf-4d59-4f26-9280-5311afab0669 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:48.508542 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-2a37aacf-4d59-4f26-9280-5311afab0669 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:48.521142 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37aacf-4d59-4f26-9280-5311afab0669 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:48.577134 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3c154-69de-4716-a9e1-89885ca935fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:48.578025 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3c154-69de-4716-a9e1-89885ca935fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:48.578308 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3c154-69de-4716-a9e1-89885ca935fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:48.578581 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3c154-69de-4716-a9e1-89885ca935fa admin admin] PATH_INFO: `/v3/users/e2a79909f7dd4ff39746ed65b67a35e2` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:48.579768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3c154-69de-4716-a9e1-89885ca935fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2a79909f7dd4ff39746ed65b67a35e2)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:48.581715 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3c154-69de-4716-a9e1-89885ca935fa admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:48.762785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-08e3c154-69de-4716-a9e1-89885ca935fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2a79909f7dd4ff39746ed65b67a35e2'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:48.776302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-08e3c154-69de-4716-a9e1-89885ca935fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2a79909f7dd4ff39746ed65b67a35e2'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:48.784262 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-08e3c154-69de-4716-a9e1-89885ca935fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2a79909f7dd4ff39746ed65b67a35e2'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:48.785052 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-08e3c154-69de-4716-a9e1-89885ca935fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2a79909f7dd4ff39746ed65b67a35e2'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:48.785714 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-08e3c154-69de-4716-a9e1-89885ca935fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2a79909f7dd4ff39746ed65b67a35e2'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:48.894680 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1122/2240] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:40:48 2022] DELETE /identity/v3/users/e2a79909f7dd4ff39746ed65b67a35e2 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:40:48.899006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f409000-1dd7-40f8-8706-461dd198114d None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:48.899300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f409000-1dd7-40f8-8706-461dd198114d None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:48.899586 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f409000-1dd7-40f8-8706-461dd198114d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:48.919554 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-7f409000-1dd7-40f8-8706-461dd198114d None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:48.920778 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-7f409000-1dd7-40f8-8706-461dd198114d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:48.982207 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1119/2241] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:48.992499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3c154-69de-4716-a9e1-89885ca935fa admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:48.994479 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-08e3c154-69de-4716-a9e1-89885ca935fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:49.052385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3c154-69de-4716-a9e1-89885ca935fa admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:49.056026 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf16b7-b82e-4bad-848b-bd0781ff354b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:49.056671 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf16b7-b82e-4bad-848b-bd0781ff354b service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:49.056956 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf16b7-b82e-4bad-848b-bd0781ff354b service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:49.057231 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf16b7-b82e-4bad-848b-bd0781ff354b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:49.066854 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf16b7-b82e-4bad-848b-bd0781ff354b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:49.068288 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf16b7-b82e-4bad-848b-bd0781ff354b service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:49.077952 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1123/2242] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:40:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:40:49.477240 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f409000-1dd7-40f8-8706-461dd198114d None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:49.478019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-7f409000-1dd7-40f8-8706-461dd198114d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:49.501261 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f409000-1dd7-40f8-8706-461dd198114d None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:49.510242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c144ccd-fd42-47d1-98b4-e2439af251d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:49.511676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c144ccd-fd42-47d1-98b4-e2439af251d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:49.512124 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c144ccd-fd42-47d1-98b4-e2439af251d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:49.512514 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c144ccd-fd42-47d1-98b4-e2439af251d5 admin admin] PATH_INFO: `/v3/projects/a7f30ce7fe644f3aba60e965c711b824` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:49.514207 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c144ccd-fd42-47d1-98b4-e2439af251d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7f30ce7fe644f3aba60e965c711b824)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:49.516342 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c144ccd-fd42-47d1-98b4-e2439af251d5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:49.619296 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7c144ccd-fd42-47d1-98b4-e2439af251d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7f30ce7fe644f3aba60e965c711b824', 'request_id': 'req-7c144ccd-fd42-47d1-98b4-e2439af251d5'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:49.625815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7c144ccd-fd42-47d1-98b4-e2439af251d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7f30ce7fe644f3aba60e965c711b824', 'request_id': 'req-7c144ccd-fd42-47d1-98b4-e2439af251d5'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:49.631953 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7c144ccd-fd42-47d1-98b4-e2439af251d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7f30ce7fe644f3aba60e965c711b824', 'request_id': 'req-7c144ccd-fd42-47d1-98b4-e2439af251d5'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:49.750010 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7c144ccd-fd42-47d1-98b4-e2439af251d5 admin admin] The token cache is being invalidate because project a7f30ce7fe644f3aba60e965c711b824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:40:49.750291 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7c144ccd-fd42-47d1-98b4-e2439af251d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:49.750944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7c144ccd-fd42-47d1-98b4-e2439af251d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:49.752846 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1120/2243] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:40:49 2022] DELETE /identity/v3/projects/a7f30ce7fe644f3aba60e965c711b824 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:40:49.757844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef7f0a-e017-4ec6-8e75-8183b5f5961c None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:49.758256 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef7f0a-e017-4ec6-8e75-8183b5f5961c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:49.758466 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef7f0a-e017-4ec6-8e75-8183b5f5961c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:49.775981 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-ccef7f0a-e017-4ec6-8e75-8183b5f5961c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:49.777169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ccef7f0a-e017-4ec6-8e75-8183b5f5961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:49.795756 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:49.837986 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1124/2244] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:40:49.846064 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfe0d3-f3dc-45f9-a841-8f8b42cb6b01 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:49.846443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfe0d3-f3dc-45f9-a841-8f8b42cb6b01 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:49.846730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfe0d3-f3dc-45f9-a841-8f8b42cb6b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:49.865975 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-addfe0d3-f3dc-45f9-a841-8f8b42cb6b01 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:49.867300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-addfe0d3-f3dc-45f9-a841-8f8b42cb6b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:49.875269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1121/2245] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:49.879537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef7f0a-e017-4ec6-8e75-8183b5f5961c None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:49.889117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef7f0a-e017-4ec6-8e75-8183b5f5961c None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:49.893692 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03c1e2-6e56-4fd2-aac5-b244c105494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:49.894339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03c1e2-6e56-4fd2-aac5-b244c105494b admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:49.894620 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03c1e2-6e56-4fd2-aac5-b244c105494b admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:49.894892 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03c1e2-6e56-4fd2-aac5-b244c105494b admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:49.895614 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03c1e2-6e56-4fd2-aac5-b244c105494b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:40:49.895925 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03c1e2-6e56-4fd2-aac5-b244c105494b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:49.897549 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03c1e2-6e56-4fd2-aac5-b244c105494b admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:49.909414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1125/2246] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:40:49.913727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfe0d3-f3dc-45f9-a841-8f8b42cb6b01 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:49.922976 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfe0d3-f3dc-45f9-a841-8f8b42cb6b01 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:49.928249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883b2c6-b489-4ce4-8f4e-66bcd4a5e8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:49.928895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883b2c6-b489-4ce4-8f4e-66bcd4a5e8f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:49.929179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883b2c6-b489-4ce4-8f4e-66bcd4a5e8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:49.929457 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883b2c6-b489-4ce4-8f4e-66bcd4a5e8f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:49.930176 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883b2c6-b489-4ce4-8f4e-66bcd4a5e8f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:49.932151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883b2c6-b489-4ce4-8f4e-66bcd4a5e8f2 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:50.045024 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1122/2247] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:40:49 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:40:50.045947 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03c1e2-6e56-4fd2-aac5-b244c105494b admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:50.055908 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03c1e2-6e56-4fd2-aac5-b244c105494b admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:50.114414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5c92f-caf9-4f6c-8c4e-63cebdbae2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:50.114998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5c92f-caf9-4f6c-8c4e-63cebdbae2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:50.115284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5c92f-caf9-4f6c-8c4e-63cebdbae2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:50.115694 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5c92f-caf9-4f6c-8c4e-63cebdbae2e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:50.116455 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5c92f-caf9-4f6c-8c4e-63cebdbae2e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:50.118451 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5c92f-caf9-4f6c-8c4e-63cebdbae2e1 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:50.206699 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1126/2248] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:40:50 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:40:50.216065 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883b2c6-b489-4ce4-8f4e-66bcd4a5e8f2 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:50.227471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883b2c6-b489-4ce4-8f4e-66bcd4a5e8f2 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:50.233121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b4d51-aaf7-4ff1-8414-261a985ab920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:50.243445 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b4d51-aaf7-4ff1-8414-261a985ab920 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:50.243445 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b4d51-aaf7-4ff1-8414-261a985ab920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:50.243445 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b4d51-aaf7-4ff1-8414-261a985ab920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:50.243445 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b4d51-aaf7-4ff1-8414-261a985ab920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:50.243445 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b4d51-aaf7-4ff1-8414-261a985ab920 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:50.248182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1123/2249] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:40:50.252514 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5c92f-caf9-4f6c-8c4e-63cebdbae2e1 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:50.263789 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5c92f-caf9-4f6c-8c4e-63cebdbae2e1 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:50.270873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f25639-df0a-49e1-80ba-a1beb8491b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:50.271317 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f25639-df0a-49e1-80ba-a1beb8491b24 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:50.271733 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f25639-df0a-49e1-80ba-a1beb8491b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:50.272159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f25639-df0a-49e1-80ba-a1beb8491b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:50.272900 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f25639-df0a-49e1-80ba-a1beb8491b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:50.274532 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f25639-df0a-49e1-80ba-a1beb8491b24 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:50.291599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1127/2250] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:40:50.295511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b4d51-aaf7-4ff1-8414-261a985ab920 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:50.306689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b4d51-aaf7-4ff1-8414-261a985ab920 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:50.312523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04048b9-ebb5-4426-b872-25993d8fd8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:50.313586 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04048b9-ebb5-4426-b872-25993d8fd8ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:50.313883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04048b9-ebb5-4426-b872-25993d8fd8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:50.314164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04048b9-ebb5-4426-b872-25993d8fd8ba admin admin] PATH_INFO: `/v3/projects/d71cac89ccad47209b35b0830e48cab6/users/081e1024c8864fb7b98d82cfbbacc034/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:50.332658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04048b9-ebb5-4426-b872-25993d8fd8ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71cac89ccad47209b35b0830e48cab6, user_id=081e1024c8864fb7b98d82cfbbacc034, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:50.335369 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04048b9-ebb5-4426-b872-25993d8fd8ba admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:50.429220 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1124/2251] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:40:50 2022] PUT /identity/v3/projects/d71cac89ccad47209b35b0830e48cab6/users/081e1024c8864fb7b98d82cfbbacc034/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:40:50.444716 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b34d2e-7b76-417c-90a7-79184dcdc7c2 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:50.445000 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b34d2e-7b76-417c-90a7-79184dcdc7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:50.445273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b34d2e-7b76-417c-90a7-79184dcdc7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:50.471649 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-36b34d2e-7b76-417c-90a7-79184dcdc7c2 None None] MFA Rules not processed for user `081e1024c8864fb7b98d82cfbbacc034`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:50.472897 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-36b34d2e-7b76-417c-90a7-79184dcdc7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:50.541329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1128/2252] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:40:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:50.553043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04048b9-ebb5-4426-b872-25993d8fd8ba admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:50.554908 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e04048b9-ebb5-4426-b872-25993d8fd8ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:50.576721 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:50.624322 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04048b9-ebb5-4426-b872-25993d8fd8ba admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:50.628173 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d085d5-f148-41c6-9fd8-da7a5cc9e7f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:50.628901 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d085d5-f148-41c6-9fd8-da7a5cc9e7f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:50.629351 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d085d5-f148-41c6-9fd8-da7a5cc9e7f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:50.629647 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d085d5-f148-41c6-9fd8-da7a5cc9e7f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:50.639045 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d085d5-f148-41c6-9fd8-da7a5cc9e7f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:50.640536 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d085d5-f148-41c6-9fd8-da7a5cc9e7f0 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:50.653320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1125/2253] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:40:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:40:50.679736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b34d2e-7b76-417c-90a7-79184dcdc7c2 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:50.701826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:50.752440 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b34d2e-7b76-417c-90a7-79184dcdc7c2 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:50.758054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8deda34-fe8b-4f94-ae21-439ab6e9b3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:50.758929 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8deda34-fe8b-4f94-ae21-439ab6e9b3d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:50.759211 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8deda34-fe8b-4f94-ae21-439ab6e9b3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:50.759511 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8deda34-fe8b-4f94-ae21-439ab6e9b3d7 admin admin] PATH_INFO: `/v3/users/081e1024c8864fb7b98d82cfbbacc034` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:50.761460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8deda34-fe8b-4f94-ae21-439ab6e9b3d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=081e1024c8864fb7b98d82cfbbacc034)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:50.771358 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8deda34-fe8b-4f94-ae21-439ab6e9b3d7 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:50.955314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-c8deda34-fe8b-4f94-ae21-439ab6e9b3d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '081e1024c8864fb7b98d82cfbbacc034'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:50.966924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-c8deda34-fe8b-4f94-ae21-439ab6e9b3d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '081e1024c8864fb7b98d82cfbbacc034'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:50.974430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-c8deda34-fe8b-4f94-ae21-439ab6e9b3d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '081e1024c8864fb7b98d82cfbbacc034'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:50.975108 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-c8deda34-fe8b-4f94-ae21-439ab6e9b3d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '081e1024c8864fb7b98d82cfbbacc034'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:50.975718 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-c8deda34-fe8b-4f94-ae21-439ab6e9b3d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '081e1024c8864fb7b98d82cfbbacc034'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:51.055788 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1129/2254] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:40:50 2022] DELETE /identity/v3/users/081e1024c8864fb7b98d82cfbbacc034 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:40:51.060507 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56663de-5ba5-4e07-a142-418136217b03 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:51.060801 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56663de-5ba5-4e07-a142-418136217b03 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:51.061084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56663de-5ba5-4e07-a142-418136217b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:51.078828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-b56663de-5ba5-4e07-a142-418136217b03 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:51.080547 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b56663de-5ba5-4e07-a142-418136217b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:51.140093 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1126/2255] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:51.150398 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8deda34-fe8b-4f94-ae21-439ab6e9b3d7 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:51.151799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c8deda34-fe8b-4f94-ae21-439ab6e9b3d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:51.209174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8deda34-fe8b-4f94-ae21-439ab6e9b3d7 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:51.212795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfbcea-85f7-46db-a79e-3cbca7077472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:51.213437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfbcea-85f7-46db-a79e-3cbca7077472 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:51.213754 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfbcea-85f7-46db-a79e-3cbca7077472 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:51.214077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfbcea-85f7-46db-a79e-3cbca7077472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:51.223542 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfbcea-85f7-46db-a79e-3cbca7077472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:51.224974 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfbcea-85f7-46db-a79e-3cbca7077472 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:51.235063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1130/2256] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:40:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:40:51.762815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56663de-5ba5-4e07-a142-418136217b03 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:51.763700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b56663de-5ba5-4e07-a142-418136217b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:51.780196 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56663de-5ba5-4e07-a142-418136217b03 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:51.791762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e9350-3ba7-4bf7-8bef-8dba9faec137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:51.792381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e9350-3ba7-4bf7-8bef-8dba9faec137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:51.792779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e9350-3ba7-4bf7-8bef-8dba9faec137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:51.793291 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e9350-3ba7-4bf7-8bef-8dba9faec137 admin admin] PATH_INFO: `/v3/projects/d71cac89ccad47209b35b0830e48cab6` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:51.795758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e9350-3ba7-4bf7-8bef-8dba9faec137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d71cac89ccad47209b35b0830e48cab6)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:51.799843 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e9350-3ba7-4bf7-8bef-8dba9faec137 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:51.918134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c75e9350-3ba7-4bf7-8bef-8dba9faec137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd71cac89ccad47209b35b0830e48cab6', 'request_id': 'req-c75e9350-3ba7-4bf7-8bef-8dba9faec137'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:51.924704 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c75e9350-3ba7-4bf7-8bef-8dba9faec137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd71cac89ccad47209b35b0830e48cab6', 'request_id': 'req-c75e9350-3ba7-4bf7-8bef-8dba9faec137'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:51.930709 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c75e9350-3ba7-4bf7-8bef-8dba9faec137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd71cac89ccad47209b35b0830e48cab6', 'request_id': 'req-c75e9350-3ba7-4bf7-8bef-8dba9faec137'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:52.030587 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c75e9350-3ba7-4bf7-8bef-8dba9faec137 admin admin] The token cache is being invalidate because project d71cac89ccad47209b35b0830e48cab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:40:52.030945 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c75e9350-3ba7-4bf7-8bef-8dba9faec137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:52.031661 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c75e9350-3ba7-4bf7-8bef-8dba9faec137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:40:52.033452 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1127/2257] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:40:51 2022] DELETE /identity/v3/projects/d71cac89ccad47209b35b0830e48cab6 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:40:52.039231 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf1bda-75dd-4d25-8dda-833294a9e793 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:52.039725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf1bda-75dd-4d25-8dda-833294a9e793 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:52.039843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf1bda-75dd-4d25-8dda-833294a9e793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:52.059072 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-d1bf1bda-75dd-4d25-8dda-833294a9e793 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:52.060346 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-d1bf1bda-75dd-4d25-8dda-833294a9e793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:52.095830 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:52.122541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1131/2258] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:52.131140 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d54c2-580b-4518-978d-fac8e69848ff None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:52.131435 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d54c2-580b-4518-978d-fac8e69848ff None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:52.131832 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d54c2-580b-4518-978d-fac8e69848ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:52.150663 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-333d54c2-580b-4518-978d-fac8e69848ff None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:52.152018 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-333d54c2-580b-4518-978d-fac8e69848ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:52.160276 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1128/2259] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:52.164588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf1bda-75dd-4d25-8dda-833294a9e793 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:52.176245 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf1bda-75dd-4d25-8dda-833294a9e793 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:52.182315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcf35e-fcf1-457e-ba11-8ed76ae3cae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:52.183244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcf35e-fcf1-457e-ba11-8ed76ae3cae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:52.183582 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcf35e-fcf1-457e-ba11-8ed76ae3cae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:52.184061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcf35e-fcf1-457e-ba11-8ed76ae3cae9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:52.184862 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcf35e-fcf1-457e-ba11-8ed76ae3cae9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:40:52.185218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcf35e-fcf1-457e-ba11-8ed76ae3cae9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:52.187189 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fcf35e-fcf1-457e-ba11-8ed76ae3cae9 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:52.200970 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1132/2260] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:40:52.206121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d54c2-580b-4518-978d-fac8e69848ff None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:52.215582 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d54c2-580b-4518-978d-fac8e69848ff None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:52.220343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91063cc-01cd-4180-af45-ccab8736ab89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:52.221004 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91063cc-01cd-4180-af45-ccab8736ab89 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:52.221287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91063cc-01cd-4180-af45-ccab8736ab89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:52.221602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91063cc-01cd-4180-af45-ccab8736ab89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:52.222295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91063cc-01cd-4180-af45-ccab8736ab89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:52.224213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91063cc-01cd-4180-af45-ccab8736ab89 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:52.286665 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1129/2261] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:40:52 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:40:52.290777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcf35e-fcf1-457e-ba11-8ed76ae3cae9 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:52.301356 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fcf35e-fcf1-457e-ba11-8ed76ae3cae9 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:52.357793 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a2d04-4ed4-4d82-8c2a-7207f8e78e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:52.358450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a2d04-4ed4-4d82-8c2a-7207f8e78e30 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:52.358735 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a2d04-4ed4-4d82-8c2a-7207f8e78e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:52.359018 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a2d04-4ed4-4d82-8c2a-7207f8e78e30 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:52.359697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a2d04-4ed4-4d82-8c2a-7207f8e78e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:52.362214 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a2d04-4ed4-4d82-8c2a-7207f8e78e30 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:52.450862 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1133/2262] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:40:52 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:40:52.452037 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91063cc-01cd-4180-af45-ccab8736ab89 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:52.462265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91063cc-01cd-4180-af45-ccab8736ab89 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:52.467221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4e97e-bd40-495a-86d5-cfd54ea4e7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:52.467884 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4e97e-bd40-495a-86d5-cfd54ea4e7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:52.468168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4e97e-bd40-495a-86d5-cfd54ea4e7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:52.468451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb4e97e-bd40-495a-86d5-cfd54ea4e7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:52.469182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4e97e-bd40-495a-86d5-cfd54ea4e7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:52.470809 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb4e97e-bd40-495a-86d5-cfd54ea4e7b3 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:52.481681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1130/2263] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:40:52.487203 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a2d04-4ed4-4d82-8c2a-7207f8e78e30 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:52.497314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a2d04-4ed4-4d82-8c2a-7207f8e78e30 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:52.502673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55ee3b-9c1e-44dc-bfdc-302b0573b58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:52.503331 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55ee3b-9c1e-44dc-bfdc-302b0573b58b admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:52.503614 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55ee3b-9c1e-44dc-bfdc-302b0573b58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:52.503890 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55ee3b-9c1e-44dc-bfdc-302b0573b58b admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:52.504617 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55ee3b-9c1e-44dc-bfdc-302b0573b58b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:52.506254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55ee3b-9c1e-44dc-bfdc-302b0573b58b admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:52.516558 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1134/2264] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:40:52.520563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4e97e-bd40-495a-86d5-cfd54ea4e7b3 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:52.531093 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb4e97e-bd40-495a-86d5-cfd54ea4e7b3 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:52.535672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3cb0ff-9860-4acb-86d9-1a04e3106ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:52.536549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cb0ff-9860-4acb-86d9-1a04e3106ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:52.536994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cb0ff-9860-4acb-86d9-1a04e3106ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:52.537244 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3cb0ff-9860-4acb-86d9-1a04e3106ac1 admin admin] PATH_INFO: `/v3/projects/c8f73890a21a4703961838607cd8d5c8/users/9221f5d77e64478198cb1d50aedb49df/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:52.539718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:52.552937 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3cb0ff-9860-4acb-86d9-1a04e3106ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f73890a21a4703961838607cd8d5c8, user_id=9221f5d77e64478198cb1d50aedb49df, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:52.555731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3cb0ff-9860-4acb-86d9-1a04e3106ac1 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:52.625271 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1131/2265] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:40:52 2022] PUT /identity/v3/projects/c8f73890a21a4703961838607cd8d5c8/users/9221f5d77e64478198cb1d50aedb49df/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:40:52.631015 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fe227-0c34-4ff5-9a1b-41687ea8ea23 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:52.631310 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fe227-0c34-4ff5-9a1b-41687ea8ea23 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:52.631594 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fe227-0c34-4ff5-9a1b-41687ea8ea23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:52.648960 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-ae7fe227-0c34-4ff5-9a1b-41687ea8ea23 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:52.650200 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ae7fe227-0c34-4ff5-9a1b-41687ea8ea23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:52.710333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1135/2266] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:40:52.721411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3cb0ff-9860-4acb-86d9-1a04e3106ac1 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:52.723198 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-1b3cb0ff-9860-4acb-86d9-1a04e3106ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:52.790785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3cb0ff-9860-4acb-86d9-1a04e3106ac1 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:52.797515 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cbd6a-2158-4156-b0ca-cf75633fc03e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:52.797515 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cbd6a-2158-4156-b0ca-cf75633fc03e service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:52.797515 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cbd6a-2158-4156-b0ca-cf75633fc03e service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:52.797515 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cbd6a-2158-4156-b0ca-cf75633fc03e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:52.805882 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cbd6a-2158-4156-b0ca-cf75633fc03e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:52.807344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cbd6a-2158-4156-b0ca-cf75633fc03e service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:52.816910 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1132/2267] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:40:54.408853 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998b3d4-7d3b-41c7-83b9-bcb23542c2ba None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:54.408853 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998b3d4-7d3b-41c7-83b9-bcb23542c2ba None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:54.408853 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998b3d4-7d3b-41c7-83b9-bcb23542c2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:54.426301 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-b998b3d4-7d3b-41c7-83b9-bcb23542c2ba None None] MFA Rules not processed for user `22750d44d710439da1d18a78419b1adf`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:54.427833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b998b3d4-7d3b-41c7-83b9-bcb23542c2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:54.474734 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:54.500345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1136/2268] 10.222.0.57 () {58 vars in 967 bytes} [Thu Jul 21 08:40:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:40:54.518107 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cbd6a-2158-4156-b0ca-cf75633fc03e service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:54.520215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-446cbd6a-2158-4156-b0ca-cf75633fc03e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:54.604060 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cbd6a-2158-4156-b0ca-cf75633fc03e service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:54.610221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69641445-11a4-4cc5-bf30-22dcf9ef9414 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e349e5dfcd74406b922d3d1ce0fa5ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:54.610885 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69641445-11a4-4cc5-bf30-22dcf9ef9414 service swift] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:54.611180 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69641445-11a4-4cc5-bf30-22dcf9ef9414 service swift] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:54.611450 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69641445-11a4-4cc5-bf30-22dcf9ef9414 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:54.620596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69641445-11a4-4cc5-bf30-22dcf9ef9414 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:54.622314 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69641445-11a4-4cc5-bf30-22dcf9ef9414 service swift] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:54.631089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1133/2269] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 08:40:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:40:58.397175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0718919-c230-4a40-8c02-ab44d803d898 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:58.397768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0718919-c230-4a40-8c02-ab44d803d898 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:58.397768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0718919-c230-4a40-8c02-ab44d803d898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:58.426959 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-e0718919-c230-4a40-8c02-ab44d803d898 None None] MFA Rules not processed for user `9221f5d77e64478198cb1d50aedb49df`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:40:58.426959 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e0718919-c230-4a40-8c02-ab44d803d898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:40:58.492546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1137/2270] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:40:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:40:58.497028 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69641445-11a4-4cc5-bf30-22dcf9ef9414 service swift] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:58.507902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69641445-11a4-4cc5-bf30-22dcf9ef9414 service swift] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:58.512324 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3e76c-a883-4fe0-b358-21944d9192c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:58.512959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3e76c-a883-4fe0-b358-21944d9192c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:58.513238 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3e76c-a883-4fe0-b358-21944d9192c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:58.513518 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3e76c-a883-4fe0-b358-21944d9192c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:58.514233 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3e76c-a883-4fe0-b358-21944d9192c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:58.516131 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3e76c-a883-4fe0-b358-21944d9192c0 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:58.623953 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1134/2271] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:40:58 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:40:58.628461 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0718919-c230-4a40-8c02-ab44d803d898 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:58.639548 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0718919-c230-4a40-8c02-ab44d803d898 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:58.696828 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42836d0a-ca60-4d4a-b8a7-9f27c58abddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:58.697421 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42836d0a-ca60-4d4a-b8a7-9f27c58abddb admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:58.697737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42836d0a-ca60-4d4a-b8a7-9f27c58abddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:58.698013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42836d0a-ca60-4d4a-b8a7-9f27c58abddb admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:58.698699 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42836d0a-ca60-4d4a-b8a7-9f27c58abddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:58.700798 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42836d0a-ca60-4d4a-b8a7-9f27c58abddb admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:58.765470 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1138/2272] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:40:58 2022] POST /identity/v3/users => generated 299 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:40:58.769395 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3e76c-a883-4fe0-b358-21944d9192c0 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:58.779951 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3e76c-a883-4fe0-b358-21944d9192c0 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:58.785063 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f5038-41f5-4be0-9b6e-a0458fba1581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:58.785754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f5038-41f5-4be0-9b6e-a0458fba1581 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:58.786042 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f5038-41f5-4be0-9b6e-a0458fba1581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:58.786321 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f5038-41f5-4be0-9b6e-a0458fba1581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:58.793655 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f5038-41f5-4be0-9b6e-a0458fba1581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:58.793655 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f5038-41f5-4be0-9b6e-a0458fba1581 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:58.800270 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1135/2273] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:40:58.804326 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42836d0a-ca60-4d4a-b8a7-9f27c58abddb admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:58.814311 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42836d0a-ca60-4d4a-b8a7-9f27c58abddb admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:58.819087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaefdf3-c50b-45a5-a5bc-5b01435ef097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:58.819978 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaefdf3-c50b-45a5-a5bc-5b01435ef097 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:58.820265 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaefdf3-c50b-45a5-a5bc-5b01435ef097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:58.820548 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaefdf3-c50b-45a5-a5bc-5b01435ef097 admin admin] PATH_INFO: `/v3/projects/3f847fe770f745f1aef45f3545eaf390/users/1a6f412e7c3d418782843c2a38d73872/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:58.836697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaefdf3-c50b-45a5-a5bc-5b01435ef097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f847fe770f745f1aef45f3545eaf390, user_id=1a6f412e7c3d418782843c2a38d73872, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:58.839413 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaefdf3-c50b-45a5-a5bc-5b01435ef097 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:58.905501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1139/2274] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:40:58 2022] PUT /identity/v3/projects/3f847fe770f745f1aef45f3545eaf390/users/1a6f412e7c3d418782843c2a38d73872/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:40:58.910159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f5038-41f5-4be0-9b6e-a0458fba1581 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:58.920619 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f5038-41f5-4be0-9b6e-a0458fba1581 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:58.966430 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:40:58.984932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4028d4e-08f9-4b91-a2d7-122240c37aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:58.984932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4028d4e-08f9-4b91-a2d7-122240c37aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:58.985677 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4028d4e-08f9-4b91-a2d7-122240c37aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:58.986015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4028d4e-08f9-4b91-a2d7-122240c37aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:58.986759 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4028d4e-08f9-4b91-a2d7-122240c37aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:58.988391 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4028d4e-08f9-4b91-a2d7-122240c37aa1 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:59.000190 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1136/2275] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:40:59.004295 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaefdf3-c50b-45a5-a5bc-5b01435ef097 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:40:59.015423 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaefdf3-c50b-45a5-a5bc-5b01435ef097 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:40:59.020356 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949415d-d8aa-4e1d-9d7b-22484db4df7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:40:59.021332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949415d-d8aa-4e1d-9d7b-22484db4df7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:40:59.021726 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949415d-d8aa-4e1d-9d7b-22484db4df7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:40:59.022080 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949415d-d8aa-4e1d-9d7b-22484db4df7d admin admin] PATH_INFO: `/v3/projects/3f847fe770f745f1aef45f3545eaf390/users/1a6f412e7c3d418782843c2a38d73872/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:40:59.024156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949415d-d8aa-4e1d-9d7b-22484db4df7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f847fe770f745f1aef45f3545eaf390, user_id=1a6f412e7c3d418782843c2a38d73872, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:40:59.026954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949415d-d8aa-4e1d-9d7b-22484db4df7d admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:40:59.038101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1140/2276] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:40:59 2022] PUT /identity/v3/projects/3f847fe770f745f1aef45f3545eaf390/users/1a6f412e7c3d418782843c2a38d73872/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:41:04.513125 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585c1d0-0259-49d9-9e3e-946a16692304 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:41:04.514033 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585c1d0-0259-49d9-9e3e-946a16692304 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:41:04.514491 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585c1d0-0259-49d9-9e3e-946a16692304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:41:04.546945 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-e585c1d0-0259-49d9-9e3e-946a16692304 None None] MFA Rules not processed for user `1a6f412e7c3d418782843c2a38d73872`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:41:04.548321 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e585c1d0-0259-49d9-9e3e-946a16692304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:41:04.635805 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1137/2277] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:41:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:41:04.645234 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949415d-d8aa-4e1d-9d7b-22484db4df7d admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:41:04.646936 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-2949415d-d8aa-4e1d-9d7b-22484db4df7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:41:04.683330 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:41:04.710792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949415d-d8aa-4e1d-9d7b-22484db4df7d admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:41:04.715426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc5c90-f8e0-4a12-bd5f-48c82406b0ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b27a4861d6b4ddfaca1a97efdaf008d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:41:04.716012 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc5c90-f8e0-4a12-bd5f-48c82406b0ad service glance] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:41:04.716292 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc5c90-f8e0-4a12-bd5f-48c82406b0ad service glance] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:41:04.722725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc5c90-f8e0-4a12-bd5f-48c82406b0ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:41:04.780902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc5c90-f8e0-4a12-bd5f-48c82406b0ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:41:04.782453 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc5c90-f8e0-4a12-bd5f-48c82406b0ad service glance] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:41:04.792088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1141/2278] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:41:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:41:05.055102 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3709b1-8336-414b-8cd3-98a0a1d76148 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:41:05.055606 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3709b1-8336-414b-8cd3-98a0a1d76148 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:41:05.056035 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3709b1-8336-414b-8cd3-98a0a1d76148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:41:05.075910 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-6b3709b1-8336-414b-8cd3-98a0a1d76148 None None] MFA Rules not processed for user `22750d44d710439da1d18a78419b1adf`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:41:05.077433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-6b3709b1-8336-414b-8cd3-98a0a1d76148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:41:05.147182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1138/2279] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 08:41:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:41:05.163494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc5c90-f8e0-4a12-bd5f-48c82406b0ad service glance] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:41:05.238791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc5c90-f8e0-4a12-bd5f-48c82406b0ad service glance] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:41:05.244258 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70c06e-27c6-43b5-94d5-ecde976ec05c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e349e5dfcd74406b922d3d1ce0fa5ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:41:05.244999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70c06e-27c6-43b5-94d5-ecde976ec05c service swift] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:41:05.245359 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70c06e-27c6-43b5-94d5-ecde976ec05c service swift] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:41:05.245746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70c06e-27c6-43b5-94d5-ecde976ec05c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:41:05.255379 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70c06e-27c6-43b5-94d5-ecde976ec05c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:41:05.257104 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70c06e-27c6-43b5-94d5-ecde976ec05c service swift] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:41:05.266191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1142/2280] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 08:41:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:41:12.991726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3709b1-8336-414b-8cd3-98a0a1d76148 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:41:12.994097 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-6b3709b1-8336-414b-8cd3-98a0a1d76148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:41:13.214862 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3709b1-8336-414b-8cd3-98a0a1d76148 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:41:13.233204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac4ece-616c-46fa-9cbb-def122b9e43f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38b7e84d6a43efbb4c1a52e2b3e681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:41:13.234370 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac4ece-616c-46fa-9cbb-def122b9e43f service placement] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:41:13.235519 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac4ece-616c-46fa-9cbb-def122b9e43f service placement] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:41:13.236010 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac4ece-616c-46fa-9cbb-def122b9e43f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:41:13.242723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-9cac4ece-616c-46fa-9cbb-def122b9e43f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:41:13.264187 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac4ece-616c-46fa-9cbb-def122b9e43f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:41:13.266300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac4ece-616c-46fa-9cbb-def122b9e43f service placement] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:41:13.271547 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:41:13.279115 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1139/2281] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:41:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:41:15.262540 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=65 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:41:17.277447 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58f683-fda3-461c-bd42-cb9384d31578 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:41:17.278191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58f683-fda3-461c-bd42-cb9384d31578 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:41:17.278191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58f683-fda3-461c-bd42-cb9384d31578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:41:17.295804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-be58f683-fda3-461c-bd42-cb9384d31578 None None] MFA Rules not processed for user `9221f5d77e64478198cb1d50aedb49df`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:41:17.297559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-be58f683-fda3-461c-bd42-cb9384d31578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:41:17.305411 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1143/2282] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:41:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:41:20.933504 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ffa7c-39e2-4325-9fd0-3a0d703dd545 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:41:20.934082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ffa7c-39e2-4325-9fd0-3a0d703dd545 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:41:20.934082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ffa7c-39e2-4325-9fd0-3a0d703dd545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:41:20.961008 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-c97ffa7c-39e2-4325-9fd0-3a0d703dd545 None None] MFA Rules not processed for user `22750d44d710439da1d18a78419b1adf`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:41:20.962262 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-c97ffa7c-39e2-4325-9fd0-3a0d703dd545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:41:20.969911 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1140/2283] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 08:41:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:41:20.985169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58f683-fda3-461c-bd42-cb9384d31578 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:41:20.997459 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58f683-fda3-461c-bd42-cb9384d31578 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:41:21.003289 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b02576-52a1-43c3-a6c1-8750ac624a87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e349e5dfcd74406b922d3d1ce0fa5ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:41:21.003923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b02576-52a1-43c3-a6c1-8750ac624a87 service swift] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:41:21.004207 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b02576-52a1-43c3-a6c1-8750ac624a87 service swift] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:41:21.004484 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b02576-52a1-43c3-a6c1-8750ac624a87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:41:21.012479 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b02576-52a1-43c3-a6c1-8750ac624a87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:41:21.014101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b02576-52a1-43c3-a6c1-8750ac624a87 service swift] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:41:21.024969 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1144/2284] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 08:41:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:41:30.954427 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=4 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:41:31.019757 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=9 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:41:45.308304 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d666342-7ec6-4c2f-8b97-ff86cf5db62c None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:41:45.308807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d666342-7ec6-4c2f-8b97-ff86cf5db62c None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:41:45.308947 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d666342-7ec6-4c2f-8b97-ff86cf5db62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:41:45.326689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-9d666342-7ec6-4c2f-8b97-ff86cf5db62c None None] MFA Rules not processed for user `fb4b22bc322c419bab3445f7dfb186fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:41:45.328375 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-9d666342-7ec6-4c2f-8b97-ff86cf5db62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:41:45.387297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1141/2285] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:41:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:41:49.139389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d55df-44ae-4fe4-8c68-7a3fcab893b7 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:41:49.140057 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d55df-44ae-4fe4-8c68-7a3fcab893b7 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:41:49.140057 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d55df-44ae-4fe4-8c68-7a3fcab893b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:41:49.163121 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-432d55df-44ae-4fe4-8c68-7a3fcab893b7 None None] MFA Rules not processed for user `a8e20ceefdcd48c88cf35ecf0bcd736b`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:41:49.164390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-432d55df-44ae-4fe4-8c68-7a3fcab893b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:41:49.220405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1145/2286] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:41:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:41:55.378735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=25 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:41:56.410916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d666342-7ec6-4c2f-8b97-ff86cf5db62c None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:41:56.412559 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-9d666342-7ec6-4c2f-8b97-ff86cf5db62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:41:56.473123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d666342-7ec6-4c2f-8b97-ff86cf5db62c None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:41:56.477268 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67acf7e-e05e-4a02-8f79-a6a592cec59f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:41:56.477959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67acf7e-e05e-4a02-8f79-a6a592cec59f service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:41:56.479113 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67acf7e-e05e-4a02-8f79-a6a592cec59f service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:41:56.479414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67acf7e-e05e-4a02-8f79-a6a592cec59f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:41:56.489471 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67acf7e-e05e-4a02-8f79-a6a592cec59f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:41:56.490961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67acf7e-e05e-4a02-8f79-a6a592cec59f service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:41:56.503677 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1142/2287] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:41:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:41:59.212730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=25 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:06.497647 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=26 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:08.562443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ecd69-4aaa-4eaf-a133-a686ae794ea4 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:08.563067 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ecd69-4aaa-4eaf-a133-a686ae794ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:08.563067 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ecd69-4aaa-4eaf-a133-a686ae794ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:08.582341 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-9b5ecd69-4aaa-4eaf-a133-a686ae794ea4 None None] MFA Rules not processed for user `017d2074ad8742ca8bd156593c591b5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:42:08.583686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9b5ecd69-4aaa-4eaf-a133-a686ae794ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:08.647810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1146/2288] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:42:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:42:18.640524 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=25 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:25.143162 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67acf7e-e05e-4a02-8f79-a6a592cec59f service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:25.151986 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67acf7e-e05e-4a02-8f79-a6a592cec59f service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:25.155633 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbfa98-aeb8-4e51-b2dc-87809b67b6ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:25.156262 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbfa98-aeb8-4e51-b2dc-87809b67b6ba service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:25.156547 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbfa98-aeb8-4e51-b2dc-87809b67b6ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:25.156827 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbfa98-aeb8-4e51-b2dc-87809b67b6ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:25.158746 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-adbbfa98-aeb8-4e51-b2dc-87809b67b6ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:25.231624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbfa98-aeb8-4e51-b2dc-87809b67b6ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:25.233306 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbfa98-aeb8-4e51-b2dc-87809b67b6ba service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:25.245427 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1143/2289] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:42:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:42:28.789935 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ecd69-4aaa-4eaf-a133-a686ae794ea4 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:28.800128 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ecd69-4aaa-4eaf-a133-a686ae794ea4 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:28.803779 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760ef9f-ded2-4135-aa18-6aa7bd7dbf47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:28.804415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760ef9f-ded2-4135-aa18-6aa7bd7dbf47 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:28.804699 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760ef9f-ded2-4135-aa18-6aa7bd7dbf47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:28.805004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760ef9f-ded2-4135-aa18-6aa7bd7dbf47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:28.806794 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7760ef9f-ded2-4135-aa18-6aa7bd7dbf47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:28.820359 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760ef9f-ded2-4135-aa18-6aa7bd7dbf47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:28.821804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7760ef9f-ded2-4135-aa18-6aa7bd7dbf47 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:28.832717 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1147/2290] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:42:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:42:35.240242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=34 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:38.827866 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=6 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:42:47.671732 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbfa98-aeb8-4e51-b2dc-87809b67b6ba service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:47.673369 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-adbbfa98-aeb8-4e51-b2dc-87809b67b6ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:47.687160 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbfa98-aeb8-4e51-b2dc-87809b67b6ba service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:47.692877 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5276152-096b-4273-9454-17b4b896a0a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:47.693534 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5276152-096b-4273-9454-17b4b896a0a6 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:47.693837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5276152-096b-4273-9454-17b4b896a0a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:47.694114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5276152-096b-4273-9454-17b4b896a0a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:47.695866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-a5276152-096b-4273-9454-17b4b896a0a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:47.706560 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5276152-096b-4273-9454-17b4b896a0a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:47.708152 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5276152-096b-4273-9454-17b4b896a0a6 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:47.716984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1144/2291] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:42:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:42:51.297232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760ef9f-ded2-4135-aa18-6aa7bd7dbf47 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:51.308895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760ef9f-ded2-4135-aa18-6aa7bd7dbf47 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:51.314971 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcb8a6-d41a-4eda-b736-1ac957c675a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:51.315637 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcb8a6-d41a-4eda-b736-1ac957c675a2 service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:51.315921 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcb8a6-d41a-4eda-b736-1ac957c675a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:51.316197 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcb8a6-d41a-4eda-b736-1ac957c675a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:51.317986 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-4cfcb8a6-d41a-4eda-b736-1ac957c675a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:51.330458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcb8a6-d41a-4eda-b736-1ac957c675a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:51.332139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcb8a6-d41a-4eda-b736-1ac957c675a2 service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:51.341241 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1148/2292] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:42:51 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:42:54.670919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5276152-096b-4273-9454-17b4b896a0a6 service nova] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:42:54.672300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-a5276152-096b-4273-9454-17b4b896a0a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:54.728732 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5276152-096b-4273-9454-17b4b896a0a6 service nova] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:42:54.732717 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f5f392-cd41-4d68-ad5d-670a54e0ea29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:42:54.733358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5f392-cd41-4d68-ad5d-670a54e0ea29 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:42:54.733680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5f392-cd41-4d68-ad5d-670a54e0ea29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:42:54.733962 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f5f392-cd41-4d68-ad5d-670a54e0ea29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:42:54.735729 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e5f5f392-cd41-4d68-ad5d-670a54e0ea29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:42:54.747194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5f392-cd41-4d68-ad5d-670a54e0ea29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:42:54.748637 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f5f392-cd41-4d68-ad5d-670a54e0ea29 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:42:54.758490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1145/2293] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:42:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:43:01.337188 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=6 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:04.678882 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcb8a6-d41a-4eda-b736-1ac957c675a2 service nova] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:04.680742 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-4cfcb8a6-d41a-4eda-b736-1ac957c675a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:04.695778 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcb8a6-d41a-4eda-b736-1ac957c675a2 service nova] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:04.703160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec17c34-1fc5-4010-b7b6-0aa2e86a469a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:04.709844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec17c34-1fc5-4010-b7b6-0aa2e86a469a service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:04.709844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec17c34-1fc5-4010-b7b6-0aa2e86a469a service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:04.709844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec17c34-1fc5-4010-b7b6-0aa2e86a469a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:04.709844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-0ec17c34-1fc5-4010-b7b6-0aa2e86a469a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:04.719807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec17c34-1fc5-4010-b7b6-0aa2e86a469a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:04.722384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec17c34-1fc5-4010-b7b6-0aa2e86a469a service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:04.754231 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=32 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:04.756765 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1149/2294] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:43:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:43:12.737648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134dac3-8493-42d3-a977-dd479048d6cc None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:12.738116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134dac3-8493-42d3-a977-dd479048d6cc None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:12.738208 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134dac3-8493-42d3-a977-dd479048d6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:12.755266 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-d134dac3-8493-42d3-a977-dd479048d6cc None None] MFA Rules not processed for user `fb4b22bc322c419bab3445f7dfb186fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:12.756479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-d134dac3-8493-42d3-a977-dd479048d6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:12.763439 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1146/2295] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:43:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:43:13.065993 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec17c34-1fc5-4010-b7b6-0aa2e86a469a service nova] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:13.075215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec17c34-1fc5-4010-b7b6-0aa2e86a469a service nova] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:13.078892 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e186c2-8478-45a6-bdd9-848560ddeaf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:13.079532 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e186c2-8478-45a6-bdd9-848560ddeaf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:13.079860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e186c2-8478-45a6-bdd9-848560ddeaf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:13.080126 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e186c2-8478-45a6-bdd9-848560ddeaf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:13.082016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-76e186c2-8478-45a6-bdd9-848560ddeaf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:13.092147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e186c2-8478-45a6-bdd9-848560ddeaf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:13.093618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e186c2-8478-45a6-bdd9-848560ddeaf6 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:13.101861 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1150/2296] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:43:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:43:13.517356 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134dac3-8493-42d3-a977-dd479048d6cc None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:13.519220 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-d134dac3-8493-42d3-a977-dd479048d6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:13.535565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134dac3-8493-42d3-a977-dd479048d6cc None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:13.543162 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daadf07-14f4-4ecf-aefc-992773ecff84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38b7e84d6a43efbb4c1a52e2b3e681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:13.543834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daadf07-14f4-4ecf-aefc-992773ecff84 service placement] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:13.544119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daadf07-14f4-4ecf-aefc-992773ecff84 service placement] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:13.544397 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daadf07-14f4-4ecf-aefc-992773ecff84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:13.549273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4daadf07-14f4-4ecf-aefc-992773ecff84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:13.564490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daadf07-14f4-4ecf-aefc-992773ecff84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:13.566136 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daadf07-14f4-4ecf-aefc-992773ecff84 service placement] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:13.576162 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1147/2297] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:43:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:43:14.687684 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f892c4d-4105-462d-b897-27864b4ecd48 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:14.691577 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f892c4d-4105-462d-b897-27864b4ecd48 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:14.691577 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f892c4d-4105-462d-b897-27864b4ecd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:14.712147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-5f892c4d-4105-462d-b897-27864b4ecd48 None None] MFA Rules not processed for user `22750d44d710439da1d18a78419b1adf`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:14.713368 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-5f892c4d-4105-462d-b897-27864b4ecd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:14.722322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1151/2298] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 08:43:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:43:14.768502 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daadf07-14f4-4ecf-aefc-992773ecff84 service placement] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:14.779830 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daadf07-14f4-4ecf-aefc-992773ecff84 service placement] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:14.785363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab16e6-f96f-42d2-80e5-2a857969b853 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e349e5dfcd74406b922d3d1ce0fa5ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:14.786092 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab16e6-f96f-42d2-80e5-2a857969b853 service swift] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:14.786367 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab16e6-f96f-42d2-80e5-2a857969b853 service swift] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:14.786814 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab16e6-f96f-42d2-80e5-2a857969b853 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:14.795817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab16e6-f96f-42d2-80e5-2a857969b853 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:14.797410 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab16e6-f96f-42d2-80e5-2a857969b853 service swift] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:14.806803 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1148/2299] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 08:43:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:43:17.109635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f892c4d-4105-462d-b897-27864b4ecd48 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:17.124045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f892c4d-4105-462d-b897-27864b4ecd48 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:17.127900 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5a916-b9de-471a-8b5b-d28f6210de90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:17.128548 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5a916-b9de-471a-8b5b-d28f6210de90 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:17.128833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5a916-b9de-471a-8b5b-d28f6210de90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:17.129108 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5a916-b9de-471a-8b5b-d28f6210de90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:17.143471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-72e5a916-b9de-471a-8b5b-d28f6210de90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:17.155933 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5a916-b9de-471a-8b5b-d28f6210de90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:17.157590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5a916-b9de-471a-8b5b-d28f6210de90 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:17.184132 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1152/2300] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:43:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:43:24.259187 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab16e6-f96f-42d2-80e5-2a857969b853 service swift] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:24.287313 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab16e6-f96f-42d2-80e5-2a857969b853 service swift] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:24.299771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f851639-3cac-4675-8aa7-76e5dabc8d18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:24.301669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f851639-3cac-4675-8aa7-76e5dabc8d18 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:24.302737 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f851639-3cac-4675-8aa7-76e5dabc8d18 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:24.305598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f851639-3cac-4675-8aa7-76e5dabc8d18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:24.307997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-1f851639-3cac-4675-8aa7-76e5dabc8d18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:24.340637 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f851639-3cac-4675-8aa7-76e5dabc8d18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:24.342274 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f851639-3cac-4675-8aa7-76e5dabc8d18 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:24.358995 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1149/2301] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:43:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:43:27.003715 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5a916-b9de-471a-8b5b-d28f6210de90 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:27.012853 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5a916-b9de-471a-8b5b-d28f6210de90 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:27.016851 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e453dcc-d3a9-4f1c-9795-45b8918b6fb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:27.017495 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e453dcc-d3a9-4f1c-9795-45b8918b6fb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:27.017837 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e453dcc-d3a9-4f1c-9795-45b8918b6fb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:27.018652 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e453dcc-d3a9-4f1c-9795-45b8918b6fb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:27.020497 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-4e453dcc-d3a9-4f1c-9795-45b8918b6fb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:27.095256 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e453dcc-d3a9-4f1c-9795-45b8918b6fb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:27.097140 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e453dcc-d3a9-4f1c-9795-45b8918b6fb1 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:27.109953 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1153/2302] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:43:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:43:28.288295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f851639-3cac-4675-8aa7-76e5dabc8d18 service nova] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:28.303366 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f851639-3cac-4675-8aa7-76e5dabc8d18 service nova] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:28.311481 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996e078-e460-437e-928a-92e312657282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:28.312589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996e078-e460-437e-928a-92e312657282 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:28.312816 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996e078-e460-437e-928a-92e312657282 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:28.313097 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2996e078-e460-437e-928a-92e312657282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:28.315050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2996e078-e460-437e-928a-92e312657282 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:28.333429 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996e078-e460-437e-928a-92e312657282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:28.335788 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2996e078-e460-437e-928a-92e312657282 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:28.351049 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1150/2303] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:43:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:43:31.315457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e453dcc-d3a9-4f1c-9795-45b8918b6fb1 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:31.331289 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e453dcc-d3a9-4f1c-9795-45b8918b6fb1 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:31.336986 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d00564-1c5e-4edc-a942-7aa308b799b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38b7e84d6a43efbb4c1a52e2b3e681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:31.339020 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d00564-1c5e-4edc-a942-7aa308b799b0 service placement] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:31.339020 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d00564-1c5e-4edc-a942-7aa308b799b0 service placement] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:31.339020 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d00564-1c5e-4edc-a942-7aa308b799b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:31.340898 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a6d00564-1c5e-4edc-a942-7aa308b799b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:31.356803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d00564-1c5e-4edc-a942-7aa308b799b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:31.359308 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d00564-1c5e-4edc-a942-7aa308b799b0 service placement] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:31.372658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1154/2304] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:43:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:43:31.462717 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996e078-e460-437e-928a-92e312657282 service nova] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:31.462717 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2996e078-e460-437e-928a-92e312657282 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:31.484387 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2996e078-e460-437e-928a-92e312657282 service nova] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:31.490038 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba58b2-d841-4e46-b7db-8ab18cc96c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:31.491273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba58b2-d841-4e46-b7db-8ab18cc96c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:31.491386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba58b2-d841-4e46-b7db-8ab18cc96c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:31.491661 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba58b2-d841-4e46-b7db-8ab18cc96c44 admin admin] PATH_INFO: `/v3/users/017d2074ad8742ca8bd156593c591b5b` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:31.492886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba58b2-d841-4e46-b7db-8ab18cc96c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=017d2074ad8742ca8bd156593c591b5b)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:31.494877 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba58b2-d841-4e46-b7db-8ab18cc96c44 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:31.672784 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-04ba58b2-d841-4e46-b7db-8ab18cc96c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '017d2074ad8742ca8bd156593c591b5b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:31.698284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036375d-3023-40cf-aab0-0d7c7046bcff None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:31.698507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036375d-3023-40cf-aab0-0d7c7046bcff None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:31.699543 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036375d-3023-40cf-aab0-0d7c7046bcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:31.699695 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-04ba58b2-d841-4e46-b7db-8ab18cc96c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '017d2074ad8742ca8bd156593c591b5b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:31.707531 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=58 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:31.709256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-04ba58b2-d841-4e46-b7db-8ab18cc96c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '017d2074ad8742ca8bd156593c591b5b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:31.710075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-04ba58b2-d841-4e46-b7db-8ab18cc96c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '017d2074ad8742ca8bd156593c591b5b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:31.710745 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-04ba58b2-d841-4e46-b7db-8ab18cc96c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '017d2074ad8742ca8bd156593c591b5b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:31.722502 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-5036375d-3023-40cf-aab0-0d7c7046bcff None None] MFA Rules not processed for user `b9ee38a03587412c93da307525e83851`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:31.723722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-5036375d-3023-40cf-aab0-0d7c7046bcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:31.795521 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1155/2305] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:43:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:43:31.811148 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1151/2306] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:43:31 2022] DELETE /identity/v3/users/017d2074ad8742ca8bd156593c591b5b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:43:32.210418 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036375d-3023-40cf-aab0-0d7c7046bcff None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:32.211817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-5036375d-3023-40cf-aab0-0d7c7046bcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:32.223755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036375d-3023-40cf-aab0-0d7c7046bcff None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:32.246320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba58b2-d841-4e46-b7db-8ab18cc96c44 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:32.247852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-04ba58b2-d841-4e46-b7db-8ab18cc96c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:32.292146 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d821c-d638-4126-b10a-28fef412e15d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:32.292902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d821c-d638-4126-b10a-28fef412e15d service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:32.293259 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d821c-d638-4126-b10a-28fef412e15d service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:32.293668 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d821c-d638-4126-b10a-28fef412e15d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:32.295545 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-3e5d821c-d638-4126-b10a-28fef412e15d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:32.306105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d821c-d638-4126-b10a-28fef412e15d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:32.307731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d821c-d638-4126-b10a-28fef412e15d service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:32.316403 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1156/2307] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:43:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:43:32.325911 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba58b2-d841-4e46-b7db-8ab18cc96c44 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:32.330552 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901e803-a3f6-4cb7-98d6-82432414279e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:32.331648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901e803-a3f6-4cb7-98d6-82432414279e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:32.331928 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901e803-a3f6-4cb7-98d6-82432414279e admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:32.332205 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901e803-a3f6-4cb7-98d6-82432414279e admin admin] PATH_INFO: `/v3/projects/3808138b7b69440c88602c8ad2e5642c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:32.333392 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901e803-a3f6-4cb7-98d6-82432414279e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3808138b7b69440c88602c8ad2e5642c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:32.335354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901e803-a3f6-4cb7-98d6-82432414279e admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:32.351311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:32.443709 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3901e803-a3f6-4cb7-98d6-82432414279e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3808138b7b69440c88602c8ad2e5642c', 'request_id': 'req-3901e803-a3f6-4cb7-98d6-82432414279e'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:32.452348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3901e803-a3f6-4cb7-98d6-82432414279e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3808138b7b69440c88602c8ad2e5642c', 'request_id': 'req-3901e803-a3f6-4cb7-98d6-82432414279e'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:32.458365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3901e803-a3f6-4cb7-98d6-82432414279e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3808138b7b69440c88602c8ad2e5642c', 'request_id': 'req-3901e803-a3f6-4cb7-98d6-82432414279e'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:32.534236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3901e803-a3f6-4cb7-98d6-82432414279e admin admin] The token cache is being invalidate because project 3808138b7b69440c88602c8ad2e5642c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:43:32.546779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3901e803-a3f6-4cb7-98d6-82432414279e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:32.546779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3901e803-a3f6-4cb7-98d6-82432414279e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:32.546779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1152/2308] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:43:32 2022] DELETE /identity/v3/projects/3808138b7b69440c88602c8ad2e5642c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:43:32.547192 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729afaaf-6f20-4637-a649-6444809e41b8 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:32.547192 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729afaaf-6f20-4637-a649-6444809e41b8 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:32.547192 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729afaaf-6f20-4637-a649-6444809e41b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:32.563143 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-729afaaf-6f20-4637-a649-6444809e41b8 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:32.565762 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-729afaaf-6f20-4637-a649-6444809e41b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:32.645407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1157/2309] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:43:32.653920 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bd6d0-24f8-4c81-9c8a-7f9351dcc4ae None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:32.654297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bd6d0-24f8-4c81-9c8a-7f9351dcc4ae None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:32.654642 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046bd6d0-24f8-4c81-9c8a-7f9351dcc4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:32.674651 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-046bd6d0-24f8-4c81-9c8a-7f9351dcc4ae None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:32.676108 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-046bd6d0-24f8-4c81-9c8a-7f9351dcc4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:32.684563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1153/2310] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:43:32.688826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729afaaf-6f20-4637-a649-6444809e41b8 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:32.700271 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729afaaf-6f20-4637-a649-6444809e41b8 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:32.705799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c3ff2-0db9-4fbf-bf54-0291b75a7d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:32.706468 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c3ff2-0db9-4fbf-bf54-0291b75a7d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:32.706747 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c3ff2-0db9-4fbf-bf54-0291b75a7d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:32.707022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3c3ff2-0db9-4fbf-bf54-0291b75a7d1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:32.707760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c3ff2-0db9-4fbf-bf54-0291b75a7d1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:43:32.708100 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c3ff2-0db9-4fbf-bf54-0291b75a7d1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:32.709759 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3c3ff2-0db9-4fbf-bf54-0291b75a7d1a admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:32.724360 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1158/2311] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:43:32.733402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bd6d0-24f8-4c81-9c8a-7f9351dcc4ae None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:32.747765 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046bd6d0-24f8-4c81-9c8a-7f9351dcc4ae None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:32.758463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5883a80-5e0f-4520-b02a-582c9af509d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:32.759189 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5883a80-5e0f-4520-b02a-582c9af509d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:32.759479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5883a80-5e0f-4520-b02a-582c9af509d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:32.759753 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5883a80-5e0f-4520-b02a-582c9af509d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:32.763926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5883a80-5e0f-4520-b02a-582c9af509d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:32.763926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5883a80-5e0f-4520-b02a-582c9af509d5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:32.860215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1154/2312] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:43:32 2022] POST /identity/v3/projects => generated 367 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:43:32.870296 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c3ff2-0db9-4fbf-bf54-0291b75a7d1a admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:32.885993 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3c3ff2-0db9-4fbf-bf54-0291b75a7d1a admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:32.944655 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:32.998646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c51300-2496-4c8b-a1ed-7093af461df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:32.999338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c51300-2496-4c8b-a1ed-7093af461df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:32.999694 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c51300-2496-4c8b-a1ed-7093af461df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:33.000037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c51300-2496-4c8b-a1ed-7093af461df3 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:33.000816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c51300-2496-4c8b-a1ed-7093af461df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:33.004107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c51300-2496-4c8b-a1ed-7093af461df3 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:33.129113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1159/2313] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:43:32 2022] POST /identity/v3/users => generated 284 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:43:33.133005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5883a80-5e0f-4520-b02a-582c9af509d5 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:33.143374 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5883a80-5e0f-4520-b02a-582c9af509d5 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:33.147871 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f9da5-c78a-40ec-bf31-045c427276c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:33.148521 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f9da5-c78a-40ec-bf31-045c427276c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:33.148800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f9da5-c78a-40ec-bf31-045c427276c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:33.149072 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f9da5-c78a-40ec-bf31-045c427276c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:33.149828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f9da5-c78a-40ec-bf31-045c427276c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:33.151411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f9da5-c78a-40ec-bf31-045c427276c4 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:33.161952 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1155/2314] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:43:33.167311 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c51300-2496-4c8b-a1ed-7093af461df3 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:33.178550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c51300-2496-4c8b-a1ed-7093af461df3 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:33.183269 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7a35b-fc41-4181-ae63-4b5313fc0539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:33.183959 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7a35b-fc41-4181-ae63-4b5313fc0539 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:33.184247 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7a35b-fc41-4181-ae63-4b5313fc0539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:33.184521 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7a35b-fc41-4181-ae63-4b5313fc0539 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:33.185320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7a35b-fc41-4181-ae63-4b5313fc0539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:33.188571 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7a35b-fc41-4181-ae63-4b5313fc0539 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:33.201709 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1160/2315] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:43:33.205704 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f9da5-c78a-40ec-bf31-045c427276c4 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:33.218893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f9da5-c78a-40ec-bf31-045c427276c4 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:33.232594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc2ed7-e595-4ee7-b765-9399a4982519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:33.233505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc2ed7-e595-4ee7-b765-9399a4982519 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:33.233820 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc2ed7-e595-4ee7-b765-9399a4982519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:33.238789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc2ed7-e595-4ee7-b765-9399a4982519 admin admin] PATH_INFO: `/v3/projects/410a452da7ea4a28946086fda534e2a2/users/0b38e4014a7e4cc0ae14fb527768427a/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:33.253913 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc2ed7-e595-4ee7-b765-9399a4982519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=410a452da7ea4a28946086fda534e2a2, user_id=0b38e4014a7e4cc0ae14fb527768427a, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:33.257077 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc2ed7-e595-4ee7-b765-9399a4982519 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:33.357986 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1156/2316] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:43:33 2022] PUT /identity/v3/projects/410a452da7ea4a28946086fda534e2a2/users/0b38e4014a7e4cc0ae14fb527768427a/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:43:33.368060 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cef6f2-cffe-4a28-9c62-0e5208c3e632 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:33.368509 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cef6f2-cffe-4a28-9c62-0e5208c3e632 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:33.368509 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cef6f2-cffe-4a28-9c62-0e5208c3e632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:33.407653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-a6cef6f2-cffe-4a28-9c62-0e5208c3e632 None None] MFA Rules not processed for user `0b38e4014a7e4cc0ae14fb527768427a`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:33.409863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a6cef6f2-cffe-4a28-9c62-0e5208c3e632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:33.492666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1161/2317] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:43:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:43:33.497306 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc2ed7-e595-4ee7-b765-9399a4982519 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:33.558817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc2ed7-e595-4ee7-b765-9399a4982519 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:33.563414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe842551-396a-488c-897f-21eb51616aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:33.564066 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe842551-396a-488c-897f-21eb51616aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:33.564349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe842551-396a-488c-897f-21eb51616aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:33.565124 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe842551-396a-488c-897f-21eb51616aa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:33.565837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe842551-396a-488c-897f-21eb51616aa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:33.567744 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe842551-396a-488c-897f-21eb51616aa2 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:33.690384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1157/2318] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:43:33 2022] POST /identity/v3/projects => generated 369 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:43:33.694379 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cef6f2-cffe-4a28-9c62-0e5208c3e632 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:33.705330 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cef6f2-cffe-4a28-9c62-0e5208c3e632 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:33.778665 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe66f3-fed8-4a62-b63b-8a1e1bd52e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:33.779011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe66f3-fed8-4a62-b63b-8a1e1bd52e25 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:33.779299 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe66f3-fed8-4a62-b63b-8a1e1bd52e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:33.783897 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe66f3-fed8-4a62-b63b-8a1e1bd52e25 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:33.783897 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe66f3-fed8-4a62-b63b-8a1e1bd52e25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:33.783897 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe66f3-fed8-4a62-b63b-8a1e1bd52e25 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:33.897557 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1162/2319] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:43:33 2022] POST /identity/v3/users => generated 291 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:43:33.900742 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe842551-396a-488c-897f-21eb51616aa2 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:33.911334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe842551-396a-488c-897f-21eb51616aa2 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:33.916983 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e4762-87b7-4f8c-a71a-17ce90784700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:33.918043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e4762-87b7-4f8c-a71a-17ce90784700 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:33.918330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e4762-87b7-4f8c-a71a-17ce90784700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:33.918604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e4762-87b7-4f8c-a71a-17ce90784700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:33.919334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350e4762-87b7-4f8c-a71a-17ce90784700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:33.920974 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350e4762-87b7-4f8c-a71a-17ce90784700 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:33.936378 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1158/2320] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:43:33.937636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe66f3-fed8-4a62-b63b-8a1e1bd52e25 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:33.948643 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe66f3-fed8-4a62-b63b-8a1e1bd52e25 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:33.953718 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da2d25-6c3f-47fd-a45e-5f4452c28681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:33.954800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da2d25-6c3f-47fd-a45e-5f4452c28681 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:33.955090 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da2d25-6c3f-47fd-a45e-5f4452c28681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:33.955394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da2d25-6c3f-47fd-a45e-5f4452c28681 admin admin] PATH_INFO: `/v3/projects/6ccf15a14c084bf091f0d3f537c40274/users/f660ee76af714ea28f18d3ed5015c830/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:33.971681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da2d25-6c3f-47fd-a45e-5f4452c28681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ccf15a14c084bf091f0d3f537c40274, user_id=f660ee76af714ea28f18d3ed5015c830, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:33.974775 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da2d25-6c3f-47fd-a45e-5f4452c28681 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:34.054872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1163/2321] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:43:33 2022] PUT /identity/v3/projects/6ccf15a14c084bf091f0d3f537c40274/users/f660ee76af714ea28f18d3ed5015c830/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:43:34.057720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e4762-87b7-4f8c-a71a-17ce90784700 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:34.075978 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e4762-87b7-4f8c-a71a-17ce90784700 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:34.098118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:34.186302 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa6450-16b3-4d57-84f5-9636a271ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:34.187039 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa6450-16b3-4d57-84f5-9636a271ce17 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:34.187324 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa6450-16b3-4d57-84f5-9636a271ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:34.187598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa6450-16b3-4d57-84f5-9636a271ce17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:34.188335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa6450-16b3-4d57-84f5-9636a271ce17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:34.190757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa6450-16b3-4d57-84f5-9636a271ce17 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:34.209888 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1159/2322] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:43:34.211193 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da2d25-6c3f-47fd-a45e-5f4452c28681 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:34.225778 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da2d25-6c3f-47fd-a45e-5f4452c28681 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:34.232196 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb758d1-96cd-4ecd-a65e-4eb69a8ddc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:34.233118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb758d1-96cd-4ecd-a65e-4eb69a8ddc61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:34.233461 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb758d1-96cd-4ecd-a65e-4eb69a8ddc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:34.233874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb758d1-96cd-4ecd-a65e-4eb69a8ddc61 admin admin] PATH_INFO: `/v3/projects/6ccf15a14c084bf091f0d3f537c40274/users/f660ee76af714ea28f18d3ed5015c830/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:34.236174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb758d1-96cd-4ecd-a65e-4eb69a8ddc61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ccf15a14c084bf091f0d3f537c40274, user_id=f660ee76af714ea28f18d3ed5015c830, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:34.239233 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb758d1-96cd-4ecd-a65e-4eb69a8ddc61 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:34.245342 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:34.252033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1164/2323] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:43:34 2022] PUT /identity/v3/projects/6ccf15a14c084bf091f0d3f537c40274/users/f660ee76af714ea28f18d3ed5015c830/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:43:34.262505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c445486-15af-41b8-ba09-bdc5a8fb619a None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:34.263492 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c445486-15af-41b8-ba09-bdc5a8fb619a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:34.263979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c445486-15af-41b8-ba09-bdc5a8fb619a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:34.299770 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-4c445486-15af-41b8-ba09-bdc5a8fb619a None None] MFA Rules not processed for user `f660ee76af714ea28f18d3ed5015c830`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:34.302114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4c445486-15af-41b8-ba09-bdc5a8fb619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:34.398857 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1160/2324] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:43:34 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:43:34.412347 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb758d1-96cd-4ecd-a65e-4eb69a8ddc61 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:34.414570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-5fb758d1-96cd-4ecd-a65e-4eb69a8ddc61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:34.483387 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb758d1-96cd-4ecd-a65e-4eb69a8ddc61 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:34.487070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5b40e-67ac-458a-989b-181a22f8471f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:34.487715 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5b40e-67ac-458a-989b-181a22f8471f service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:34.488028 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5b40e-67ac-458a-989b-181a22f8471f service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:34.488304 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5b40e-67ac-458a-989b-181a22f8471f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:34.498569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5b40e-67ac-458a-989b-181a22f8471f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:34.500056 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5b40e-67ac-458a-989b-181a22f8471f service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:34.510863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1165/2325] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:43:34 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:43:34.629739 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c445486-15af-41b8-ba09-bdc5a8fb619a None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:34.631191 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4c445486-15af-41b8-ba09-bdc5a8fb619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:34.643222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c445486-15af-41b8-ba09-bdc5a8fb619a None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:34.650676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8cfef-95b5-40d7-a3a0-bbb53240fbe0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:34.650676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8cfef-95b5-40d7-a3a0-bbb53240fbe0 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:34.650676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8cfef-95b5-40d7-a3a0-bbb53240fbe0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:34.650676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8cfef-95b5-40d7-a3a0-bbb53240fbe0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:34.706914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8cfef-95b5-40d7-a3a0-bbb53240fbe0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:34.708313 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8cfef-95b5-40d7-a3a0-bbb53240fbe0 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:34.717541 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1161/2326] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:43:34 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:43:36.450457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438e02f-395d-4115-8d85-f1b0e01fca38 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:36.450955 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438e02f-395d-4115-8d85-f1b0e01fca38 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:36.451067 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438e02f-395d-4115-8d85-f1b0e01fca38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:36.471571 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-7438e02f-395d-4115-8d85-f1b0e01fca38 None None] MFA Rules not processed for user `22750d44d710439da1d18a78419b1adf`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:36.472817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7438e02f-395d-4115-8d85-f1b0e01fca38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:36.548703 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1166/2327] 10.222.0.57 () {58 vars in 1009 bytes} [Thu Jul 21 08:43:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:43:36.562272 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8cfef-95b5-40d7-a3a0-bbb53240fbe0 service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:36.564123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-a7a8cfef-95b5-40d7-a3a0-bbb53240fbe0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:36.645599 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:36.723871 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8cfef-95b5-40d7-a3a0-bbb53240fbe0 service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:36.740646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3ddd2-a00e-4831-9117-87fc2f33a760 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e349e5dfcd74406b922d3d1ce0fa5ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:36.741321 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3ddd2-a00e-4831-9117-87fc2f33a760 service swift] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:36.749908 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3ddd2-a00e-4831-9117-87fc2f33a760 service swift] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:36.749908 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3ddd2-a00e-4831-9117-87fc2f33a760 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:36.764326 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3ddd2-a00e-4831-9117-87fc2f33a760 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:36.766242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3ddd2-a00e-4831-9117-87fc2f33a760 service swift] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:36.776973 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1162/2328] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 08:43:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:43:40.597688 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438e02f-395d-4115-8d85-f1b0e01fca38 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:40.681747 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438e02f-395d-4115-8d85-f1b0e01fca38 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:40.688555 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe1c35-6aa2-4f19-9b7b-26ed138d0a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:40.690134 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe1c35-6aa2-4f19-9b7b-26ed138d0a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:40.690429 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe1c35-6aa2-4f19-9b7b-26ed138d0a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:40.690719 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbe1c35-6aa2-4f19-9b7b-26ed138d0a1e admin admin] PATH_INFO: `/v3/users/0b38e4014a7e4cc0ae14fb527768427a` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:40.692071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe1c35-6aa2-4f19-9b7b-26ed138d0a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b38e4014a7e4cc0ae14fb527768427a)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:40.696275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbe1c35-6aa2-4f19-9b7b-26ed138d0a1e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:40.927718 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-8bbe1c35-6aa2-4f19-9b7b-26ed138d0a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b38e4014a7e4cc0ae14fb527768427a'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:40.929144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:40.946155 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-8bbe1c35-6aa2-4f19-9b7b-26ed138d0a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b38e4014a7e4cc0ae14fb527768427a'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:40.950356 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-8bbe1c35-6aa2-4f19-9b7b-26ed138d0a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b38e4014a7e4cc0ae14fb527768427a'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:40.951098 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-8bbe1c35-6aa2-4f19-9b7b-26ed138d0a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b38e4014a7e4cc0ae14fb527768427a'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:40.951713 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-8bbe1c35-6aa2-4f19-9b7b-26ed138d0a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b38e4014a7e4cc0ae14fb527768427a'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:41.028534 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1167/2329] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:43:40 2022] DELETE /identity/v3/users/0b38e4014a7e4cc0ae14fb527768427a => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:43:41.033714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9679bc4-ddae-48f0-ad8c-ebcbe20a699c None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:41.034346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9679bc4-ddae-48f0-ad8c-ebcbe20a699c None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:41.034481 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9679bc4-ddae-48f0-ad8c-ebcbe20a699c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:41.053291 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-c9679bc4-ddae-48f0-ad8c-ebcbe20a699c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:41.054610 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-c9679bc4-ddae-48f0-ad8c-ebcbe20a699c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:41.116879 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1163/2330] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:43:41.127782 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe1c35-6aa2-4f19-9b7b-26ed138d0a1e admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:41.129483 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-8bbe1c35-6aa2-4f19-9b7b-26ed138d0a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:41.190660 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbe1c35-6aa2-4f19-9b7b-26ed138d0a1e admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:41.195089 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e23925-6d78-4e60-8467-77919d1ca61f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:41.195840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e23925-6d78-4e60-8467-77919d1ca61f service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:41.196413 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e23925-6d78-4e60-8467-77919d1ca61f service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:41.197026 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e23925-6d78-4e60-8467-77919d1ca61f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:41.209976 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e23925-6d78-4e60-8467-77919d1ca61f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:41.211583 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e23925-6d78-4e60-8467-77919d1ca61f service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:41.222367 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1168/2331] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:43:41.728257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9679bc4-ddae-48f0-ad8c-ebcbe20a699c None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:41.728257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-c9679bc4-ddae-48f0-ad8c-ebcbe20a699c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:41.740366 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9679bc4-ddae-48f0-ad8c-ebcbe20a699c None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:41.745648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a1f3f-3d2a-4e34-bbea-fb8b662f3217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:41.746783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a1f3f-3d2a-4e34-bbea-fb8b662f3217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:41.747180 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a1f3f-3d2a-4e34-bbea-fb8b662f3217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:41.747521 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a1f3f-3d2a-4e34-bbea-fb8b662f3217 admin admin] PATH_INFO: `/v3/projects/410a452da7ea4a28946086fda534e2a2` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:41.748806 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a1f3f-3d2a-4e34-bbea-fb8b662f3217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=410a452da7ea4a28946086fda534e2a2)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:41.751086 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a1f3f-3d2a-4e34-bbea-fb8b662f3217 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:41.885764 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3c0a1f3f-3d2a-4e34-bbea-fb8b662f3217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410a452da7ea4a28946086fda534e2a2', 'request_id': 'req-3c0a1f3f-3d2a-4e34-bbea-fb8b662f3217'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:41.896633 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3c0a1f3f-3d2a-4e34-bbea-fb8b662f3217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410a452da7ea4a28946086fda534e2a2', 'request_id': 'req-3c0a1f3f-3d2a-4e34-bbea-fb8b662f3217'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:41.913679 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3c0a1f3f-3d2a-4e34-bbea-fb8b662f3217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410a452da7ea4a28946086fda534e2a2', 'request_id': 'req-3c0a1f3f-3d2a-4e34-bbea-fb8b662f3217'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:42.019348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3c0a1f3f-3d2a-4e34-bbea-fb8b662f3217 admin admin] The token cache is being invalidate because project 410a452da7ea4a28946086fda534e2a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:43:42.019645 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3c0a1f3f-3d2a-4e34-bbea-fb8b662f3217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:42.020296 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3c0a1f3f-3d2a-4e34-bbea-fb8b662f3217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:42.021908 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1164/2332] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:43:41 2022] DELETE /identity/v3/projects/410a452da7ea4a28946086fda534e2a2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:43:42.026007 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e23925-6d78-4e60-8467-77919d1ca61f service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:42.035699 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e23925-6d78-4e60-8467-77919d1ca61f service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:42.099452 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24156e40-af62-4bbf-8e40-6396e8e2d658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:42.100329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24156e40-af62-4bbf-8e40-6396e8e2d658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:42.100612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24156e40-af62-4bbf-8e40-6396e8e2d658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:42.100893 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24156e40-af62-4bbf-8e40-6396e8e2d658 admin admin] PATH_INFO: `/v3/users/f660ee76af714ea28f18d3ed5015c830` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:42.102133 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24156e40-af62-4bbf-8e40-6396e8e2d658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f660ee76af714ea28f18d3ed5015c830)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:42.104169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24156e40-af62-4bbf-8e40-6396e8e2d658 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:42.296736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-24156e40-af62-4bbf-8e40-6396e8e2d658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f660ee76af714ea28f18d3ed5015c830'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:42.319383 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-24156e40-af62-4bbf-8e40-6396e8e2d658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f660ee76af714ea28f18d3ed5015c830'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:42.324881 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:42.327981 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-24156e40-af62-4bbf-8e40-6396e8e2d658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f660ee76af714ea28f18d3ed5015c830'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:42.328777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-24156e40-af62-4bbf-8e40-6396e8e2d658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f660ee76af714ea28f18d3ed5015c830'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:42.329410 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-24156e40-af62-4bbf-8e40-6396e8e2d658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f660ee76af714ea28f18d3ed5015c830'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:42.394476 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1169/2333] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:43:42 2022] DELETE /identity/v3/users/f660ee76af714ea28f18d3ed5015c830 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:43:42.888678 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a1f3f-3d2a-4e34-bbea-fb8b662f3217 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:42.900398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-3c0a1f3f-3d2a-4e34-bbea-fb8b662f3217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:42.905511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a1f3f-3d2a-4e34-bbea-fb8b662f3217 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:42.991866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:43.023005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a69d4-27a0-40c3-a372-2531d16721cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:43.023813 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a69d4-27a0-40c3-a372-2531d16721cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:43.024128 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a69d4-27a0-40c3-a372-2531d16721cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:43.024411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a69d4-27a0-40c3-a372-2531d16721cc admin admin] PATH_INFO: `/v3/projects/6ccf15a14c084bf091f0d3f537c40274` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:43.025835 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a69d4-27a0-40c3-a372-2531d16721cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ccf15a14c084bf091f0d3f537c40274)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:43.030532 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a69d4-27a0-40c3-a372-2531d16721cc admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:43.160042 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f59a69d4-27a0-40c3-a372-2531d16721cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ccf15a14c084bf091f0d3f537c40274', 'request_id': 'req-f59a69d4-27a0-40c3-a372-2531d16721cc'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:43.169106 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f59a69d4-27a0-40c3-a372-2531d16721cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ccf15a14c084bf091f0d3f537c40274', 'request_id': 'req-f59a69d4-27a0-40c3-a372-2531d16721cc'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:43.177013 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f59a69d4-27a0-40c3-a372-2531d16721cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ccf15a14c084bf091f0d3f537c40274', 'request_id': 'req-f59a69d4-27a0-40c3-a372-2531d16721cc'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:43.281952 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f59a69d4-27a0-40c3-a372-2531d16721cc admin admin] The token cache is being invalidate because project 6ccf15a14c084bf091f0d3f537c40274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:43:43.282319 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f59a69d4-27a0-40c3-a372-2531d16721cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:43.282986 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f59a69d4-27a0-40c3-a372-2531d16721cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:43.285795 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1165/2334] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:43:42 2022] DELETE /identity/v3/projects/6ccf15a14c084bf091f0d3f537c40274 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:43:43.291530 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a5d8e-fa34-4ce9-8abe-f5c0901ef9f9 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:43.291530 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a5d8e-fa34-4ce9-8abe-f5c0901ef9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:43.291530 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a5d8e-fa34-4ce9-8abe-f5c0901ef9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:43.309392 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-d65a5d8e-fa34-4ce9-8abe-f5c0901ef9f9 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:43.310758 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-d65a5d8e-fa34-4ce9-8abe-f5c0901ef9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:43.420915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1170/2335] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:43:43.422875 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa325a2-e3c7-4685-b501-c5f5b9d11d61 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:43.424592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa325a2-e3c7-4685-b501-c5f5b9d11d61 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:43.424592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa325a2-e3c7-4685-b501-c5f5b9d11d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:43.446169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-7aa325a2-e3c7-4685-b501-c5f5b9d11d61 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:43.447551 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-7aa325a2-e3c7-4685-b501-c5f5b9d11d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:43.456884 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1166/2336] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:43:43.471089 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a5d8e-fa34-4ce9-8abe-f5c0901ef9f9 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:43.476703 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a5d8e-fa34-4ce9-8abe-f5c0901ef9f9 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:43.482363 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002dd25-453e-49e1-bc5d-ff60b56defce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:43.483245 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002dd25-453e-49e1-bc5d-ff60b56defce admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:43.483537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002dd25-453e-49e1-bc5d-ff60b56defce admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:43.484019 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002dd25-453e-49e1-bc5d-ff60b56defce admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:43.484835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002dd25-453e-49e1-bc5d-ff60b56defce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:43:43.485210 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002dd25-453e-49e1-bc5d-ff60b56defce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:43.487029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002dd25-453e-49e1-bc5d-ff60b56defce admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:43.500581 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1171/2337] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:43:43.505170 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa325a2-e3c7-4685-b501-c5f5b9d11d61 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:43.514860 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa325a2-e3c7-4685-b501-c5f5b9d11d61 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:43.519730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52867b-7b14-417b-84e6-69b4227daf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:43.520381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52867b-7b14-417b-84e6-69b4227daf5a admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:43.520665 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52867b-7b14-417b-84e6-69b4227daf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:43.520942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52867b-7b14-417b-84e6-69b4227daf5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:43.521702 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52867b-7b14-417b-84e6-69b4227daf5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:43.523766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52867b-7b14-417b-84e6-69b4227daf5a admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:43.612587 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1167/2338] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:43:43 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:43:43.616723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002dd25-453e-49e1-bc5d-ff60b56defce admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:43.626825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002dd25-453e-49e1-bc5d-ff60b56defce admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:43.688869 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498889c1-082f-4431-830c-9847e842b304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:43.689604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498889c1-082f-4431-830c-9847e842b304 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:43.689920 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498889c1-082f-4431-830c-9847e842b304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:43.690198 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498889c1-082f-4431-830c-9847e842b304 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:43.690904 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498889c1-082f-4431-830c-9847e842b304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:43.692832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498889c1-082f-4431-830c-9847e842b304 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:43.768204 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1172/2339] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:43:43 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:43:43.772673 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52867b-7b14-417b-84e6-69b4227daf5a admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:43.784447 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52867b-7b14-417b-84e6-69b4227daf5a admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:43.789422 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a9d53-c4ba-4a3d-91c9-3510df9ac491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:43.790143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a9d53-c4ba-4a3d-91c9-3510df9ac491 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:43.790430 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a9d53-c4ba-4a3d-91c9-3510df9ac491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:43.790713 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a9d53-c4ba-4a3d-91c9-3510df9ac491 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:43.791459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a9d53-c4ba-4a3d-91c9-3510df9ac491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:43.793087 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a9d53-c4ba-4a3d-91c9-3510df9ac491 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:43.811243 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498889c1-082f-4431-830c-9847e842b304 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:43.815649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1168/2340] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:43:43.826516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498889c1-082f-4431-830c-9847e842b304 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:43.836638 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad219d3-f178-4e2f-b505-1b9be5a9b7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:43.837468 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad219d3-f178-4e2f-b505-1b9be5a9b7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:43.837866 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad219d3-f178-4e2f-b505-1b9be5a9b7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:43.838159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad219d3-f178-4e2f-b505-1b9be5a9b7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:43.839020 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad219d3-f178-4e2f-b505-1b9be5a9b7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:43.841007 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad219d3-f178-4e2f-b505-1b9be5a9b7b2 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:43.854939 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1173/2341] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:43:43.864832 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a9d53-c4ba-4a3d-91c9-3510df9ac491 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:43.875193 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a9d53-c4ba-4a3d-91c9-3510df9ac491 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:43.882172 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8478fb-66cc-4da8-91a1-df91c73bfcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:43.883343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8478fb-66cc-4da8-91a1-df91c73bfcf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:43.883721 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8478fb-66cc-4da8-91a1-df91c73bfcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:43.884153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8478fb-66cc-4da8-91a1-df91c73bfcf4 admin admin] PATH_INFO: `/v3/projects/b8b05dc2e005481bb8e1b49618f6c1a4/users/64dcb772701a4f11aae292dd03edbba5/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:43.907127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8478fb-66cc-4da8-91a1-df91c73bfcf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b05dc2e005481bb8e1b49618f6c1a4, user_id=64dcb772701a4f11aae292dd03edbba5, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:43.914655 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8478fb-66cc-4da8-91a1-df91c73bfcf4 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:44.000373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1169/2342] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:43:43 2022] PUT /identity/v3/projects/b8b05dc2e005481bb8e1b49618f6c1a4/users/64dcb772701a4f11aae292dd03edbba5/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:43:44.010836 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f44b16-b591-4183-94ad-e19011a26f95 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:44.011137 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f44b16-b591-4183-94ad-e19011a26f95 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:44.011452 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f44b16-b591-4183-94ad-e19011a26f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:44.042446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-b6f44b16-b591-4183-94ad-e19011a26f95 None None] MFA Rules not processed for user `64dcb772701a4f11aae292dd03edbba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:44.043704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b6f44b16-b591-4183-94ad-e19011a26f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:44.102821 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:44.125452 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1174/2343] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:43:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:43:44.130108 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8478fb-66cc-4da8-91a1-df91c73bfcf4 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:44.195811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8478fb-66cc-4da8-91a1-df91c73bfcf4 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:44.201686 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fb106-0abd-44a1-a90f-1f948153d7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:44.202501 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fb106-0abd-44a1-a90f-1f948153d7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:44.202786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fb106-0abd-44a1-a90f-1f948153d7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:44.203065 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fb106-0abd-44a1-a90f-1f948153d7a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:44.203756 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014fb106-0abd-44a1-a90f-1f948153d7a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:44.206368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014fb106-0abd-44a1-a90f-1f948153d7a3 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:44.279514 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:44.290812 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1170/2344] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:43:44 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:43:44.294798 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f44b16-b591-4183-94ad-e19011a26f95 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:44.306608 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f44b16-b591-4183-94ad-e19011a26f95 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:44.375879 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce14e6-2b56-4384-9f64-91a24cfc8a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:44.376485 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce14e6-2b56-4384-9f64-91a24cfc8a4a admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:44.376826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce14e6-2b56-4384-9f64-91a24cfc8a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:44.377079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce14e6-2b56-4384-9f64-91a24cfc8a4a admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:44.378459 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce14e6-2b56-4384-9f64-91a24cfc8a4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:44.380673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce14e6-2b56-4384-9f64-91a24cfc8a4a admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:44.489112 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1175/2345] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:43:44 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:43:44.493228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fb106-0abd-44a1-a90f-1f948153d7a3 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:44.504522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fb106-0abd-44a1-a90f-1f948153d7a3 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:44.509744 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642eb037-5b2f-4e81-a253-9272c34a5cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:44.510428 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eb037-5b2f-4e81-a253-9272c34a5cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:44.510714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eb037-5b2f-4e81-a253-9272c34a5cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:44.510992 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642eb037-5b2f-4e81-a253-9272c34a5cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:44.511726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642eb037-5b2f-4e81-a253-9272c34a5cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:44.513354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642eb037-5b2f-4e81-a253-9272c34a5cb5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:44.534292 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1171/2346] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:43:44.537293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce14e6-2b56-4384-9f64-91a24cfc8a4a admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:44.553889 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce14e6-2b56-4384-9f64-91a24cfc8a4a admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:44.559276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82e20b-a390-4f60-ab6d-55b95e5deb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:44.560277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82e20b-a390-4f60-ab6d-55b95e5deb46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:44.560564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82e20b-a390-4f60-ab6d-55b95e5deb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:44.560842 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82e20b-a390-4f60-ab6d-55b95e5deb46 admin admin] PATH_INFO: `/v3/projects/28dfa82cbe1246f896c465e4cbb30c76/users/d9f6a6e40fbe4ba69bea3ed5487e6e4f/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:44.577648 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82e20b-a390-4f60-ab6d-55b95e5deb46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28dfa82cbe1246f896c465e4cbb30c76, user_id=d9f6a6e40fbe4ba69bea3ed5487e6e4f, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:44.581090 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82e20b-a390-4f60-ab6d-55b95e5deb46 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:44.654607 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1176/2347] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:43:44 2022] PUT /identity/v3/projects/28dfa82cbe1246f896c465e4cbb30c76/users/d9f6a6e40fbe4ba69bea3ed5487e6e4f/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:43:44.659668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642eb037-5b2f-4e81-a253-9272c34a5cb5 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:44.678639 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642eb037-5b2f-4e81-a253-9272c34a5cb5 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:44.756090 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fbe5a-aa67-48aa-abb3-c7c5fe480375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:44.756886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fbe5a-aa67-48aa-abb3-c7c5fe480375 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:44.757246 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fbe5a-aa67-48aa-abb3-c7c5fe480375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:44.757542 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fbe5a-aa67-48aa-abb3-c7c5fe480375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:44.758374 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fbe5a-aa67-48aa-abb3-c7c5fe480375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:44.760089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fbe5a-aa67-48aa-abb3-c7c5fe480375 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:44.772284 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1172/2348] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:43:44 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:43:44.776355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82e20b-a390-4f60-ab6d-55b95e5deb46 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:44.788054 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82e20b-a390-4f60-ab6d-55b95e5deb46 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:44.793200 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a9331-e49f-4ba0-b014-7025a6d54dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:44.794145 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a9331-e49f-4ba0-b014-7025a6d54dac admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:44.794427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a9331-e49f-4ba0-b014-7025a6d54dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:44.794702 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a9331-e49f-4ba0-b014-7025a6d54dac admin admin] PATH_INFO: `/v3/projects/28dfa82cbe1246f896c465e4cbb30c76/users/d9f6a6e40fbe4ba69bea3ed5487e6e4f/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:44.796774 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a9331-e49f-4ba0-b014-7025a6d54dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=28dfa82cbe1246f896c465e4cbb30c76, user_id=d9f6a6e40fbe4ba69bea3ed5487e6e4f, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:44.799500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a9331-e49f-4ba0-b014-7025a6d54dac admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:44.811697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1177/2349] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:43:44 2022] PUT /identity/v3/projects/28dfa82cbe1246f896c465e4cbb30c76/users/d9f6a6e40fbe4ba69bea3ed5487e6e4f/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:43:44.824018 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee35cca-60ee-49fd-95aa-9ffd58e7afe5 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:44.824305 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee35cca-60ee-49fd-95aa-9ffd58e7afe5 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:44.824583 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee35cca-60ee-49fd-95aa-9ffd58e7afe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:44.862530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-2ee35cca-60ee-49fd-95aa-9ffd58e7afe5 None None] MFA Rules not processed for user `d9f6a6e40fbe4ba69bea3ed5487e6e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:44.864008 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2ee35cca-60ee-49fd-95aa-9ffd58e7afe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:44.944235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1173/2350] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:43:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:43:44.956893 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a9331-e49f-4ba0-b014-7025a6d54dac admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:44.958608 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-6e1a9331-e49f-4ba0-b014-7025a6d54dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:45.029635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a9331-e49f-4ba0-b014-7025a6d54dac admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:45.033453 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6fc6a-a8c1-4b13-9432-152ea4dab753 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:45.034131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6fc6a-a8c1-4b13-9432-152ea4dab753 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:45.034418 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6fc6a-a8c1-4b13-9432-152ea4dab753 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:45.034820 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6fc6a-a8c1-4b13-9432-152ea4dab753 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:45.045159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6fc6a-a8c1-4b13-9432-152ea4dab753 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:45.046651 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6fc6a-a8c1-4b13-9432-152ea4dab753 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:45.058674 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1178/2351] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:43:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:43:46.035631 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee35cca-60ee-49fd-95aa-9ffd58e7afe5 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:46.044789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee35cca-60ee-49fd-95aa-9ffd58e7afe5 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:46.049431 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38458b2d-a0f5-4716-8c73-c333b04f08cf tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f6a6e40fbe4ba69bea3ed5487e6e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28dfa82cbe1246f896c465e4cbb30c76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:46.050133 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38458b2d-a0f5-4716-8c73-c333b04f08cf tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:46.050424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38458b2d-a0f5-4716-8c73-c333b04f08cf tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:46.050706 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38458b2d-a0f5-4716-8c73-c333b04f08cf tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:46.051484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38458b2d-a0f5-4716-8c73-c333b04f08cf tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:43:46.051771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38458b2d-a0f5-4716-8c73-c333b04f08cf tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:46.053375 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38458b2d-a0f5-4716-8c73-c333b04f08cf tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:46.065122 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1174/2352] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:43:46.069418 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6fc6a-a8c1-4b13-9432-152ea4dab753 service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:46.078827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6fc6a-a8c1-4b13-9432-152ea4dab753 service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:46.084180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90991e19-c55b-451d-a86f-a672c11264f0 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f6a6e40fbe4ba69bea3ed5487e6e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28dfa82cbe1246f896c465e4cbb30c76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:46.084950 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90991e19-c55b-451d-a86f-a672c11264f0 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:46.085253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90991e19-c55b-451d-a86f-a672c11264f0 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:46.085608 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90991e19-c55b-451d-a86f-a672c11264f0 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:46.086351 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90991e19-c55b-451d-a86f-a672c11264f0 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:46.088381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90991e19-c55b-451d-a86f-a672c11264f0 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:46.185613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1179/2353] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:43:46 2022] POST /identity/v3/projects => generated 355 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:43:46.190289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38458b2d-a0f5-4716-8c73-c333b04f08cf tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:46.200378 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38458b2d-a0f5-4716-8c73-c333b04f08cf tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:46.250287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:46.257374 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1c1a9-6f42-4752-85e3-5fe308a06808 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f6a6e40fbe4ba69bea3ed5487e6e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28dfa82cbe1246f896c465e4cbb30c76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:46.260566 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1c1a9-6f42-4752-85e3-5fe308a06808 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:46.260566 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1c1a9-6f42-4752-85e3-5fe308a06808 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:46.260566 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1c1a9-6f42-4752-85e3-5fe308a06808 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:46.260566 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1c1a9-6f42-4752-85e3-5fe308a06808 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:43:46.260566 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1c1a9-6f42-4752-85e3-5fe308a06808 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:46.261273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1c1a9-6f42-4752-85e3-5fe308a06808 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:46.273613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1175/2354] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:43:46.308428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90991e19-c55b-451d-a86f-a672c11264f0 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:46.319181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90991e19-c55b-451d-a86f-a672c11264f0 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:46.323815 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4571ba6d-6bb0-4af4-9420-730e17cdf2f5 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9f6a6e40fbe4ba69bea3ed5487e6e4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '28dfa82cbe1246f896c465e4cbb30c76', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:46.324664 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571ba6d-6bb0-4af4-9420-730e17cdf2f5 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:46.324953 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571ba6d-6bb0-4af4-9420-730e17cdf2f5 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:46.325238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4571ba6d-6bb0-4af4-9420-730e17cdf2f5 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] PATH_INFO: `/v3/projects/5dd282c75f5d4fcb82c90f2c85afd700` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:46.326455 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571ba6d-6bb0-4af4-9420-730e17cdf2f5 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5dd282c75f5d4fcb82c90f2c85afd700)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:46.328342 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4571ba6d-6bb0-4af4-9420-730e17cdf2f5 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:46.347140 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:46.451660 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4571ba6d-6bb0-4af4-9420-730e17cdf2f5 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd282c75f5d4fcb82c90f2c85afd700', 'request_id': 'req-4571ba6d-6bb0-4af4-9420-730e17cdf2f5'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:46.457830 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4571ba6d-6bb0-4af4-9420-730e17cdf2f5 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd282c75f5d4fcb82c90f2c85afd700', 'request_id': 'req-4571ba6d-6bb0-4af4-9420-730e17cdf2f5'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:46.536246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4571ba6d-6bb0-4af4-9420-730e17cdf2f5 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd282c75f5d4fcb82c90f2c85afd700', 'request_id': 'req-4571ba6d-6bb0-4af4-9420-730e17cdf2f5'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:46.547731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4571ba6d-6bb0-4af4-9420-730e17cdf2f5 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] The token cache is being invalidate because project 5dd282c75f5d4fcb82c90f2c85afd700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:43:46.548015 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4571ba6d-6bb0-4af4-9420-730e17cdf2f5 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:46.548650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4571ba6d-6bb0-4af4-9420-730e17cdf2f5 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:46.550746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1180/2355] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:43:46 2022] DELETE /identity/v3/projects/5dd282c75f5d4fcb82c90f2c85afd700 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:43:47.158579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1c1a9-6f42-4752-85e3-5fe308a06808 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:47.161214 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-9ef1c1a9-6f42-4752-85e3-5fe308a06808 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:47.232851 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1c1a9-6f42-4752-85e3-5fe308a06808 tempest-VolumeQuotaClassesTest-1216430043 tempest-VolumeQuotaClassesTest-1216430043-project-admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:47.331947 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d86c9-09d1-4282-8819-9489f1107805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:47.333959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d86c9-09d1-4282-8819-9489f1107805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:47.334393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d86c9-09d1-4282-8819-9489f1107805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:47.335424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d86c9-09d1-4282-8819-9489f1107805 admin admin] PATH_INFO: `/v3/users/64dcb772701a4f11aae292dd03edbba5` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:47.337817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d86c9-09d1-4282-8819-9489f1107805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64dcb772701a4f11aae292dd03edbba5)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:47.345508 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d86c9-09d1-4282-8819-9489f1107805 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:47.602295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4a5d86c9-09d1-4282-8819-9489f1107805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64dcb772701a4f11aae292dd03edbba5'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:47.621892 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4a5d86c9-09d1-4282-8819-9489f1107805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64dcb772701a4f11aae292dd03edbba5'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:47.633179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4a5d86c9-09d1-4282-8819-9489f1107805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64dcb772701a4f11aae292dd03edbba5'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:47.634315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4a5d86c9-09d1-4282-8819-9489f1107805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64dcb772701a4f11aae292dd03edbba5'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:47.635221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4a5d86c9-09d1-4282-8819-9489f1107805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64dcb772701a4f11aae292dd03edbba5'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:47.745363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1176/2356] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:43:47 2022] DELETE /identity/v3/users/64dcb772701a4f11aae292dd03edbba5 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:43:47.749843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa7566-1e5f-485a-a380-0c47e0b5ec46 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:47.750669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa7566-1e5f-485a-a380-0c47e0b5ec46 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:47.751087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa7566-1e5f-485a-a380-0c47e0b5ec46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:47.787828 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-e0fa7566-1e5f-485a-a380-0c47e0b5ec46 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:47.788485 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e0fa7566-1e5f-485a-a380-0c47e0b5ec46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:47.865977 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1181/2357] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:43:47.876312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d86c9-09d1-4282-8819-9489f1107805 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:47.878573 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4a5d86c9-09d1-4282-8819-9489f1107805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:47.901952 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:47.950501 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d86c9-09d1-4282-8819-9489f1107805 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:47.955802 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3964f0b-af69-41d6-bc1b-42d24c8de927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:47.956423 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3964f0b-af69-41d6-bc1b-42d24c8de927 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:47.956706 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3964f0b-af69-41d6-bc1b-42d24c8de927 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:47.957419 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3964f0b-af69-41d6-bc1b-42d24c8de927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:47.969163 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3964f0b-af69-41d6-bc1b-42d24c8de927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:47.971493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3964f0b-af69-41d6-bc1b-42d24c8de927 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:47.985206 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1177/2358] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:43:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:43:48.845396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa7566-1e5f-485a-a380-0c47e0b5ec46 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:48.846966 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e0fa7566-1e5f-485a-a380-0c47e0b5ec46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:48.859336 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa7566-1e5f-485a-a380-0c47e0b5ec46 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:48.865350 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6a03c-2d5a-482b-9498-fe90cff46952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:48.866446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6a03c-2d5a-482b-9498-fe90cff46952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:48.866724 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6a03c-2d5a-482b-9498-fe90cff46952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:48.866997 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6a03c-2d5a-482b-9498-fe90cff46952 admin admin] PATH_INFO: `/v3/projects/b8b05dc2e005481bb8e1b49618f6c1a4` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:48.868359 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6a03c-2d5a-482b-9498-fe90cff46952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b05dc2e005481bb8e1b49618f6c1a4)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:48.870241 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6a03c-2d5a-482b-9498-fe90cff46952 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:49.004855 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e1e6a03c-2d5a-482b-9498-fe90cff46952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b05dc2e005481bb8e1b49618f6c1a4', 'request_id': 'req-e1e6a03c-2d5a-482b-9498-fe90cff46952'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:49.012576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e1e6a03c-2d5a-482b-9498-fe90cff46952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b05dc2e005481bb8e1b49618f6c1a4', 'request_id': 'req-e1e6a03c-2d5a-482b-9498-fe90cff46952'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:49.082051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e1e6a03c-2d5a-482b-9498-fe90cff46952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b05dc2e005481bb8e1b49618f6c1a4', 'request_id': 'req-e1e6a03c-2d5a-482b-9498-fe90cff46952'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:49.097729 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e1e6a03c-2d5a-482b-9498-fe90cff46952 admin admin] The token cache is being invalidate because project b8b05dc2e005481bb8e1b49618f6c1a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:43:49.098104 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e1e6a03c-2d5a-482b-9498-fe90cff46952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:49.098838 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e1e6a03c-2d5a-482b-9498-fe90cff46952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:49.100618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1182/2359] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:43:48 2022] DELETE /identity/v3/projects/b8b05dc2e005481bb8e1b49618f6c1a4 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:43:49.104483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3964f0b-af69-41d6-bc1b-42d24c8de927 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:49.115046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3964f0b-af69-41d6-bc1b-42d24c8de927 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:49.173388 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6d1e9-05ec-4c43-bdc2-1dbd48a5784a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:49.174542 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6d1e9-05ec-4c43-bdc2-1dbd48a5784a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:49.174764 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6d1e9-05ec-4c43-bdc2-1dbd48a5784a admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:49.175043 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6d1e9-05ec-4c43-bdc2-1dbd48a5784a admin admin] PATH_INFO: `/v3/users/d9f6a6e40fbe4ba69bea3ed5487e6e4f` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:49.176244 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6d1e9-05ec-4c43-bdc2-1dbd48a5784a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f6a6e40fbe4ba69bea3ed5487e6e4f)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:49.178228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a6d1e9-05ec-4c43-bdc2-1dbd48a5784a admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:49.391664 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-15a6d1e9-05ec-4c43-bdc2-1dbd48a5784a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f6a6e40fbe4ba69bea3ed5487e6e4f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:49.404877 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-15a6d1e9-05ec-4c43-bdc2-1dbd48a5784a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f6a6e40fbe4ba69bea3ed5487e6e4f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:49.412065 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-15a6d1e9-05ec-4c43-bdc2-1dbd48a5784a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f6a6e40fbe4ba69bea3ed5487e6e4f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:49.412806 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-15a6d1e9-05ec-4c43-bdc2-1dbd48a5784a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f6a6e40fbe4ba69bea3ed5487e6e4f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:49.413435 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-15a6d1e9-05ec-4c43-bdc2-1dbd48a5784a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f6a6e40fbe4ba69bea3ed5487e6e4f'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:49.505745 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1178/2360] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:43:49 2022] DELETE /identity/v3/users/d9f6a6e40fbe4ba69bea3ed5487e6e4f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:43:50.042713 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6a03c-2d5a-482b-9498-fe90cff46952 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:50.044787 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e1e6a03c-2d5a-482b-9498-fe90cff46952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:50.058576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6a03c-2d5a-482b-9498-fe90cff46952 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:50.082871 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:50.129385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc151ed-8298-488b-9f5d-d2969cad4fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:50.130280 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc151ed-8298-488b-9f5d-d2969cad4fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:50.130565 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc151ed-8298-488b-9f5d-d2969cad4fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:50.133595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc151ed-8298-488b-9f5d-d2969cad4fc0 admin admin] PATH_INFO: `/v3/projects/28dfa82cbe1246f896c465e4cbb30c76` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:50.133595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc151ed-8298-488b-9f5d-d2969cad4fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28dfa82cbe1246f896c465e4cbb30c76)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:50.135057 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc151ed-8298-488b-9f5d-d2969cad4fc0 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:50.285596 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6dc151ed-8298-488b-9f5d-d2969cad4fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28dfa82cbe1246f896c465e4cbb30c76', 'request_id': 'req-6dc151ed-8298-488b-9f5d-d2969cad4fc0'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:50.292084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6dc151ed-8298-488b-9f5d-d2969cad4fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28dfa82cbe1246f896c465e4cbb30c76', 'request_id': 'req-6dc151ed-8298-488b-9f5d-d2969cad4fc0'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:50.391463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6dc151ed-8298-488b-9f5d-d2969cad4fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28dfa82cbe1246f896c465e4cbb30c76', 'request_id': 'req-6dc151ed-8298-488b-9f5d-d2969cad4fc0'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:50.411367 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6dc151ed-8298-488b-9f5d-d2969cad4fc0 admin admin] The token cache is being invalidate because project 28dfa82cbe1246f896c465e4cbb30c76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:43:50.411799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6dc151ed-8298-488b-9f5d-d2969cad4fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:50.412524 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6dc151ed-8298-488b-9f5d-d2969cad4fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:50.414350 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1183/2361] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:43:50 2022] DELETE /identity/v3/projects/28dfa82cbe1246f896c465e4cbb30c76 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:43:50.419062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a2ccc-f4d1-4a19-893a-878fc5afb5ee None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:50.422414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a2ccc-f4d1-4a19-893a-878fc5afb5ee None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:50.422414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a2ccc-f4d1-4a19-893a-878fc5afb5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:50.458628 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-412a2ccc-f4d1-4a19-893a-878fc5afb5ee None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:50.461685 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-412a2ccc-f4d1-4a19-893a-878fc5afb5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:50.502209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:50.529927 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1179/2362] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:43:50.538424 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c8b12-66e2-49b9-979c-668516a80b9e None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:50.538687 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c8b12-66e2-49b9-979c-668516a80b9e None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:50.538908 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c8b12-66e2-49b9-979c-668516a80b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:50.559670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-a06c8b12-66e2-49b9-979c-668516a80b9e None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:50.561039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a06c8b12-66e2-49b9-979c-668516a80b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:50.569984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1184/2363] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:43:50.574261 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a2ccc-f4d1-4a19-893a-878fc5afb5ee None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:50.584791 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a2ccc-f4d1-4a19-893a-878fc5afb5ee None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:50.589439 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee885303-5037-472e-866b-f890f6e10fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:50.590133 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee885303-5037-472e-866b-f890f6e10fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:50.590415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee885303-5037-472e-866b-f890f6e10fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:50.590687 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee885303-5037-472e-866b-f890f6e10fb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:50.591472 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee885303-5037-472e-866b-f890f6e10fb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:43:50.591776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee885303-5037-472e-866b-f890f6e10fb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:50.593373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee885303-5037-472e-866b-f890f6e10fb5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:50.607086 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1180/2364] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:43:50.611482 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c8b12-66e2-49b9-979c-668516a80b9e None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:50.620694 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c8b12-66e2-49b9-979c-668516a80b9e None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:50.625445 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d962434-c03b-4147-be6e-73c6188c0b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:50.626122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d962434-c03b-4147-be6e-73c6188c0b8c admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:50.626401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d962434-c03b-4147-be6e-73c6188c0b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:50.626670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d962434-c03b-4147-be6e-73c6188c0b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:50.627396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d962434-c03b-4147-be6e-73c6188c0b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:50.629335 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d962434-c03b-4147-be6e-73c6188c0b8c admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:50.732863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1185/2365] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:43:50 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:43:50.734362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee885303-5037-472e-866b-f890f6e10fb5 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:50.745134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee885303-5037-472e-866b-f890f6e10fb5 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:50.802675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e699ee-060a-49e4-bbf3-674be30a2877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:50.803351 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e699ee-060a-49e4-bbf3-674be30a2877 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:50.803638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e699ee-060a-49e4-bbf3-674be30a2877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:50.803918 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e699ee-060a-49e4-bbf3-674be30a2877 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:50.804627 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e699ee-060a-49e4-bbf3-674be30a2877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:50.806589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e699ee-060a-49e4-bbf3-674be30a2877 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:50.887814 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1181/2366] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:43:50 2022] POST /identity/v3/users => generated 283 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:43:50.891848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d962434-c03b-4147-be6e-73c6188c0b8c admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:50.903272 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d962434-c03b-4147-be6e-73c6188c0b8c admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:50.907960 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60dbc42-55f7-4b20-a1d6-16b819aa65e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:50.908738 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dbc42-55f7-4b20-a1d6-16b819aa65e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:50.909022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dbc42-55f7-4b20-a1d6-16b819aa65e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:50.909303 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60dbc42-55f7-4b20-a1d6-16b819aa65e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:50.910068 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60dbc42-55f7-4b20-a1d6-16b819aa65e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:50.911676 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60dbc42-55f7-4b20-a1d6-16b819aa65e9 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:50.922567 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1186/2367] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:43:50.926684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e699ee-060a-49e4-bbf3-674be30a2877 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:50.936716 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e699ee-060a-49e4-bbf3-674be30a2877 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:50.942142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78890e6d-7e41-4e92-9579-3409698ef730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:50.942805 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890e6d-7e41-4e92-9579-3409698ef730 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:50.943090 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890e6d-7e41-4e92-9579-3409698ef730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:50.943392 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78890e6d-7e41-4e92-9579-3409698ef730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:50.944232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78890e6d-7e41-4e92-9579-3409698ef730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:50.945988 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78890e6d-7e41-4e92-9579-3409698ef730 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:50.957625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1182/2368] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:43:50.961794 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60dbc42-55f7-4b20-a1d6-16b819aa65e9 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:50.971685 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60dbc42-55f7-4b20-a1d6-16b819aa65e9 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:50.976799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d647d9d-efa4-4c62-95d6-15345abd93c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:50.978008 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d647d9d-efa4-4c62-95d6-15345abd93c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:50.978350 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d647d9d-efa4-4c62-95d6-15345abd93c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:50.978559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d647d9d-efa4-4c62-95d6-15345abd93c4 admin admin] PATH_INFO: `/v3/projects/e745c0c7331241539b16a2312bc2f75d/users/9d38ff88cffe45429fdfbed86f3cf841/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:50.995127 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d647d9d-efa4-4c62-95d6-15345abd93c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e745c0c7331241539b16a2312bc2f75d, user_id=9d38ff88cffe45429fdfbed86f3cf841, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:50.997814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d647d9d-efa4-4c62-95d6-15345abd93c4 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:51.093251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1187/2369] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:43:50 2022] PUT /identity/v3/projects/e745c0c7331241539b16a2312bc2f75d/users/9d38ff88cffe45429fdfbed86f3cf841/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:43:51.104099 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754a4c7-19ef-4d3b-bd8d-39468b6cfcc9 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:51.104386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754a4c7-19ef-4d3b-bd8d-39468b6cfcc9 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:51.104666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2754a4c7-19ef-4d3b-bd8d-39468b6cfcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:51.132445 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-2754a4c7-19ef-4d3b-bd8d-39468b6cfcc9 None None] MFA Rules not processed for user `9d38ff88cffe45429fdfbed86f3cf841`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:51.133702 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2754a4c7-19ef-4d3b-bd8d-39468b6cfcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:51.195804 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1183/2370] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:43:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:43:51.200447 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d647d9d-efa4-4c62-95d6-15345abd93c4 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:51.249104 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:51.262153 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d647d9d-efa4-4c62-95d6-15345abd93c4 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:51.266938 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7862e8-3d7c-4f01-9099-51567569c810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:51.268099 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7862e8-3d7c-4f01-9099-51567569c810 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:51.268387 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7862e8-3d7c-4f01-9099-51567569c810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:51.268707 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7862e8-3d7c-4f01-9099-51567569c810 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:51.269404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7862e8-3d7c-4f01-9099-51567569c810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:51.271349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7862e8-3d7c-4f01-9099-51567569c810 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:51.368680 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1188/2371] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:43:51 2022] POST /identity/v3/projects => generated 365 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:43:51.372780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754a4c7-19ef-4d3b-bd8d-39468b6cfcc9 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:51.383838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2754a4c7-19ef-4d3b-bd8d-39468b6cfcc9 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:51.419287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:51.451223 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c3007-bceb-4599-9c82-104ef1e85090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:51.452171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c3007-bceb-4599-9c82-104ef1e85090 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:51.452548 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c3007-bceb-4599-9c82-104ef1e85090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:51.452827 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c3007-bceb-4599-9c82-104ef1e85090 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:51.453630 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c3007-bceb-4599-9c82-104ef1e85090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:51.456266 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c3007-bceb-4599-9c82-104ef1e85090 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:51.533961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1184/2372] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:43:51 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:43:51.535186 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7862e8-3d7c-4f01-9099-51567569c810 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:51.546333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7862e8-3d7c-4f01-9099-51567569c810 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:51.551506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36073eb-84eb-457c-ac79-0e479eb59c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:51.552280 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36073eb-84eb-457c-ac79-0e479eb59c59 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:51.552565 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36073eb-84eb-457c-ac79-0e479eb59c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:51.552843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36073eb-84eb-457c-ac79-0e479eb59c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:51.554208 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36073eb-84eb-457c-ac79-0e479eb59c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:51.555864 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36073eb-84eb-457c-ac79-0e479eb59c59 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:51.575442 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1189/2373] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:43:51.576577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c3007-bceb-4599-9c82-104ef1e85090 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:51.593053 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c3007-bceb-4599-9c82-104ef1e85090 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:51.598014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3309a9d-435e-4571-9f8b-0d1e0699a1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:51.598905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3309a9d-435e-4571-9f8b-0d1e0699a1c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:51.599189 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3309a9d-435e-4571-9f8b-0d1e0699a1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:51.599467 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3309a9d-435e-4571-9f8b-0d1e0699a1c7 admin admin] PATH_INFO: `/v3/projects/df5306460ae34a3a9ebfc6fe3946cd42/users/95c19b275a054affb5e01e4023d8cc90/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:51.615550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3309a9d-435e-4571-9f8b-0d1e0699a1c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5306460ae34a3a9ebfc6fe3946cd42, user_id=95c19b275a054affb5e01e4023d8cc90, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:51.618257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3309a9d-435e-4571-9f8b-0d1e0699a1c7 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:51.727379 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1185/2374] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:43:51 2022] PUT /identity/v3/projects/df5306460ae34a3a9ebfc6fe3946cd42/users/95c19b275a054affb5e01e4023d8cc90/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:43:51.731595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36073eb-84eb-457c-ac79-0e479eb59c59 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:51.741821 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36073eb-84eb-457c-ac79-0e479eb59c59 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:51.800618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b481b-4eca-4e8e-a208-2317079b4601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:51.801546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b481b-4eca-4e8e-a208-2317079b4601 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:51.801858 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b481b-4eca-4e8e-a208-2317079b4601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:51.802140 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b481b-4eca-4e8e-a208-2317079b4601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:51.803022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b481b-4eca-4e8e-a208-2317079b4601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:51.805893 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b481b-4eca-4e8e-a208-2317079b4601 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:51.823125 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1190/2375] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:43:51.826100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3309a9d-435e-4571-9f8b-0d1e0699a1c7 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:51.836735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3309a9d-435e-4571-9f8b-0d1e0699a1c7 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:51.841689 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b54dae7-ebd7-4ee3-b986-769ab2d30b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:51.842579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54dae7-ebd7-4ee3-b986-769ab2d30b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:51.842861 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54dae7-ebd7-4ee3-b986-769ab2d30b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:51.843136 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b54dae7-ebd7-4ee3-b986-769ab2d30b98 admin admin] PATH_INFO: `/v3/projects/df5306460ae34a3a9ebfc6fe3946cd42/users/95c19b275a054affb5e01e4023d8cc90/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:51.845180 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54dae7-ebd7-4ee3-b986-769ab2d30b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5306460ae34a3a9ebfc6fe3946cd42, user_id=95c19b275a054affb5e01e4023d8cc90, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:51.847905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b54dae7-ebd7-4ee3-b986-769ab2d30b98 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:51.864031 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1186/2376] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:43:51 2022] PUT /identity/v3/projects/df5306460ae34a3a9ebfc6fe3946cd42/users/95c19b275a054affb5e01e4023d8cc90/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:43:51.875223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd07a3b-735b-42fc-8718-167800cc5285 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:51.875516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd07a3b-735b-42fc-8718-167800cc5285 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:51.875800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd07a3b-735b-42fc-8718-167800cc5285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:51.913457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-1cd07a3b-735b-42fc-8718-167800cc5285 None None] MFA Rules not processed for user `95c19b275a054affb5e01e4023d8cc90`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:51.914749 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-1cd07a3b-735b-42fc-8718-167800cc5285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:51.995432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211cd51-2288-49d7-a6b9-5034ceac78d2 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:51.995432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211cd51-2288-49d7-a6b9-5034ceac78d2 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:51.995432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211cd51-2288-49d7-a6b9-5034ceac78d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:51.998564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1191/2377] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:43:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:43:52.012867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd07a3b-735b-42fc-8718-167800cc5285 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:52.014306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-1cd07a3b-735b-42fc-8718-167800cc5285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:52.015415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-9211cd51-2288-49d7-a6b9-5034ceac78d2 None None] MFA Rules not processed for user `22750d44d710439da1d18a78419b1adf`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:52.016845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-9211cd51-2288-49d7-a6b9-5034ceac78d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:52.074962 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:52.081730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1187/2378] 10.222.0.57 () {58 vars in 967 bytes} [Thu Jul 21 08:43:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:43:52.087281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd07a3b-735b-42fc-8718-167800cc5285 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:52.092209 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5b2d7-6790-4085-910d-fc3245795206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:52.092892 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5b2d7-6790-4085-910d-fc3245795206 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:52.093181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5b2d7-6790-4085-910d-fc3245795206 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:52.093461 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5b2d7-6790-4085-910d-fc3245795206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:52.095132 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211cd51-2288-49d7-a6b9-5034ceac78d2 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:52.097900 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-9211cd51-2288-49d7-a6b9-5034ceac78d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:52.104845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5b2d7-6790-4085-910d-fc3245795206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:52.107345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5b2d7-6790-4085-910d-fc3245795206 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:52.121048 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1192/2379] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:43:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:43:52.179855 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211cd51-2288-49d7-a6b9-5034ceac78d2 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:52.187520 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba3a3e-a4b9-42d4-b2cc-1fe91b9464d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e349e5dfcd74406b922d3d1ce0fa5ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:52.188626 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba3a3e-a4b9-42d4-b2cc-1fe91b9464d3 service swift] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:52.189049 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba3a3e-a4b9-42d4-b2cc-1fe91b9464d3 service swift] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:52.190055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba3a3e-a4b9-42d4-b2cc-1fe91b9464d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:52.207694 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba3a3e-a4b9-42d4-b2cc-1fe91b9464d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:52.209776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba3a3e-a4b9-42d4-b2cc-1fe91b9464d3 service swift] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:52.218114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1188/2380] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 08:43:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:43:52.383081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5b2d7-6790-4085-910d-fc3245795206 service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:52.393556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5b2d7-6790-4085-910d-fc3245795206 service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:52.398223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf2e59-00c8-4279-9bae-6313ddce651a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:52.398223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf2e59-00c8-4279-9bae-6313ddce651a service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:52.398223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf2e59-00c8-4279-9bae-6313ddce651a service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:52.398516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf2e59-00c8-4279-9bae-6313ddce651a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:52.461087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf2e59-00c8-4279-9bae-6313ddce651a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:52.463016 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf2e59-00c8-4279-9bae-6313ddce651a service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:52.472598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1193/2381] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:43:52 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:43:58.085806 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b11088-a2f1-48a3-8215-68fba11d8269 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:58.089556 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b11088-a2f1-48a3-8215-68fba11d8269 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:58.089556 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b11088-a2f1-48a3-8215-68fba11d8269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:58.104162 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-45b11088-a2f1-48a3-8215-68fba11d8269 None None] MFA Rules not processed for user `22750d44d710439da1d18a78419b1adf`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:58.105364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-45b11088-a2f1-48a3-8215-68fba11d8269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:58.113303 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1189/2382] 10.222.0.57 () {58 vars in 967 bytes} [Thu Jul 21 08:43:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:43:58.125983 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf2e59-00c8-4279-9bae-6313ddce651a service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:58.138319 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf2e59-00c8-4279-9bae-6313ddce651a service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:58.143269 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26c457-31bd-4562-8edd-63eb3bace073 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e349e5dfcd74406b922d3d1ce0fa5ef4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:58.143895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26c457-31bd-4562-8edd-63eb3bace073 service swift] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:58.144190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26c457-31bd-4562-8edd-63eb3bace073 service swift] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:58.144449 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26c457-31bd-4562-8edd-63eb3bace073 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:58.153385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26c457-31bd-4562-8edd-63eb3bace073 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:58.155027 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26c457-31bd-4562-8edd-63eb3bace073 service swift] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:58.164497 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1194/2383] 10.222.0.57 () {60 vars in 1384 bytes} [Thu Jul 21 08:43:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 08:43:59.187058 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b11088-a2f1-48a3-8215-68fba11d8269 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:59.201002 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:43:59.253126 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b11088-a2f1-48a3-8215-68fba11d8269 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:59.258155 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58e26f-90fa-47d9-a887-f0ddd88ca9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:59.259257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58e26f-90fa-47d9-a887-f0ddd88ca9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:59.260745 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58e26f-90fa-47d9-a887-f0ddd88ca9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:59.261084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58e26f-90fa-47d9-a887-f0ddd88ca9f5 admin admin] PATH_INFO: `/v3/users/9d38ff88cffe45429fdfbed86f3cf841` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:59.262617 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58e26f-90fa-47d9-a887-f0ddd88ca9f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d38ff88cffe45429fdfbed86f3cf841)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:59.264399 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58e26f-90fa-47d9-a887-f0ddd88ca9f5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:59.509902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ac58e26f-90fa-47d9-a887-f0ddd88ca9f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d38ff88cffe45429fdfbed86f3cf841'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:59.525055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ac58e26f-90fa-47d9-a887-f0ddd88ca9f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d38ff88cffe45429fdfbed86f3cf841'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:59.533554 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ac58e26f-90fa-47d9-a887-f0ddd88ca9f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d38ff88cffe45429fdfbed86f3cf841'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:59.534452 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ac58e26f-90fa-47d9-a887-f0ddd88ca9f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d38ff88cffe45429fdfbed86f3cf841'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:59.535760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ac58e26f-90fa-47d9-a887-f0ddd88ca9f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d38ff88cffe45429fdfbed86f3cf841'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:43:59.628208 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1190/2384] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:43:59 2022] DELETE /identity/v3/users/9d38ff88cffe45429fdfbed86f3cf841 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:43:59.633350 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d04750-f355-4024-81e7-900c66f57820 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:59.634299 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d04750-f355-4024-81e7-900c66f57820 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:59.634795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d04750-f355-4024-81e7-900c66f57820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:59.653193 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-f5d04750-f355-4024-81e7-900c66f57820 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:43:59.654459 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f5d04750-f355-4024-81e7-900c66f57820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:59.725903 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1195/2385] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:43:59.733628 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58e26f-90fa-47d9-a887-f0ddd88ca9f5 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:43:59.735939 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ac58e26f-90fa-47d9-a887-f0ddd88ca9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:43:59.813736 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58e26f-90fa-47d9-a887-f0ddd88ca9f5 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:43:59.818222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9247b2-3c5e-46c6-9032-0fd73d8e58eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:43:59.818884 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9247b2-3c5e-46c6-9032-0fd73d8e58eb service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:43:59.819169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9247b2-3c5e-46c6-9032-0fd73d8e58eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:43:59.819455 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9247b2-3c5e-46c6-9032-0fd73d8e58eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:43:59.831516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9247b2-3c5e-46c6-9032-0fd73d8e58eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:43:59.833206 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9247b2-3c5e-46c6-9032-0fd73d8e58eb service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:43:59.843997 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1191/2386] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:43:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:44:00.295999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d04750-f355-4024-81e7-900c66f57820 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:00.298166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f5d04750-f355-4024-81e7-900c66f57820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:00.319527 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d04750-f355-4024-81e7-900c66f57820 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:00.324995 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e842c7c-1a3d-4594-b054-a8d09b3d41c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:00.326087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e842c7c-1a3d-4594-b054-a8d09b3d41c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:00.326369 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e842c7c-1a3d-4594-b054-a8d09b3d41c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:00.326637 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e842c7c-1a3d-4594-b054-a8d09b3d41c3 admin admin] PATH_INFO: `/v3/projects/e745c0c7331241539b16a2312bc2f75d` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:00.327979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e842c7c-1a3d-4594-b054-a8d09b3d41c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e745c0c7331241539b16a2312bc2f75d)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:00.330290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e842c7c-1a3d-4594-b054-a8d09b3d41c3 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:00.439335 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7e842c7c-1a3d-4594-b054-a8d09b3d41c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e745c0c7331241539b16a2312bc2f75d', 'request_id': 'req-7e842c7c-1a3d-4594-b054-a8d09b3d41c3'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:00.453428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7e842c7c-1a3d-4594-b054-a8d09b3d41c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e745c0c7331241539b16a2312bc2f75d', 'request_id': 'req-7e842c7c-1a3d-4594-b054-a8d09b3d41c3'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:00.530735 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7e842c7c-1a3d-4594-b054-a8d09b3d41c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e745c0c7331241539b16a2312bc2f75d', 'request_id': 'req-7e842c7c-1a3d-4594-b054-a8d09b3d41c3'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:00.533604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:00.545258 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7e842c7c-1a3d-4594-b054-a8d09b3d41c3 admin admin] The token cache is being invalidate because project e745c0c7331241539b16a2312bc2f75d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:44:00.545877 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7e842c7c-1a3d-4594-b054-a8d09b3d41c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:00.546855 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7e842c7c-1a3d-4594-b054-a8d09b3d41c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:00.548716 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1196/2387] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:44:00 2022] DELETE /identity/v3/projects/e745c0c7331241539b16a2312bc2f75d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:00.553198 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9247b2-3c5e-46c6-9032-0fd73d8e58eb service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:00.564903 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9247b2-3c5e-46c6-9032-0fd73d8e58eb service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:00.608034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:00.635205 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814646e2-5608-4b54-8ac7-7d9704458d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:00.636400 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814646e2-5608-4b54-8ac7-7d9704458d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:00.636873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814646e2-5608-4b54-8ac7-7d9704458d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:00.637305 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814646e2-5608-4b54-8ac7-7d9704458d7e admin admin] PATH_INFO: `/v3/users/95c19b275a054affb5e01e4023d8cc90` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:00.639011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814646e2-5608-4b54-8ac7-7d9704458d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=95c19b275a054affb5e01e4023d8cc90)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:00.641381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814646e2-5608-4b54-8ac7-7d9704458d7e admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:00.893046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-814646e2-5608-4b54-8ac7-7d9704458d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95c19b275a054affb5e01e4023d8cc90'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:00.906464 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-814646e2-5608-4b54-8ac7-7d9704458d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95c19b275a054affb5e01e4023d8cc90'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:00.914416 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-814646e2-5608-4b54-8ac7-7d9704458d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95c19b275a054affb5e01e4023d8cc90'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:00.915128 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-814646e2-5608-4b54-8ac7-7d9704458d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95c19b275a054affb5e01e4023d8cc90'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:00.915730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-814646e2-5608-4b54-8ac7-7d9704458d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95c19b275a054affb5e01e4023d8cc90'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:01.011168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1192/2388] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:44:00 2022] DELETE /identity/v3/users/95c19b275a054affb5e01e4023d8cc90 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:01.712168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e842c7c-1a3d-4594-b054-a8d09b3d41c3 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:01.713710 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7e842c7c-1a3d-4594-b054-a8d09b3d41c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:01.729712 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e842c7c-1a3d-4594-b054-a8d09b3d41c3 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:01.810589 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5076f50-6c13-4394-ae2e-0b0d4e9a31a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:01.811719 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5076f50-6c13-4394-ae2e-0b0d4e9a31a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:01.811997 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5076f50-6c13-4394-ae2e-0b0d4e9a31a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:01.812455 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5076f50-6c13-4394-ae2e-0b0d4e9a31a1 admin admin] PATH_INFO: `/v3/projects/df5306460ae34a3a9ebfc6fe3946cd42` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:01.813883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5076f50-6c13-4394-ae2e-0b0d4e9a31a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df5306460ae34a3a9ebfc6fe3946cd42)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:01.815819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5076f50-6c13-4394-ae2e-0b0d4e9a31a1 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:01.917258 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f5076f50-6c13-4394-ae2e-0b0d4e9a31a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df5306460ae34a3a9ebfc6fe3946cd42', 'request_id': 'req-f5076f50-6c13-4394-ae2e-0b0d4e9a31a1'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:01.923099 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f5076f50-6c13-4394-ae2e-0b0d4e9a31a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df5306460ae34a3a9ebfc6fe3946cd42', 'request_id': 'req-f5076f50-6c13-4394-ae2e-0b0d4e9a31a1'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:02.016812 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f5076f50-6c13-4394-ae2e-0b0d4e9a31a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df5306460ae34a3a9ebfc6fe3946cd42', 'request_id': 'req-f5076f50-6c13-4394-ae2e-0b0d4e9a31a1'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:02.029922 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f5076f50-6c13-4394-ae2e-0b0d4e9a31a1 admin admin] The token cache is being invalidate because project df5306460ae34a3a9ebfc6fe3946cd42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:44:02.030340 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f5076f50-6c13-4394-ae2e-0b0d4e9a31a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:02.031001 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-f5076f50-6c13-4394-ae2e-0b0d4e9a31a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:02.032557 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1197/2389] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:44:01 2022] DELETE /identity/v3/projects/df5306460ae34a3a9ebfc6fe3946cd42 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:02.039061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ec694-d359-470c-b916-8f39e4947c5e None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:02.040723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ec694-d359-470c-b916-8f39e4947c5e None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:02.040723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ec694-d359-470c-b916-8f39e4947c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:02.062562 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-5b5ec694-d359-470c-b916-8f39e4947c5e None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:02.064102 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5b5ec694-d359-470c-b916-8f39e4947c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:02.137265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1193/2390] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:02.145367 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae30bfa-cbd4-47be-9c96-4cc07605df3e None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:02.145722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae30bfa-cbd4-47be-9c96-4cc07605df3e None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:02.145972 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae30bfa-cbd4-47be-9c96-4cc07605df3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:02.170420 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-eae30bfa-cbd4-47be-9c96-4cc07605df3e None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:02.171806 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-eae30bfa-cbd4-47be-9c96-4cc07605df3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:02.180570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1198/2391] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:02.185319 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ec694-d359-470c-b916-8f39e4947c5e None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:02.200068 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ec694-d359-470c-b916-8f39e4947c5e None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:02.204891 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6dd81-5df7-4039-8194-87236c5812b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:02.205596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6dd81-5df7-4039-8194-87236c5812b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:02.205888 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6dd81-5df7-4039-8194-87236c5812b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:02.206167 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc6dd81-5df7-4039-8194-87236c5812b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:02.207626 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6dd81-5df7-4039-8194-87236c5812b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:44:02.207942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6dd81-5df7-4039-8194-87236c5812b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:02.209590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc6dd81-5df7-4039-8194-87236c5812b7 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:02.221583 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1194/2392] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:44:02.225975 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae30bfa-cbd4-47be-9c96-4cc07605df3e None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:02.236151 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae30bfa-cbd4-47be-9c96-4cc07605df3e None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:02.240806 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c28e4-83e0-4418-9df5-b88b0295fd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:02.244124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c28e4-83e0-4418-9df5-b88b0295fd9f admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:02.244124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c28e4-83e0-4418-9df5-b88b0295fd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:02.244124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c28e4-83e0-4418-9df5-b88b0295fd9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:02.244124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c28e4-83e0-4418-9df5-b88b0295fd9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:02.244600 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c28e4-83e0-4418-9df5-b88b0295fd9f admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:02.363820 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1199/2393] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:44:02 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:44:02.365217 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6dd81-5df7-4039-8194-87236c5812b7 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:02.375485 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc6dd81-5df7-4039-8194-87236c5812b7 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:02.417210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:02.434626 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4678c49-ff06-44ce-a602-0db7394416fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:02.435296 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4678c49-ff06-44ce-a602-0db7394416fb admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:02.435585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4678c49-ff06-44ce-a602-0db7394416fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:02.435861 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4678c49-ff06-44ce-a602-0db7394416fb admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:02.436575 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4678c49-ff06-44ce-a602-0db7394416fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:02.438555 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4678c49-ff06-44ce-a602-0db7394416fb admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:02.527538 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1195/2394] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:44:02 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:44:02.528830 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c28e4-83e0-4418-9df5-b88b0295fd9f admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:02.539596 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c28e4-83e0-4418-9df5-b88b0295fd9f admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:02.546135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9823134-ddf4-4ade-93aa-5522b26428d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:02.546812 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9823134-ddf4-4ade-93aa-5522b26428d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:02.547091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9823134-ddf4-4ade-93aa-5522b26428d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:02.547363 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9823134-ddf4-4ade-93aa-5522b26428d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:02.548159 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9823134-ddf4-4ade-93aa-5522b26428d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:02.549800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9823134-ddf4-4ade-93aa-5522b26428d0 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:02.563888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1200/2395] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:44:02.576884 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4678c49-ff06-44ce-a602-0db7394416fb admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:02.584865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4678c49-ff06-44ce-a602-0db7394416fb admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:02.590091 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169e333-715d-48c2-b0de-92ad618a4e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:02.590762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169e333-715d-48c2-b0de-92ad618a4e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:02.591070 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169e333-715d-48c2-b0de-92ad618a4e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:02.591477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169e333-715d-48c2-b0de-92ad618a4e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:02.592214 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169e333-715d-48c2-b0de-92ad618a4e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:02.593858 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169e333-715d-48c2-b0de-92ad618a4e1e admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:02.605343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1196/2396] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:44:02.612478 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9823134-ddf4-4ade-93aa-5522b26428d0 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:02.620167 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9823134-ddf4-4ade-93aa-5522b26428d0 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:02.624906 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7423eaf-3827-487e-b8e6-2a7f55cc2418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:02.625809 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7423eaf-3827-487e-b8e6-2a7f55cc2418 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:02.626091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7423eaf-3827-487e-b8e6-2a7f55cc2418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:02.626369 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7423eaf-3827-487e-b8e6-2a7f55cc2418 admin admin] PATH_INFO: `/v3/projects/63b484e27f2b41c0bc1741c8cf78c08f/users/c1e3599f2be74125ad83a4b777c1bf41/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:02.641321 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7423eaf-3827-487e-b8e6-2a7f55cc2418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63b484e27f2b41c0bc1741c8cf78c08f, user_id=c1e3599f2be74125ad83a4b777c1bf41, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:02.644165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7423eaf-3827-487e-b8e6-2a7f55cc2418 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:02.731803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1201/2397] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:44:02 2022] PUT /identity/v3/projects/63b484e27f2b41c0bc1741c8cf78c08f/users/c1e3599f2be74125ad83a4b777c1bf41/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:02.742514 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf186f-d601-496c-944c-918a203df824 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:02.742940 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf186f-d601-496c-944c-918a203df824 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:02.743230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf186f-d601-496c-944c-918a203df824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:02.772762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-10bf186f-d601-496c-944c-918a203df824 None None] MFA Rules not processed for user `c1e3599f2be74125ad83a4b777c1bf41`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:02.774012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-10bf186f-d601-496c-944c-918a203df824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:02.844215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1197/2398] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:02.848809 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7423eaf-3827-487e-b8e6-2a7f55cc2418 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:02.875556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:02.913224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7423eaf-3827-487e-b8e6-2a7f55cc2418 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:02.918522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e95ce-770f-40d9-a1e6-4631917cc0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:02.919192 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e95ce-770f-40d9-a1e6-4631917cc0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:02.919480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e95ce-770f-40d9-a1e6-4631917cc0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:02.919762 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e95ce-770f-40d9-a1e6-4631917cc0f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:02.921316 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e95ce-770f-40d9-a1e6-4631917cc0f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:02.922763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e95ce-770f-40d9-a1e6-4631917cc0f8 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:02.999842 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1202/2399] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:44:02 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:44:03.002163 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf186f-d601-496c-944c-918a203df824 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:03.016613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf186f-d601-496c-944c-918a203df824 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:03.095470 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6154e-bf62-40c2-b8d6-0ffd442e897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:03.096309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6154e-bf62-40c2-b8d6-0ffd442e897b admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:03.096594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6154e-bf62-40c2-b8d6-0ffd442e897b admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:03.096872 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6154e-bf62-40c2-b8d6-0ffd442e897b admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:03.098141 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6154e-bf62-40c2-b8d6-0ffd442e897b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:03.100603 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6154e-bf62-40c2-b8d6-0ffd442e897b admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:03.208530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1198/2400] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:44:03 2022] POST /identity/v3/users => generated 298 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:44:03.212210 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e95ce-770f-40d9-a1e6-4631917cc0f8 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:03.226905 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e95ce-770f-40d9-a1e6-4631917cc0f8 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:03.233193 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda69c28-73f4-4b4c-af2f-f3b6bb6476b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:03.233998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda69c28-73f4-4b4c-af2f-f3b6bb6476b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:03.234349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda69c28-73f4-4b4c-af2f-f3b6bb6476b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:03.234690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda69c28-73f4-4b4c-af2f-f3b6bb6476b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:03.235487 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda69c28-73f4-4b4c-af2f-f3b6bb6476b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:03.237218 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda69c28-73f4-4b4c-af2f-f3b6bb6476b2 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:03.265249 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1203/2401] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:44:03.269976 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6154e-bf62-40c2-b8d6-0ffd442e897b admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:03.281922 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6154e-bf62-40c2-b8d6-0ffd442e897b admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:03.288244 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1547e-ba44-4d8f-87b1-952714f64b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:03.289960 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1547e-ba44-4d8f-87b1-952714f64b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:03.290318 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1547e-ba44-4d8f-87b1-952714f64b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:03.290667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1547e-ba44-4d8f-87b1-952714f64b73 admin admin] PATH_INFO: `/v3/projects/f7688803d5c94ad28401d04b8b8fc104/users/9ec3b7e83aef4fd9a254297de14cb1d0/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:03.317944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1547e-ba44-4d8f-87b1-952714f64b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7688803d5c94ad28401d04b8b8fc104, user_id=9ec3b7e83aef4fd9a254297de14cb1d0, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:03.320986 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1547e-ba44-4d8f-87b1-952714f64b73 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:03.383743 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1199/2402] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:44:03 2022] PUT /identity/v3/projects/f7688803d5c94ad28401d04b8b8fc104/users/9ec3b7e83aef4fd9a254297de14cb1d0/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:03.387632 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda69c28-73f4-4b4c-af2f-f3b6bb6476b2 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:03.398414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda69c28-73f4-4b4c-af2f-f3b6bb6476b2 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:03.465911 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ffbbe-c948-4ad2-aa06-6b8c73ea7542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:03.467069 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ffbbe-c948-4ad2-aa06-6b8c73ea7542 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:03.467069 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ffbbe-c948-4ad2-aa06-6b8c73ea7542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:03.467349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ffbbe-c948-4ad2-aa06-6b8c73ea7542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:03.468083 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ffbbe-c948-4ad2-aa06-6b8c73ea7542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:03.469847 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ffbbe-c948-4ad2-aa06-6b8c73ea7542 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:03.481255 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1204/2403] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:44:03.485440 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1547e-ba44-4d8f-87b1-952714f64b73 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:03.502934 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1547e-ba44-4d8f-87b1-952714f64b73 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:03.511524 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3459a-cebb-4eb2-8597-651204e87288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:03.512924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3459a-cebb-4eb2-8597-651204e87288 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:03.513077 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3459a-cebb-4eb2-8597-651204e87288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:03.513510 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3459a-cebb-4eb2-8597-651204e87288 admin admin] PATH_INFO: `/v3/projects/f7688803d5c94ad28401d04b8b8fc104/users/9ec3b7e83aef4fd9a254297de14cb1d0/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:03.515671 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3459a-cebb-4eb2-8597-651204e87288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7688803d5c94ad28401d04b8b8fc104, user_id=9ec3b7e83aef4fd9a254297de14cb1d0, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:03.518543 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3459a-cebb-4eb2-8597-651204e87288 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:03.530105 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1200/2404] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:44:03 2022] PUT /identity/v3/projects/f7688803d5c94ad28401d04b8b8fc104/users/9ec3b7e83aef4fd9a254297de14cb1d0/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:03.542306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216726f-3650-4b5a-b978-4089ffe3df65 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:03.542596 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216726f-3650-4b5a-b978-4089ffe3df65 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:03.544460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216726f-3650-4b5a-b978-4089ffe3df65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:03.571417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-d216726f-3650-4b5a-b978-4089ffe3df65 None None] MFA Rules not processed for user `9ec3b7e83aef4fd9a254297de14cb1d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:03.575203 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-d216726f-3650-4b5a-b978-4089ffe3df65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:03.667782 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1205/2405] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:03.679745 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3459a-cebb-4eb2-8597-651204e87288 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:03.681579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f7a3459a-cebb-4eb2-8597-651204e87288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:03.686982 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:03.739245 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3459a-cebb-4eb2-8597-651204e87288 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:03.743614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e9932-234d-4003-ab4b-e250dd5ad760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:03.744315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e9932-234d-4003-ab4b-e250dd5ad760 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:03.744805 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e9932-234d-4003-ab4b-e250dd5ad760 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:03.745094 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e9932-234d-4003-ab4b-e250dd5ad760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:03.757876 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e9932-234d-4003-ab4b-e250dd5ad760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:03.759649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e9932-234d-4003-ab4b-e250dd5ad760 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:03.773185 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1201/2406] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:44:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:44:03.921722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216726f-3650-4b5a-b978-4089ffe3df65 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:03.931799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216726f-3650-4b5a-b978-4089ffe3df65 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:03.935588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e87b5b-500d-4a1e-8259-d0a7ad6d9ee6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:03.936232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e87b5b-500d-4a1e-8259-d0a7ad6d9ee6 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:03.936520 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e87b5b-500d-4a1e-8259-d0a7ad6d9ee6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:03.936843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e87b5b-500d-4a1e-8259-d0a7ad6d9ee6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:03.950435 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:03.996618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e87b5b-500d-4a1e-8259-d0a7ad6d9ee6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:03.998197 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e87b5b-500d-4a1e-8259-d0a7ad6d9ee6 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:04.008382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1206/2407] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:44:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:44:04.448714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e9932-234d-4003-ab4b-e250dd5ad760 service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:04.517986 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e9932-234d-4003-ab4b-e250dd5ad760 service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:04.523213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89813b-2399-472c-ac1f-a6e187204586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:04.524082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89813b-2399-472c-ac1f-a6e187204586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:04.524364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89813b-2399-472c-ac1f-a6e187204586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:04.524641 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89813b-2399-472c-ac1f-a6e187204586 admin admin] PATH_INFO: `/v3/users/c1e3599f2be74125ad83a4b777c1bf41` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:04.525852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89813b-2399-472c-ac1f-a6e187204586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1e3599f2be74125ad83a4b777c1bf41)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:04.527789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89813b-2399-472c-ac1f-a6e187204586 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:04.734937 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ab89813b-2399-472c-ac1f-a6e187204586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1e3599f2be74125ad83a4b777c1bf41'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:04.747735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ab89813b-2399-472c-ac1f-a6e187204586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1e3599f2be74125ad83a4b777c1bf41'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:04.755612 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ab89813b-2399-472c-ac1f-a6e187204586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1e3599f2be74125ad83a4b777c1bf41'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:04.756344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ab89813b-2399-472c-ac1f-a6e187204586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1e3599f2be74125ad83a4b777c1bf41'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:04.757003 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ab89813b-2399-472c-ac1f-a6e187204586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1e3599f2be74125ad83a4b777c1bf41'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:04.861509 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1202/2408] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:44:04 2022] DELETE /identity/v3/users/c1e3599f2be74125ad83a4b777c1bf41 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:04.866847 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586bb6e-7ea7-4cc5-a12b-defc3f3321ec None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:04.867358 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586bb6e-7ea7-4cc5-a12b-defc3f3321ec None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:04.867845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586bb6e-7ea7-4cc5-a12b-defc3f3321ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:04.895426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-8586bb6e-7ea7-4cc5-a12b-defc3f3321ec None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:04.896678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-8586bb6e-7ea7-4cc5-a12b-defc3f3321ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:04.965199 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1207/2409] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:44:04.976385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89813b-2399-472c-ac1f-a6e187204586 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:04.977892 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ab89813b-2399-472c-ac1f-a6e187204586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:05.012381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:05.046039 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89813b-2399-472c-ac1f-a6e187204586 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:05.053563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cea422-d98c-4f6c-b79e-564e553ea777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:05.053563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cea422-d98c-4f6c-b79e-564e553ea777 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:05.053563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cea422-d98c-4f6c-b79e-564e553ea777 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:05.053563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cea422-d98c-4f6c-b79e-564e553ea777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:05.063656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cea422-d98c-4f6c-b79e-564e553ea777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:05.065145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cea422-d98c-4f6c-b79e-564e553ea777 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:05.088752 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1203/2410] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:44:05.528938 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586bb6e-7ea7-4cc5-a12b-defc3f3321ec None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:05.530439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-8586bb6e-7ea7-4cc5-a12b-defc3f3321ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:05.546523 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586bb6e-7ea7-4cc5-a12b-defc3f3321ec None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:05.554320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f145b-8f34-4b8f-b2c6-55e6c951226e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:05.555389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f145b-8f34-4b8f-b2c6-55e6c951226e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:05.555681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f145b-8f34-4b8f-b2c6-55e6c951226e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:05.555950 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f145b-8f34-4b8f-b2c6-55e6c951226e admin admin] PATH_INFO: `/v3/projects/63b484e27f2b41c0bc1741c8cf78c08f` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:05.567157 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f145b-8f34-4b8f-b2c6-55e6c951226e admin admin] RBAC: Authorizing `identity:delete_project(project_id=63b484e27f2b41c0bc1741c8cf78c08f)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:05.569095 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9f145b-8f34-4b8f-b2c6-55e6c951226e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:05.708569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-2e9f145b-8f34-4b8f-b2c6-55e6c951226e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63b484e27f2b41c0bc1741c8cf78c08f', 'request_id': 'req-2e9f145b-8f34-4b8f-b2c6-55e6c951226e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:05.714651 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-2e9f145b-8f34-4b8f-b2c6-55e6c951226e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63b484e27f2b41c0bc1741c8cf78c08f', 'request_id': 'req-2e9f145b-8f34-4b8f-b2c6-55e6c951226e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:05.773273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-2e9f145b-8f34-4b8f-b2c6-55e6c951226e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63b484e27f2b41c0bc1741c8cf78c08f', 'request_id': 'req-2e9f145b-8f34-4b8f-b2c6-55e6c951226e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:05.787394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-2e9f145b-8f34-4b8f-b2c6-55e6c951226e admin admin] The token cache is being invalidate because project 63b484e27f2b41c0bc1741c8cf78c08f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:44:05.787771 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-2e9f145b-8f34-4b8f-b2c6-55e6c951226e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:05.788564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-2e9f145b-8f34-4b8f-b2c6-55e6c951226e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:05.790571 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1208/2411] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:44:05 2022] DELETE /identity/v3/projects/63b484e27f2b41c0bc1741c8cf78c08f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:05.794279 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cea422-d98c-4f6c-b79e-564e553ea777 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:05.804847 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cea422-d98c-4f6c-b79e-564e553ea777 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:05.876970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2264a6b-89b1-40df-82d8-96989891559f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:05.877953 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2264a6b-89b1-40df-82d8-96989891559f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:05.878609 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2264a6b-89b1-40df-82d8-96989891559f admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:05.878728 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2264a6b-89b1-40df-82d8-96989891559f admin admin] PATH_INFO: `/v3/users/9ec3b7e83aef4fd9a254297de14cb1d0` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:05.880165 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2264a6b-89b1-40df-82d8-96989891559f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec3b7e83aef4fd9a254297de14cb1d0)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:05.882287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2264a6b-89b1-40df-82d8-96989891559f admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:06.076308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a2264a6b-89b1-40df-82d8-96989891559f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec3b7e83aef4fd9a254297de14cb1d0'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:06.089920 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a2264a6b-89b1-40df-82d8-96989891559f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec3b7e83aef4fd9a254297de14cb1d0'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:06.098037 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a2264a6b-89b1-40df-82d8-96989891559f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec3b7e83aef4fd9a254297de14cb1d0'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:06.098882 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a2264a6b-89b1-40df-82d8-96989891559f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec3b7e83aef4fd9a254297de14cb1d0'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:06.099573 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a2264a6b-89b1-40df-82d8-96989891559f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec3b7e83aef4fd9a254297de14cb1d0'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:06.204974 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1204/2412] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:44:05 2022] DELETE /identity/v3/users/9ec3b7e83aef4fd9a254297de14cb1d0 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:06.833985 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f145b-8f34-4b8f-b2c6-55e6c951226e admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:06.835662 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-2e9f145b-8f34-4b8f-b2c6-55e6c951226e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:06.867271 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f145b-8f34-4b8f-b2c6-55e6c951226e admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:06.912941 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:06.932037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e723e8-a852-456a-9e75-604c3a2084dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:06.933037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e723e8-a852-456a-9e75-604c3a2084dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:06.933445 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e723e8-a852-456a-9e75-604c3a2084dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:06.933862 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e723e8-a852-456a-9e75-604c3a2084dd admin admin] PATH_INFO: `/v3/projects/f7688803d5c94ad28401d04b8b8fc104` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:06.935234 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e723e8-a852-456a-9e75-604c3a2084dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7688803d5c94ad28401d04b8b8fc104)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:06.937434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e723e8-a852-456a-9e75-604c3a2084dd admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:07.079169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-05e723e8-a852-456a-9e75-604c3a2084dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7688803d5c94ad28401d04b8b8fc104', 'request_id': 'req-05e723e8-a852-456a-9e75-604c3a2084dd'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:07.087951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-05e723e8-a852-456a-9e75-604c3a2084dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7688803d5c94ad28401d04b8b8fc104', 'request_id': 'req-05e723e8-a852-456a-9e75-604c3a2084dd'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:07.156281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-05e723e8-a852-456a-9e75-604c3a2084dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7688803d5c94ad28401d04b8b8fc104', 'request_id': 'req-05e723e8-a852-456a-9e75-604c3a2084dd'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:07.172811 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-05e723e8-a852-456a-9e75-604c3a2084dd admin admin] The token cache is being invalidate because project f7688803d5c94ad28401d04b8b8fc104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:44:07.173111 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-05e723e8-a852-456a-9e75-604c3a2084dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:07.173836 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-05e723e8-a852-456a-9e75-604c3a2084dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:07.175588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1209/2413] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:44:06 2022] DELETE /identity/v3/projects/f7688803d5c94ad28401d04b8b8fc104 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:07.181239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160d6b6-f8de-4a98-8749-98f22e674b57 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:07.181749 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160d6b6-f8de-4a98-8749-98f22e674b57 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:07.183582 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160d6b6-f8de-4a98-8749-98f22e674b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:07.200651 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-6160d6b6-f8de-4a98-8749-98f22e674b57 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:07.201909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-6160d6b6-f8de-4a98-8749-98f22e674b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:07.248090 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:07.270679 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1205/2414] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:07.279551 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640fdfa-7437-4c8c-ad52-2babf4886127 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:07.280142 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640fdfa-7437-4c8c-ad52-2babf4886127 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:07.281033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640fdfa-7437-4c8c-ad52-2babf4886127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:07.310140 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-c640fdfa-7437-4c8c-ad52-2babf4886127 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:07.311791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c640fdfa-7437-4c8c-ad52-2babf4886127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:07.325660 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1210/2415] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:07.327773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160d6b6-f8de-4a98-8749-98f22e674b57 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:07.341452 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160d6b6-f8de-4a98-8749-98f22e674b57 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:07.347266 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86408390-603a-4a81-9c1d-b4a8b5e29fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:07.348282 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86408390-603a-4a81-9c1d-b4a8b5e29fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:07.348638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86408390-603a-4a81-9c1d-b4a8b5e29fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:07.349150 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86408390-603a-4a81-9c1d-b4a8b5e29fa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:07.350000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86408390-603a-4a81-9c1d-b4a8b5e29fa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:44:07.350380 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86408390-603a-4a81-9c1d-b4a8b5e29fa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:07.352257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86408390-603a-4a81-9c1d-b4a8b5e29fa5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:07.370272 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1206/2416] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:44:07.374050 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640fdfa-7437-4c8c-ad52-2babf4886127 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:07.384377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640fdfa-7437-4c8c-ad52-2babf4886127 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:07.390245 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f3cbb-cbef-474f-ade0-95c98b59b767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:07.390915 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f3cbb-cbef-474f-ade0-95c98b59b767 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:07.391211 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f3cbb-cbef-474f-ade0-95c98b59b767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:07.391475 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f3cbb-cbef-474f-ade0-95c98b59b767 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:07.392612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f3cbb-cbef-474f-ade0-95c98b59b767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:07.395364 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f3cbb-cbef-474f-ade0-95c98b59b767 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:07.487381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1211/2417] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:44:07 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:44:07.488517 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86408390-603a-4a81-9c1d-b4a8b5e29fa5 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:07.498788 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86408390-603a-4a81-9c1d-b4a8b5e29fa5 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:07.557197 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eab7e6-0e93-4d4b-b2b9-223d47c2ec0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:07.557919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eab7e6-0e93-4d4b-b2b9-223d47c2ec0d admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:07.558201 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eab7e6-0e93-4d4b-b2b9-223d47c2ec0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:07.558477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eab7e6-0e93-4d4b-b2b9-223d47c2ec0d admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:07.559165 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eab7e6-0e93-4d4b-b2b9-223d47c2ec0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:07.561177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eab7e6-0e93-4d4b-b2b9-223d47c2ec0d admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:07.587924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f3cbb-cbef-474f-ade0-95c98b59b767 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:07.589822 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c12f3cbb-cbef-474f-ade0-95c98b59b767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:07.602866 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f3cbb-cbef-474f-ade0-95c98b59b767 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:07.608919 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d8194-3fcf-40a5-b3e2-ed83faa28da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:07.609814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d8194-3fcf-40a5-b3e2-ed83faa28da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:07.610101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d8194-3fcf-40a5-b3e2-ed83faa28da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:07.610379 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d8194-3fcf-40a5-b3e2-ed83faa28da0 admin admin] PATH_INFO: `/v3/users/9221f5d77e64478198cb1d50aedb49df` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:07.611594 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d8194-3fcf-40a5-b3e2-ed83faa28da0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9221f5d77e64478198cb1d50aedb49df)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:07.614075 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d8194-3fcf-40a5-b3e2-ed83faa28da0 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:07.644682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1207/2418] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:44:07 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:44:07.653215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eab7e6-0e93-4d4b-b2b9-223d47c2ec0d admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:07.664073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eab7e6-0e93-4d4b-b2b9-223d47c2ec0d admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:07.668743 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1b058-64f6-44f6-8354-1edb6b2d26fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:07.669386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1b058-64f6-44f6-8354-1edb6b2d26fe admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:07.669707 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1b058-64f6-44f6-8354-1edb6b2d26fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:07.669990 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1b058-64f6-44f6-8354-1edb6b2d26fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:07.670703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1b058-64f6-44f6-8354-1edb6b2d26fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:07.672299 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e1b058-64f6-44f6-8354-1edb6b2d26fe admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:07.682744 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1208/2419] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:44:07.686545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1b058-64f6-44f6-8354-1edb6b2d26fe admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:07.696285 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e1b058-64f6-44f6-8354-1edb6b2d26fe admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:07.700933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde48b8-69ca-4730-957f-3da0ee2426e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:07.701578 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde48b8-69ca-4730-957f-3da0ee2426e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:07.701868 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde48b8-69ca-4730-957f-3da0ee2426e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:07.702149 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde48b8-69ca-4730-957f-3da0ee2426e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:07.702847 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde48b8-69ca-4730-957f-3da0ee2426e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:07.704389 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde48b8-69ca-4730-957f-3da0ee2426e5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:07.714847 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1209/2420] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:44:07.718581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde48b8-69ca-4730-957f-3da0ee2426e5 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:07.727960 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde48b8-69ca-4730-957f-3da0ee2426e5 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:07.733078 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f459145-d369-4cc5-bf07-683ba4e27c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:07.737127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f459145-d369-4cc5-bf07-683ba4e27c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:07.737127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f459145-d369-4cc5-bf07-683ba4e27c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:07.737127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f459145-d369-4cc5-bf07-683ba4e27c29 admin admin] PATH_INFO: `/v3/projects/59db82133ff7474ca9718e8bc7fc80dc/users/30606cc997cb4968a9e6e2190895cbe0/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:07.750169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f459145-d369-4cc5-bf07-683ba4e27c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59db82133ff7474ca9718e8bc7fc80dc, user_id=30606cc997cb4968a9e6e2190895cbe0, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:07.752856 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f459145-d369-4cc5-bf07-683ba4e27c29 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:07.843780 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-627d8194-3fcf-40a5-b3e2-ed83faa28da0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9221f5d77e64478198cb1d50aedb49df'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:07.855534 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-627d8194-3fcf-40a5-b3e2-ed83faa28da0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9221f5d77e64478198cb1d50aedb49df'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:07.864176 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1210/2421] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:44:07 2022] PUT /identity/v3/projects/59db82133ff7474ca9718e8bc7fc80dc/users/30606cc997cb4968a9e6e2190895cbe0/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:44:07.864329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-627d8194-3fcf-40a5-b3e2-ed83faa28da0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9221f5d77e64478198cb1d50aedb49df'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:07.865095 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-627d8194-3fcf-40a5-b3e2-ed83faa28da0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9221f5d77e64478198cb1d50aedb49df'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:07.865750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-627d8194-3fcf-40a5-b3e2-ed83faa28da0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9221f5d77e64478198cb1d50aedb49df'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:07.875623 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce436b-e8ae-4871-91aa-19c015e2b3bf None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:07.875904 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce436b-e8ae-4871-91aa-19c015e2b3bf None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:07.876182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce436b-e8ae-4871-91aa-19c015e2b3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:07.902685 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-f6ce436b-e8ae-4871-91aa-19c015e2b3bf None None] MFA Rules not processed for user `30606cc997cb4968a9e6e2190895cbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:07.903899 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f6ce436b-e8ae-4871-91aa-19c015e2b3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:07.944281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1212/2422] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:44:07 2022] DELETE /identity/v3/users/9221f5d77e64478198cb1d50aedb49df => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:44:07.969460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1211/2423] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:44:07.981491 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d8194-3fcf-40a5-b3e2-ed83faa28da0 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:07.982949 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-627d8194-3fcf-40a5-b3e2-ed83faa28da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:07.998122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:08.044381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d8194-3fcf-40a5-b3e2-ed83faa28da0 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:08.048001 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefa93d-df9c-4621-82df-a7e3dee66e5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:08.048655 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefa93d-df9c-4621-82df-a7e3dee66e5e service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:08.051887 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefa93d-df9c-4621-82df-a7e3dee66e5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:08.051887 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefa93d-df9c-4621-82df-a7e3dee66e5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:08.109432 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefa93d-df9c-4621-82df-a7e3dee66e5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:08.110884 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefa93d-df9c-4621-82df-a7e3dee66e5e service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:08.119836 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1213/2424] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:44:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:44:08.175289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce436b-e8ae-4871-91aa-19c015e2b3bf None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:08.176849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f6ce436b-e8ae-4871-91aa-19c015e2b3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:08.187343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:08.249599 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce436b-e8ae-4871-91aa-19c015e2b3bf None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:08.308631 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425b469-8fb1-4601-b902-17c61a3cbf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:08.309488 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425b469-8fb1-4601-b902-17c61a3cbf63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:08.309808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425b469-8fb1-4601-b902-17c61a3cbf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:08.310084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425b469-8fb1-4601-b902-17c61a3cbf63 admin admin] PATH_INFO: `/v3/projects/c8f73890a21a4703961838607cd8d5c8` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:08.311248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425b469-8fb1-4601-b902-17c61a3cbf63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8f73890a21a4703961838607cd8d5c8)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:08.313166 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425b469-8fb1-4601-b902-17c61a3cbf63 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:08.445947 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f425b469-8fb1-4601-b902-17c61a3cbf63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8f73890a21a4703961838607cd8d5c8', 'request_id': 'req-f425b469-8fb1-4601-b902-17c61a3cbf63'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:08.455594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f425b469-8fb1-4601-b902-17c61a3cbf63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8f73890a21a4703961838607cd8d5c8', 'request_id': 'req-f425b469-8fb1-4601-b902-17c61a3cbf63'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:08.461926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f425b469-8fb1-4601-b902-17c61a3cbf63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8f73890a21a4703961838607cd8d5c8', 'request_id': 'req-f425b469-8fb1-4601-b902-17c61a3cbf63'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:08.546924 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f425b469-8fb1-4601-b902-17c61a3cbf63 admin admin] The token cache is being invalidate because project c8f73890a21a4703961838607cd8d5c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:44:08.547240 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f425b469-8fb1-4601-b902-17c61a3cbf63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:08.547868 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f425b469-8fb1-4601-b902-17c61a3cbf63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:08.549432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1212/2425] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:44:08 2022] DELETE /identity/v3/projects/c8f73890a21a4703961838607cd8d5c8 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:08.554113 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefa93d-df9c-4621-82df-a7e3dee66e5e service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:08.565008 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefa93d-df9c-4621-82df-a7e3dee66e5e service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:08.621406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbc91e-65fc-489d-94b3-30471d140d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:08.622302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbc91e-65fc-489d-94b3-30471d140d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:08.622587 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbc91e-65fc-489d-94b3-30471d140d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:08.622865 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbc91e-65fc-489d-94b3-30471d140d03 admin admin] PATH_INFO: `/v3/users/1a6f412e7c3d418782843c2a38d73872` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:08.624061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbc91e-65fc-489d-94b3-30471d140d03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a6f412e7c3d418782843c2a38d73872)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:08.626018 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbc91e-65fc-489d-94b3-30471d140d03 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:08.843726 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e8cbc91e-65fc-489d-94b3-30471d140d03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a6f412e7c3d418782843c2a38d73872'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:08.856666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e8cbc91e-65fc-489d-94b3-30471d140d03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a6f412e7c3d418782843c2a38d73872'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:08.861342 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:08.864734 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e8cbc91e-65fc-489d-94b3-30471d140d03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a6f412e7c3d418782843c2a38d73872'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:08.868438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e8cbc91e-65fc-489d-94b3-30471d140d03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a6f412e7c3d418782843c2a38d73872'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:08.869121 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e8cbc91e-65fc-489d-94b3-30471d140d03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a6f412e7c3d418782843c2a38d73872'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:08.938753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1214/2426] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:44:08 2022] DELETE /identity/v3/users/1a6f412e7c3d418782843c2a38d73872 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:09.169217 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425b469-8fb1-4601-b902-17c61a3cbf63 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:09.170750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f425b469-8fb1-4601-b902-17c61a3cbf63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:09.184360 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425b469-8fb1-4601-b902-17c61a3cbf63 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:09.226897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:09.241332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8192d6b-6c68-434e-8305-244fa34a0582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:09.242275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8192d6b-6c68-434e-8305-244fa34a0582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:09.242572 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8192d6b-6c68-434e-8305-244fa34a0582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:09.242845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8192d6b-6c68-434e-8305-244fa34a0582 admin admin] PATH_INFO: `/v3/projects/3f847fe770f745f1aef45f3545eaf390` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:09.244010 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8192d6b-6c68-434e-8305-244fa34a0582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f847fe770f745f1aef45f3545eaf390)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:09.245932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8192d6b-6c68-434e-8305-244fa34a0582 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:09.348930 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-d8192d6b-6c68-434e-8305-244fa34a0582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f847fe770f745f1aef45f3545eaf390', 'request_id': 'req-d8192d6b-6c68-434e-8305-244fa34a0582'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:09.355113 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-d8192d6b-6c68-434e-8305-244fa34a0582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f847fe770f745f1aef45f3545eaf390', 'request_id': 'req-d8192d6b-6c68-434e-8305-244fa34a0582'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:09.360735 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-d8192d6b-6c68-434e-8305-244fa34a0582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f847fe770f745f1aef45f3545eaf390', 'request_id': 'req-d8192d6b-6c68-434e-8305-244fa34a0582'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:09.449929 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-d8192d6b-6c68-434e-8305-244fa34a0582 admin admin] The token cache is being invalidate because project 3f847fe770f745f1aef45f3545eaf390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:44:09.450228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-d8192d6b-6c68-434e-8305-244fa34a0582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:09.450849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-d8192d6b-6c68-434e-8305-244fa34a0582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:09.452401 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1213/2427] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:44:09 2022] DELETE /identity/v3/projects/3f847fe770f745f1aef45f3545eaf390 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:09.458042 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcd807-cd3a-4adb-a49a-86a8634730ae None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:09.458339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcd807-cd3a-4adb-a49a-86a8634730ae None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:09.458625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcd807-cd3a-4adb-a49a-86a8634730ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:09.477790 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-84fcd807-cd3a-4adb-a49a-86a8634730ae None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:09.479006 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-84fcd807-cd3a-4adb-a49a-86a8634730ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:09.540746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1215/2428] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:09.546335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b112ee6-f058-4cf8-ac08-5696a54afd73 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:09.546632 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b112ee6-f058-4cf8-ac08-5696a54afd73 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:09.546917 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b112ee6-f058-4cf8-ac08-5696a54afd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:09.565762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-5b112ee6-f058-4cf8-ac08-5696a54afd73 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:09.567489 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5b112ee6-f058-4cf8-ac08-5696a54afd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:09.575578 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1214/2429] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:09.580088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcd807-cd3a-4adb-a49a-86a8634730ae None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:09.590429 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcd807-cd3a-4adb-a49a-86a8634730ae None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:09.595018 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748b0e4-44e3-4464-a782-53bcef8d9a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:09.595663 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748b0e4-44e3-4464-a782-53bcef8d9a3d admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:09.596914 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748b0e4-44e3-4464-a782-53bcef8d9a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:09.596914 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748b0e4-44e3-4464-a782-53bcef8d9a3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:09.596914 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748b0e4-44e3-4464-a782-53bcef8d9a3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:44:09.597238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748b0e4-44e3-4464-a782-53bcef8d9a3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:09.598914 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748b0e4-44e3-4464-a782-53bcef8d9a3d admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:09.610564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1216/2430] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:44:09.616435 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b112ee6-f058-4cf8-ac08-5696a54afd73 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:09.625772 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b112ee6-f058-4cf8-ac08-5696a54afd73 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:09.631519 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced70f5-65c4-4e88-8e2a-9672b834fbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:09.632188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced70f5-65c4-4e88-8e2a-9672b834fbf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:09.632477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced70f5-65c4-4e88-8e2a-9672b834fbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:09.632871 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced70f5-65c4-4e88-8e2a-9672b834fbf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:09.633599 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced70f5-65c4-4e88-8e2a-9672b834fbf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:09.635538 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced70f5-65c4-4e88-8e2a-9672b834fbf9 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:09.758021 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1215/2431] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:44:09 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:44:09.762270 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748b0e4-44e3-4464-a782-53bcef8d9a3d admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:09.772833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748b0e4-44e3-4464-a782-53bcef8d9a3d admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:09.835387 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6066ed4-3b52-4eb4-8771-0dccd9cf74d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:09.835387 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6066ed4-3b52-4eb4-8771-0dccd9cf74d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:09.835387 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6066ed4-3b52-4eb4-8771-0dccd9cf74d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:09.835387 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6066ed4-3b52-4eb4-8771-0dccd9cf74d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:09.835798 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6066ed4-3b52-4eb4-8771-0dccd9cf74d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:09.835798 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6066ed4-3b52-4eb4-8771-0dccd9cf74d0 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:09.919613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1217/2432] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:44:09 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:44:09.923807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced70f5-65c4-4e88-8e2a-9672b834fbf9 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:09.934670 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced70f5-65c4-4e88-8e2a-9672b834fbf9 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:09.939206 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6114a01-cdb2-49cd-b278-1a834a869b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:09.939849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6114a01-cdb2-49cd-b278-1a834a869b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:09.940131 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6114a01-cdb2-49cd-b278-1a834a869b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:09.943119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6114a01-cdb2-49cd-b278-1a834a869b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:09.943119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6114a01-cdb2-49cd-b278-1a834a869b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:09.943347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6114a01-cdb2-49cd-b278-1a834a869b05 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:09.954532 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1216/2433] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:44:09.958443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6066ed4-3b52-4eb4-8771-0dccd9cf74d0 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:09.968593 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6066ed4-3b52-4eb4-8771-0dccd9cf74d0 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:09.973546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db7158-4d54-4cdc-b80e-0714ebcb2418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:09.974246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db7158-4d54-4cdc-b80e-0714ebcb2418 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:09.974530 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db7158-4d54-4cdc-b80e-0714ebcb2418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:09.974807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db7158-4d54-4cdc-b80e-0714ebcb2418 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:09.975535 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db7158-4d54-4cdc-b80e-0714ebcb2418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:09.977223 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db7158-4d54-4cdc-b80e-0714ebcb2418 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:09.988682 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1218/2434] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:44:09.992279 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6114a01-cdb2-49cd-b278-1a834a869b05 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:10.002727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6114a01-cdb2-49cd-b278-1a834a869b05 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:10.008238 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9b119-51e3-4914-a977-1234a4d498ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:10.009238 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9b119-51e3-4914-a977-1234a4d498ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:10.009542 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9b119-51e3-4914-a977-1234a4d498ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:10.009836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9b119-51e3-4914-a977-1234a4d498ae admin admin] PATH_INFO: `/v3/projects/99cd7b7979214fe380423b7b52e05e59/users/99f3fb6b49934fa6baa5b16b22528f1d/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:10.024616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9b119-51e3-4914-a977-1234a4d498ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=99cd7b7979214fe380423b7b52e05e59, user_id=99f3fb6b49934fa6baa5b16b22528f1d, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:10.027361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9b119-51e3-4914-a977-1234a4d498ae admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:10.116736 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1217/2435] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:44:09 2022] PUT /identity/v3/projects/99cd7b7979214fe380423b7b52e05e59/users/99f3fb6b49934fa6baa5b16b22528f1d/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:10.121858 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21235f2d-fa24-4c7f-899b-2ead082aa02f None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:10.122228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21235f2d-fa24-4c7f-899b-2ead082aa02f None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:10.122510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21235f2d-fa24-4c7f-899b-2ead082aa02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:10.141342 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-21235f2d-fa24-4c7f-899b-2ead082aa02f None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:10.142640 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-21235f2d-fa24-4c7f-899b-2ead082aa02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:10.194079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:10.206626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1219/2436] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:10.217133 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9b119-51e3-4914-a977-1234a4d498ae admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:10.218884 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5de9b119-51e3-4914-a977-1234a4d498ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:10.277207 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9b119-51e3-4914-a977-1234a4d498ae admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:10.280932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0b5a6-588c-4ef6-a39b-63d239a14598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:10.281613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0b5a6-588c-4ef6-a39b-63d239a14598 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:10.281900 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0b5a6-588c-4ef6-a39b-63d239a14598 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:10.282192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0b5a6-588c-4ef6-a39b-63d239a14598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:10.292394 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0b5a6-588c-4ef6-a39b-63d239a14598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:10.293977 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0b5a6-588c-4ef6-a39b-63d239a14598 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:10.305256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1218/2437] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:44:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:44:16.166168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9008d-b7b7-4156-89cb-3fb02dd03644 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:16.168160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9008d-b7b7-4156-89cb-3fb02dd03644 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:16.168160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9008d-b7b7-4156-89cb-3fb02dd03644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:16.199676 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-d1f9008d-b7b7-4156-89cb-3fb02dd03644 None None] MFA Rules not processed for user `99f3fb6b49934fa6baa5b16b22528f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:16.200917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-d1f9008d-b7b7-4156-89cb-3fb02dd03644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:16.270575 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1220/2438] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:16.275120 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0b5a6-588c-4ef6-a39b-63d239a14598 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:16.285935 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0b5a6-588c-4ef6-a39b-63d239a14598 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:16.290586 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed91678-1ccd-44a1-9088-06e3aaa3dc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:16.291223 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed91678-1ccd-44a1-9088-06e3aaa3dc16 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:16.291502 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed91678-1ccd-44a1-9088-06e3aaa3dc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:16.291775 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed91678-1ccd-44a1-9088-06e3aaa3dc16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:16.292455 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed91678-1ccd-44a1-9088-06e3aaa3dc16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:16.294420 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed91678-1ccd-44a1-9088-06e3aaa3dc16 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:16.307393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:16.375262 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1219/2439] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:44:16 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:44:16.379224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9008d-b7b7-4156-89cb-3fb02dd03644 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:16.390400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9008d-b7b7-4156-89cb-3fb02dd03644 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:16.447645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bf097-a7f1-406b-a274-ea67c153597c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:16.448235 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bf097-a7f1-406b-a274-ea67c153597c admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:16.448522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bf097-a7f1-406b-a274-ea67c153597c admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:16.448835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457bf097-a7f1-406b-a274-ea67c153597c admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:16.449519 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bf097-a7f1-406b-a274-ea67c153597c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:16.451516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457bf097-a7f1-406b-a274-ea67c153597c admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:16.513269 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1221/2440] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:44:16 2022] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:44:16.517247 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed91678-1ccd-44a1-9088-06e3aaa3dc16 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:16.528145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed91678-1ccd-44a1-9088-06e3aaa3dc16 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:16.532870 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d1bc0-d939-462d-b1b9-c0a42ccca09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:16.533553 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d1bc0-d939-462d-b1b9-c0a42ccca09c admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:16.533836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d1bc0-d939-462d-b1b9-c0a42ccca09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:16.534116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d1bc0-d939-462d-b1b9-c0a42ccca09c admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:16.535460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d1bc0-d939-462d-b1b9-c0a42ccca09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:16.537161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d1bc0-d939-462d-b1b9-c0a42ccca09c admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:16.547612 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1220/2441] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:44:16.551659 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bf097-a7f1-406b-a274-ea67c153597c admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:16.561496 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457bf097-a7f1-406b-a274-ea67c153597c admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:16.566485 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329b0d9-a995-4b2a-a763-d4b7a41fd501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:16.567384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329b0d9-a995-4b2a-a763-d4b7a41fd501 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:16.567670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329b0d9-a995-4b2a-a763-d4b7a41fd501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:16.567949 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329b0d9-a995-4b2a-a763-d4b7a41fd501 admin admin] PATH_INFO: `/v3/projects/65e64862e9ef4a79b89322c97933dabb/users/47290b6fa0554100b57ff26522c52d73/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:16.584432 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329b0d9-a995-4b2a-a763-d4b7a41fd501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e64862e9ef4a79b89322c97933dabb, user_id=47290b6fa0554100b57ff26522c52d73, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:16.587107 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329b0d9-a995-4b2a-a763-d4b7a41fd501 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:16.665651 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1222/2442] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:44:16 2022] PUT /identity/v3/projects/65e64862e9ef4a79b89322c97933dabb/users/47290b6fa0554100b57ff26522c52d73/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:16.669475 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d1bc0-d939-462d-b1b9-c0a42ccca09c admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:16.683465 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d1bc0-d939-462d-b1b9-c0a42ccca09c admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:16.746488 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387789b3-1378-4bce-bee3-4a3996ff3ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:16.747085 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387789b3-1378-4bce-bee3-4a3996ff3ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:16.747369 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387789b3-1378-4bce-bee3-4a3996ff3ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:16.747669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387789b3-1378-4bce-bee3-4a3996ff3ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:16.748555 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387789b3-1378-4bce-bee3-4a3996ff3ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:16.750323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387789b3-1378-4bce-bee3-4a3996ff3ba7 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:16.761045 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1221/2443] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:44:16.765434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329b0d9-a995-4b2a-a763-d4b7a41fd501 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:16.777927 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329b0d9-a995-4b2a-a763-d4b7a41fd501 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:16.782751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162bc75-87b2-4656-aba8-2411ed2c4db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:16.783801 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162bc75-87b2-4656-aba8-2411ed2c4db9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:16.784079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162bc75-87b2-4656-aba8-2411ed2c4db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:16.784402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162bc75-87b2-4656-aba8-2411ed2c4db9 admin admin] PATH_INFO: `/v3/projects/65e64862e9ef4a79b89322c97933dabb/users/47290b6fa0554100b57ff26522c52d73/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:16.787093 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162bc75-87b2-4656-aba8-2411ed2c4db9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65e64862e9ef4a79b89322c97933dabb, user_id=47290b6fa0554100b57ff26522c52d73, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:16.789971 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162bc75-87b2-4656-aba8-2411ed2c4db9 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:16.801909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1223/2444] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:44:16 2022] PUT /identity/v3/projects/65e64862e9ef4a79b89322c97933dabb/users/47290b6fa0554100b57ff26522c52d73/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:44:22.588776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbaf3b-994a-4033-b654-ab7499f2ac32 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:22.589249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbaf3b-994a-4033-b654-ab7499f2ac32 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:22.589380 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbaf3b-994a-4033-b654-ab7499f2ac32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:22.623205 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-5dcbaf3b-994a-4033-b654-ab7499f2ac32 None None] MFA Rules not processed for user `47290b6fa0554100b57ff26522c52d73`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:22.624545 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5dcbaf3b-994a-4033-b654-ab7499f2ac32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:22.706831 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1222/2445] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:22.724744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162bc75-87b2-4656-aba8-2411ed2c4db9 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:22.727186 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e162bc75-87b2-4656-aba8-2411ed2c4db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:22.783661 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:22.819359 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162bc75-87b2-4656-aba8-2411ed2c4db9 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:22.825081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a92fa-0661-4e0f-a35e-4a1109697c97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:22.825769 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a92fa-0661-4e0f-a35e-4a1109697c97 service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:22.826053 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a92fa-0661-4e0f-a35e-4a1109697c97 service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:22.826328 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a92fa-0661-4e0f-a35e-4a1109697c97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:22.888049 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a92fa-0661-4e0f-a35e-4a1109697c97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:22.889935 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a92fa-0661-4e0f-a35e-4a1109697c97 service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:22.899754 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1224/2446] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:44:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:44:32.591606 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbaf3b-994a-4033-b654-ab7499f2ac32 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:32.593068 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5dcbaf3b-994a-4033-b654-ab7499f2ac32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:32.660605 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbaf3b-994a-4033-b654-ab7499f2ac32 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:32.665133 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0589cc8-b775-412f-8996-44b5b20b8cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:32.666035 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0589cc8-b775-412f-8996-44b5b20b8cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:32.666311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0589cc8-b775-412f-8996-44b5b20b8cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:32.666580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0589cc8-b775-412f-8996-44b5b20b8cf3 admin admin] PATH_INFO: `/v3/users/30606cc997cb4968a9e6e2190895cbe0` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:32.667755 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0589cc8-b775-412f-8996-44b5b20b8cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30606cc997cb4968a9e6e2190895cbe0)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:32.669697 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0589cc8-b775-412f-8996-44b5b20b8cf3 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:32.672095 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:32.912534 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-e0589cc8-b775-412f-8996-44b5b20b8cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30606cc997cb4968a9e6e2190895cbe0'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:32.924480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-e0589cc8-b775-412f-8996-44b5b20b8cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30606cc997cb4968a9e6e2190895cbe0'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:32.932123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-e0589cc8-b775-412f-8996-44b5b20b8cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30606cc997cb4968a9e6e2190895cbe0'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:32.932796 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-e0589cc8-b775-412f-8996-44b5b20b8cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30606cc997cb4968a9e6e2190895cbe0'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:32.933408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-e0589cc8-b775-412f-8996-44b5b20b8cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30606cc997cb4968a9e6e2190895cbe0'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:33.002109 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=40 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:33.008558 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1223/2447] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:44:32 2022] DELETE /identity/v3/users/30606cc997cb4968a9e6e2190895cbe0 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:33.013161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08772ce-686f-4361-a8f2-2ae940099af1 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:33.013726 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08772ce-686f-4361-a8f2-2ae940099af1 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:33.014152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08772ce-686f-4361-a8f2-2ae940099af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:33.035294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-a08772ce-686f-4361-a8f2-2ae940099af1 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:33.036608 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a08772ce-686f-4361-a8f2-2ae940099af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:33.106078 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1225/2448] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:33.119052 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0589cc8-b775-412f-8996-44b5b20b8cf3 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:33.120718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e0589cc8-b775-412f-8996-44b5b20b8cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:33.183125 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0589cc8-b775-412f-8996-44b5b20b8cf3 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:33.187100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923113f1-1606-4575-9810-57bb6bebcf0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:33.187858 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923113f1-1606-4575-9810-57bb6bebcf0b service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:33.188209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923113f1-1606-4575-9810-57bb6bebcf0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:33.188563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923113f1-1606-4575-9810-57bb6bebcf0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:33.198300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923113f1-1606-4575-9810-57bb6bebcf0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:33.199753 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923113f1-1606-4575-9810-57bb6bebcf0b service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:33.210351 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1224/2449] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:44:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:44:33.620606 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08772ce-686f-4361-a8f2-2ae940099af1 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:33.622049 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a08772ce-686f-4361-a8f2-2ae940099af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:33.635326 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08772ce-686f-4361-a8f2-2ae940099af1 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:33.640055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626d2e4-8fd8-43c0-a162-5ad341cf275e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:33.640923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626d2e4-8fd8-43c0-a162-5ad341cf275e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:33.646370 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626d2e4-8fd8-43c0-a162-5ad341cf275e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:33.646370 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626d2e4-8fd8-43c0-a162-5ad341cf275e admin admin] PATH_INFO: `/v3/projects/59db82133ff7474ca9718e8bc7fc80dc` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:33.646370 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626d2e4-8fd8-43c0-a162-5ad341cf275e admin admin] RBAC: Authorizing `identity:delete_project(project_id=59db82133ff7474ca9718e8bc7fc80dc)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:33.646370 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626d2e4-8fd8-43c0-a162-5ad341cf275e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:33.772352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a626d2e4-8fd8-43c0-a162-5ad341cf275e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59db82133ff7474ca9718e8bc7fc80dc', 'request_id': 'req-a626d2e4-8fd8-43c0-a162-5ad341cf275e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:33.781211 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a626d2e4-8fd8-43c0-a162-5ad341cf275e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59db82133ff7474ca9718e8bc7fc80dc', 'request_id': 'req-a626d2e4-8fd8-43c0-a162-5ad341cf275e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:33.852989 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a626d2e4-8fd8-43c0-a162-5ad341cf275e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59db82133ff7474ca9718e8bc7fc80dc', 'request_id': 'req-a626d2e4-8fd8-43c0-a162-5ad341cf275e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:33.868626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a626d2e4-8fd8-43c0-a162-5ad341cf275e admin admin] The token cache is being invalidate because project 59db82133ff7474ca9718e8bc7fc80dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:44:33.869064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a626d2e4-8fd8-43c0-a162-5ad341cf275e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:33.869866 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a626d2e4-8fd8-43c0-a162-5ad341cf275e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:33.871613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1226/2450] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:44:33 2022] DELETE /identity/v3/projects/59db82133ff7474ca9718e8bc7fc80dc => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:33.876466 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca253b-f2d0-4963-9c49-39edbeadc69f None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:33.881577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca253b-f2d0-4963-9c49-39edbeadc69f None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:33.881577 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca253b-f2d0-4963-9c49-39edbeadc69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:33.896608 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-90ca253b-f2d0-4963-9c49-39edbeadc69f None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:33.897884 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-90ca253b-f2d0-4963-9c49-39edbeadc69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:33.967755 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1225/2451] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:33.979013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073cb19-8d12-40a4-98a8-c13b15227bd5 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:33.979434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073cb19-8d12-40a4-98a8-c13b15227bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:33.979782 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073cb19-8d12-40a4-98a8-c13b15227bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:34.000507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-e073cb19-8d12-40a4-98a8-c13b15227bd5 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:34.001824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e073cb19-8d12-40a4-98a8-c13b15227bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:34.014953 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1227/2452] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:34.017259 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca253b-f2d0-4963-9c49-39edbeadc69f None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:34.028965 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca253b-f2d0-4963-9c49-39edbeadc69f None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:34.033981 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0b53b-fb68-42a2-ba9b-b9fa1f93354b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:34.035308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0b53b-fb68-42a2-ba9b-b9fa1f93354b admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:34.035595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0b53b-fb68-42a2-ba9b-b9fa1f93354b admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:34.035874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0b53b-fb68-42a2-ba9b-b9fa1f93354b admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:34.036609 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0b53b-fb68-42a2-ba9b-b9fa1f93354b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:44:34.036921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0b53b-fb68-42a2-ba9b-b9fa1f93354b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:34.038576 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0b53b-fb68-42a2-ba9b-b9fa1f93354b admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:34.051398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1226/2453] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:44:34.055998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073cb19-8d12-40a4-98a8-c13b15227bd5 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:34.065761 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073cb19-8d12-40a4-98a8-c13b15227bd5 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:34.070532 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5042bb6-bb03-49a8-8dfd-64c29f47730e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:34.071204 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5042bb6-bb03-49a8-8dfd-64c29f47730e admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:34.071494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5042bb6-bb03-49a8-8dfd-64c29f47730e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:34.071773 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5042bb6-bb03-49a8-8dfd-64c29f47730e admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:34.072485 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5042bb6-bb03-49a8-8dfd-64c29f47730e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:34.076948 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5042bb6-bb03-49a8-8dfd-64c29f47730e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:34.199396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1228/2454] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:44:34 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:44:34.203893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0b53b-fb68-42a2-ba9b-b9fa1f93354b admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:34.215293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0b53b-fb68-42a2-ba9b-b9fa1f93354b admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:34.223987 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:34.280495 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f512e-4dcf-488f-90ec-727878d4b338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:34.281220 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f512e-4dcf-488f-90ec-727878d4b338 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:34.281511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f512e-4dcf-488f-90ec-727878d4b338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:34.281830 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f512e-4dcf-488f-90ec-727878d4b338 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:34.282569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f512e-4dcf-488f-90ec-727878d4b338 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:34.284916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f512e-4dcf-488f-90ec-727878d4b338 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:34.356075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1227/2455] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:44:34 2022] POST /identity/v3/users => generated 285 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:44:34.360508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5042bb6-bb03-49a8-8dfd-64c29f47730e admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:34.371768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5042bb6-bb03-49a8-8dfd-64c29f47730e admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:34.376485 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f34ef-d483-4f48-8c06-1ff76a208c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:34.377188 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f34ef-d483-4f48-8c06-1ff76a208c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:34.377472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f34ef-d483-4f48-8c06-1ff76a208c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:34.378318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f34ef-d483-4f48-8c06-1ff76a208c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:34.379121 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f34ef-d483-4f48-8c06-1ff76a208c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:34.380727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f34ef-d483-4f48-8c06-1ff76a208c23 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:34.393415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1229/2456] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:44:34.398276 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f512e-4dcf-488f-90ec-727878d4b338 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:34.408174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f512e-4dcf-488f-90ec-727878d4b338 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:34.414366 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f139a-1ed7-4ca8-b585-ed793cd7e11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:34.415145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f139a-1ed7-4ca8-b585-ed793cd7e11d admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:34.415425 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f139a-1ed7-4ca8-b585-ed793cd7e11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:34.415701 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f139a-1ed7-4ca8-b585-ed793cd7e11d admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:34.416494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f139a-1ed7-4ca8-b585-ed793cd7e11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:34.418659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654f139a-1ed7-4ca8-b585-ed793cd7e11d admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:34.431358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1228/2457] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:44:34.435378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f34ef-d483-4f48-8c06-1ff76a208c23 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:34.446783 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f34ef-d483-4f48-8c06-1ff76a208c23 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:34.451476 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeff448-7830-413a-96c9-30fd588e2e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:34.452354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeff448-7830-413a-96c9-30fd588e2e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:34.452640 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeff448-7830-413a-96c9-30fd588e2e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:34.452943 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeff448-7830-413a-96c9-30fd588e2e27 admin admin] PATH_INFO: `/v3/projects/6e64dc0f148c467f9264d77500a37316/users/8519fad7798245f4b7b11f3b7182494d/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:34.470323 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeff448-7830-413a-96c9-30fd588e2e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e64dc0f148c467f9264d77500a37316, user_id=8519fad7798245f4b7b11f3b7182494d, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:34.473343 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeff448-7830-413a-96c9-30fd588e2e27 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:34.568051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1230/2458] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:44:34 2022] PUT /identity/v3/projects/6e64dc0f148c467f9264d77500a37316/users/8519fad7798245f4b7b11f3b7182494d/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:34.578601 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b23e3-421d-46dc-8bc4-4cf63ce78b3e None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:34.578960 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b23e3-421d-46dc-8bc4-4cf63ce78b3e None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:34.579246 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b23e3-421d-46dc-8bc4-4cf63ce78b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:34.606255 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-d81b23e3-421d-46dc-8bc4-4cf63ce78b3e None None] MFA Rules not processed for user `8519fad7798245f4b7b11f3b7182494d`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:34.607919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-d81b23e3-421d-46dc-8bc4-4cf63ce78b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:34.681046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1229/2459] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:34.699703 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeff448-7830-413a-96c9-30fd588e2e27 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:34.701676 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9eeff448-7830-413a-96c9-30fd588e2e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:34.726688 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:34.775158 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeff448-7830-413a-96c9-30fd588e2e27 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:34.779321 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77626c89-556a-4dc7-8298-4b9a203421b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b27a4861d6b4ddfaca1a97efdaf008d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:34.780145 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77626c89-556a-4dc7-8298-4b9a203421b8 service glance] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:34.780566 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77626c89-556a-4dc7-8298-4b9a203421b8 service glance] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:34.780871 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77626c89-556a-4dc7-8298-4b9a203421b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:34.794596 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77626c89-556a-4dc7-8298-4b9a203421b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:34.796135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77626c89-556a-4dc7-8298-4b9a203421b8 service glance] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:34.807226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1231/2460] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:44:34 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:44:43.823513 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b23e3-421d-46dc-8bc4-4cf63ce78b3e None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:43.823513 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-d81b23e3-421d-46dc-8bc4-4cf63ce78b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:43.868680 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77626c89-556a-4dc7-8298-4b9a203421b8 service glance] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:43.872423 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-77626c89-556a-4dc7-8298-4b9a203421b8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:43.891194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b23e3-421d-46dc-8bc4-4cf63ce78b3e None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:43.896116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d98a54-732d-4883-854d-59efeb119a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:43.896782 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d98a54-732d-4883-854d-59efeb119a78 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:43.897047 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d98a54-732d-4883-854d-59efeb119a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:43.897322 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d98a54-732d-4883-854d-59efeb119a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:43.899143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-73d98a54-732d-4883-854d-59efeb119a78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:43.940675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:43.943734 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77626c89-556a-4dc7-8298-4b9a203421b8 service glance] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:43.947335 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d13e8-7441-4ad3-9d08-8fb5d5b2a4c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:43.947978 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d13e8-7441-4ad3-9d08-8fb5d5b2a4c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:43.948356 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d13e8-7441-4ad3-9d08-8fb5d5b2a4c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:43.948694 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d13e8-7441-4ad3-9d08-8fb5d5b2a4c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:43.950521 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-6d3d13e8-7441-4ad3-9d08-8fb5d5b2a4c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:43.970536 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d98a54-732d-4883-854d-59efeb119a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:43.972592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d98a54-732d-4883-854d-59efeb119a78 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:43.983102 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1230/2461] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:44:43.984008 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d98a54-732d-4883-854d-59efeb119a78 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:43.985713 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-73d98a54-732d-4883-854d-59efeb119a78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:44.022399 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d13e8-7441-4ad3-9d08-8fb5d5b2a4c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:44.023867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d13e8-7441-4ad3-9d08-8fb5d5b2a4c5 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:44.036298 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1232/2462] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:44:44.072699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d98a54-732d-4883-854d-59efeb119a78 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:44.078216 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b254ee-6a0c-47d6-8a24-1b589f2b9bcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:44.078867 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b254ee-6a0c-47d6-8a24-1b589f2b9bcf service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:44.079151 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b254ee-6a0c-47d6-8a24-1b589f2b9bcf service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:44.079427 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b254ee-6a0c-47d6-8a24-1b589f2b9bcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:44.081262 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b5b254ee-6a0c-47d6-8a24-1b589f2b9bcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:44.155513 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b254ee-6a0c-47d6-8a24-1b589f2b9bcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:44.157230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b254ee-6a0c-47d6-8a24-1b589f2b9bcf service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:44.167251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1231/2463] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:44:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:44:46.314491 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b062ccd-5b46-4ded-b8a0-64a04730a2c9 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:46.315055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b062ccd-5b46-4ded-b8a0-64a04730a2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:46.315055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b062ccd-5b46-4ded-b8a0-64a04730a2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:46.333553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-1b062ccd-5b46-4ded-b8a0-64a04730a2c9 None None] MFA Rules not processed for user `99f3fb6b49934fa6baa5b16b22528f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:46.334795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-1b062ccd-5b46-4ded-b8a0-64a04730a2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:46.414685 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1233/2464] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:49.464897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b254ee-6a0c-47d6-8a24-1b589f2b9bcf service nova] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:49.466530 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b5b254ee-6a0c-47d6-8a24-1b589f2b9bcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:49.497842 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b254ee-6a0c-47d6-8a24-1b589f2b9bcf service nova] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:49.504360 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbcd57-40f8-4225-a13e-34bc96b9fae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:49.505257 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbcd57-40f8-4225-a13e-34bc96b9fae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:49.505554 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbcd57-40f8-4225-a13e-34bc96b9fae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:49.505843 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbcd57-40f8-4225-a13e-34bc96b9fae5 admin admin] PATH_INFO: `/v3/users/a8e20ceefdcd48c88cf35ecf0bcd736b` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:49.508408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbcd57-40f8-4225-a13e-34bc96b9fae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e20ceefdcd48c88cf35ecf0bcd736b)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:49.512784 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbcd57-40f8-4225-a13e-34bc96b9fae5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:49.760362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-14bbcd57-40f8-4225-a13e-34bc96b9fae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e20ceefdcd48c88cf35ecf0bcd736b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:49.773501 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:49.776362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-14bbcd57-40f8-4225-a13e-34bc96b9fae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e20ceefdcd48c88cf35ecf0bcd736b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:49.791622 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-14bbcd57-40f8-4225-a13e-34bc96b9fae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e20ceefdcd48c88cf35ecf0bcd736b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:49.792628 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-14bbcd57-40f8-4225-a13e-34bc96b9fae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e20ceefdcd48c88cf35ecf0bcd736b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:49.794185 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-14bbcd57-40f8-4225-a13e-34bc96b9fae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e20ceefdcd48c88cf35ecf0bcd736b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:49.887005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1232/2465] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:44:49 2022] DELETE /identity/v3/users/a8e20ceefdcd48c88cf35ecf0bcd736b => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:50.138258 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b062ccd-5b46-4ded-b8a0-64a04730a2c9 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:50.139730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-1b062ccd-5b46-4ded-b8a0-64a04730a2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:50.156012 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b062ccd-5b46-4ded-b8a0-64a04730a2c9 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:50.172206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:50.213948 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d033d5-e5d8-4aa7-9ab6-7a4a6e9b530b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:50.217723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d033d5-e5d8-4aa7-9ab6-7a4a6e9b530b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:50.218137 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d033d5-e5d8-4aa7-9ab6-7a4a6e9b530b admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:50.218452 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d033d5-e5d8-4aa7-9ab6-7a4a6e9b530b admin admin] PATH_INFO: `/v3/users/fb4b22bc322c419bab3445f7dfb186fb` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:50.219814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d033d5-e5d8-4aa7-9ab6-7a4a6e9b530b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb4b22bc322c419bab3445f7dfb186fb)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:50.221982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d033d5-e5d8-4aa7-9ab6-7a4a6e9b530b admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:50.226143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbcd57-40f8-4225-a13e-34bc96b9fae5 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:50.227122 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-14bbcd57-40f8-4225-a13e-34bc96b9fae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:50.242365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbcd57-40f8-4225-a13e-34bc96b9fae5 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:50.247307 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c6a1c-9cda-42e7-8fdb-55c322328d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:50.248249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c6a1c-9cda-42e7-8fdb-55c322328d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:50.248537 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c6a1c-9cda-42e7-8fdb-55c322328d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:50.248827 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c6a1c-9cda-42e7-8fdb-55c322328d4e admin admin] PATH_INFO: `/v3/projects/e70d3c63003440bc9ed504fcef81f783` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:50.250123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c6a1c-9cda-42e7-8fdb-55c322328d4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e70d3c63003440bc9ed504fcef81f783)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:50.255083 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c6a1c-9cda-42e7-8fdb-55c322328d4e admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:50.385115 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-d6d033d5-e5d8-4aa7-9ab6-7a4a6e9b530b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb4b22bc322c419bab3445f7dfb186fb'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:50.386015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a87c6a1c-9cda-42e7-8fdb-55c322328d4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e70d3c63003440bc9ed504fcef81f783', 'request_id': 'req-a87c6a1c-9cda-42e7-8fdb-55c322328d4e'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:50.393283 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a87c6a1c-9cda-42e7-8fdb-55c322328d4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e70d3c63003440bc9ed504fcef81f783', 'request_id': 'req-a87c6a1c-9cda-42e7-8fdb-55c322328d4e'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:50.399369 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-d6d033d5-e5d8-4aa7-9ab6-7a4a6e9b530b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb4b22bc322c419bab3445f7dfb186fb'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:50.399693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a87c6a1c-9cda-42e7-8fdb-55c322328d4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e70d3c63003440bc9ed504fcef81f783', 'request_id': 'req-a87c6a1c-9cda-42e7-8fdb-55c322328d4e'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:50.406465 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-d6d033d5-e5d8-4aa7-9ab6-7a4a6e9b530b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb4b22bc322c419bab3445f7dfb186fb'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:50.407240 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-d6d033d5-e5d8-4aa7-9ab6-7a4a6e9b530b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb4b22bc322c419bab3445f7dfb186fb'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:50.407888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-d6d033d5-e5d8-4aa7-9ab6-7a4a6e9b530b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb4b22bc322c419bab3445f7dfb186fb'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:50.480474 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a87c6a1c-9cda-42e7-8fdb-55c322328d4e admin admin] The token cache is being invalidate because project e70d3c63003440bc9ed504fcef81f783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:44:50.481061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a87c6a1c-9cda-42e7-8fdb-55c322328d4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:50.481408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a87c6a1c-9cda-42e7-8fdb-55c322328d4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:50.483335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1233/2466] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:44:50 2022] DELETE /identity/v3/projects/e70d3c63003440bc9ed504fcef81f783 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:44:50.490233 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00552d13-260e-4ec9-bf04-add99abfb5ff None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:50.490593 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00552d13-260e-4ec9-bf04-add99abfb5ff None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:50.490890 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00552d13-260e-4ec9-bf04-add99abfb5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:50.509932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-00552d13-260e-4ec9-bf04-add99abfb5ff None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:50.511162 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-00552d13-260e-4ec9-bf04-add99abfb5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:50.569762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1234/2467] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:44:50.578381 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ff16b-d857-4b93-ab14-25b0f036541c None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:50.578693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ff16b-d857-4b93-ab14-25b0f036541c None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:50.578996 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ff16b-d857-4b93-ab14-25b0f036541c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:50.582150 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1234/2468] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:44:50 2022] DELETE /identity/v3/users/fb4b22bc322c419bab3445f7dfb186fb => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:50.597280 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-b65ff16b-d857-4b93-ab14-25b0f036541c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:50.600993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b65ff16b-d857-4b93-ab14-25b0f036541c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:50.666044 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1235/2469] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:50.670306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d033d5-e5d8-4aa7-9ab6-7a4a6e9b530b admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:50.671705 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-d6d033d5-e5d8-4aa7-9ab6-7a4a6e9b530b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:50.685068 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d033d5-e5d8-4aa7-9ab6-7a4a6e9b530b admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:50.690090 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd8edd-146d-48d7-b391-97606d09765d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:50.690751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd8edd-146d-48d7-b391-97606d09765d admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:50.691039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd8edd-146d-48d7-b391-97606d09765d admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:50.691323 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd8edd-146d-48d7-b391-97606d09765d admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:50.692128 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd8edd-146d-48d7-b391-97606d09765d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:44:50.692440 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd8edd-146d-48d7-b391-97606d09765d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:50.694082 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd8edd-146d-48d7-b391-97606d09765d admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:50.707315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1235/2470] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:44:50.710764 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ff16b-d857-4b93-ab14-25b0f036541c None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:50.715223 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:50.720653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ff16b-d857-4b93-ab14-25b0f036541c None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:50.726228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76180c76-0d0f-4d96-94e3-7a9b4c350c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:50.726882 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76180c76-0d0f-4d96-94e3-7a9b4c350c08 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:50.730171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76180c76-0d0f-4d96-94e3-7a9b4c350c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:50.730171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76180c76-0d0f-4d96-94e3-7a9b4c350c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:50.730171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76180c76-0d0f-4d96-94e3-7a9b4c350c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:50.730171 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76180c76-0d0f-4d96-94e3-7a9b4c350c08 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:50.894026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1236/2471] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:44:50 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:44:50.898171 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd8edd-146d-48d7-b391-97606d09765d admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:50.908151 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd8edd-146d-48d7-b391-97606d09765d admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:50.940904 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76180c76-0d0f-4d96-94e3-7a9b4c350c08 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:50.946709 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-76180c76-0d0f-4d96-94e3-7a9b4c350c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:50.974712 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5a4d3-07b5-4ec8-b4c9-a767839d3677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:50.975384 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5a4d3-07b5-4ec8-b4c9-a767839d3677 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:50.975669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5a4d3-07b5-4ec8-b4c9-a767839d3677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:50.976081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5a4d3-07b5-4ec8-b4c9-a767839d3677 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:50.977219 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5a4d3-07b5-4ec8-b4c9-a767839d3677 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:50.979199 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5a4d3-07b5-4ec8-b4c9-a767839d3677 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:51.032273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76180c76-0d0f-4d96-94e3-7a9b4c350c08 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:51.044390 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f94af-c243-43db-b08d-dd35faf7c8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:51.045275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f94af-c243-43db-b08d-dd35faf7c8b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:51.045590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f94af-c243-43db-b08d-dd35faf7c8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:51.045874 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f94af-c243-43db-b08d-dd35faf7c8b3 admin admin] PATH_INFO: `/v3/projects/8b153628177048a397b79d65addb4be5` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:51.047072 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f94af-c243-43db-b08d-dd35faf7c8b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b153628177048a397b79d65addb4be5)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:51.049150 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f94af-c243-43db-b08d-dd35faf7c8b3 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:51.064756 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1236/2472] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:44:50 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:44:51.069591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5a4d3-07b5-4ec8-b4c9-a767839d3677 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:51.079504 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5a4d3-07b5-4ec8-b4c9-a767839d3677 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:51.087890 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28b8de-4494-4fac-a607-ed64562ea77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:51.088710 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28b8de-4494-4fac-a607-ed64562ea77e admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:51.088998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28b8de-4494-4fac-a607-ed64562ea77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:51.089337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28b8de-4494-4fac-a607-ed64562ea77e admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:51.090211 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28b8de-4494-4fac-a607-ed64562ea77e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:51.092062 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28b8de-4494-4fac-a607-ed64562ea77e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:51.103085 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1237/2473] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:44:51.107454 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28b8de-4494-4fac-a607-ed64562ea77e admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:51.114671 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:51.120094 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28b8de-4494-4fac-a607-ed64562ea77e admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:51.124961 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a4a25-ab2e-45b3-bd33-1cc21363576c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:51.125734 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a4a25-ab2e-45b3-bd33-1cc21363576c admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:51.126013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a4a25-ab2e-45b3-bd33-1cc21363576c admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:51.126290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a4a25-ab2e-45b3-bd33-1cc21363576c admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:51.127171 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a4a25-ab2e-45b3-bd33-1cc21363576c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:51.130460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a4a25-ab2e-45b3-bd33-1cc21363576c admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:51.144718 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1238/2474] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:44:51.148883 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a4a25-ab2e-45b3-bd33-1cc21363576c admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:51.159088 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2d1f94af-c243-43db-b08d-dd35faf7c8b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b153628177048a397b79d65addb4be5', 'request_id': 'req-2d1f94af-c243-43db-b08d-dd35faf7c8b3'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:51.162363 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a4a25-ab2e-45b3-bd33-1cc21363576c admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:51.167856 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2d1f94af-c243-43db-b08d-dd35faf7c8b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b153628177048a397b79d65addb4be5', 'request_id': 'req-2d1f94af-c243-43db-b08d-dd35faf7c8b3'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:51.173563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2d1f94af-c243-43db-b08d-dd35faf7c8b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b153628177048a397b79d65addb4be5', 'request_id': 'req-2d1f94af-c243-43db-b08d-dd35faf7c8b3'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:51.227656 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc5ef7-971c-431b-b466-442debc11aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:51.228560 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc5ef7-971c-431b-b466-442debc11aa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:51.228844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc5ef7-971c-431b-b466-442debc11aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:51.229117 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc5ef7-971c-431b-b466-442debc11aa9 admin admin] PATH_INFO: `/v3/projects/ccaf2630d5934fcb8de6e5249991460b/users/0bda7f1817834930a8da2cc394a2398f/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:51.246055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc5ef7-971c-431b-b466-442debc11aa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccaf2630d5934fcb8de6e5249991460b, user_id=0bda7f1817834930a8da2cc394a2398f, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:51.254448 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2d1f94af-c243-43db-b08d-dd35faf7c8b3 admin admin] The token cache is being invalidate because project 8b153628177048a397b79d65addb4be5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:44:51.254448 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2d1f94af-c243-43db-b08d-dd35faf7c8b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:51.254448 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2d1f94af-c243-43db-b08d-dd35faf7c8b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:51.254727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc5ef7-971c-431b-b466-442debc11aa9 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:51.254830 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1237/2475] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:44:50 2022] DELETE /identity/v3/projects/8b153628177048a397b79d65addb4be5 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:44:51.254830 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5539ed-9950-4352-a797-2b46170aca5b None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:51.254998 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5539ed-9950-4352-a797-2b46170aca5b None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:51.255265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5539ed-9950-4352-a797-2b46170aca5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:51.274385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-5a5539ed-9950-4352-a797-2b46170aca5b None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:51.275531 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5a5539ed-9950-4352-a797-2b46170aca5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:51.283682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1238/2476] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:44:51.291848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd421310-5ec6-46e2-b108-a67b81f89bea None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:51.292148 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd421310-5ec6-46e2-b108-a67b81f89bea None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:51.292435 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd421310-5ec6-46e2-b108-a67b81f89bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:51.311638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-fd421310-5ec6-46e2-b108-a67b81f89bea None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:51.312437 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-fd421310-5ec6-46e2-b108-a67b81f89bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:51.321406 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1239/2477] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:44:51.325169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd421310-5ec6-46e2-b108-a67b81f89bea None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:51.334290 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd421310-5ec6-46e2-b108-a67b81f89bea None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:51.339733 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642187b-f05d-44fe-88a3-92bf11e31473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:51.340407 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642187b-f05d-44fe-88a3-92bf11e31473 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:51.340684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642187b-f05d-44fe-88a3-92bf11e31473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:51.340957 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642187b-f05d-44fe-88a3-92bf11e31473 admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:51.341714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642187b-f05d-44fe-88a3-92bf11e31473 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:44:51.342020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642187b-f05d-44fe-88a3-92bf11e31473 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:51.343629 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642187b-f05d-44fe-88a3-92bf11e31473 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:51.356931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1240/2478] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:44:51.360425 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642187b-f05d-44fe-88a3-92bf11e31473 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:51.371600 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642187b-f05d-44fe-88a3-92bf11e31473 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:51.380076 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1239/2479] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:44:51 2022] PUT /identity/v3/projects/ccaf2630d5934fcb8de6e5249991460b/users/0bda7f1817834930a8da2cc394a2398f/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:44:51.390626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042097a9-9169-4777-b7a6-26efe98b812b None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:51.390913 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042097a9-9169-4777-b7a6-26efe98b812b None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:51.391181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042097a9-9169-4777-b7a6-26efe98b812b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:51.421256 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-042097a9-9169-4777-b7a6-26efe98b812b None None] MFA Rules not processed for user `0bda7f1817834930a8da2cc394a2398f`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:51.422527 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-042097a9-9169-4777-b7a6-26efe98b812b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:51.436906 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:51.452255 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ce800-1bf4-4aef-a8a9-91b74804f78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:51.452921 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ce800-1bf4-4aef-a8a9-91b74804f78a admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:51.453210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ce800-1bf4-4aef-a8a9-91b74804f78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:51.453507 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ce800-1bf4-4aef-a8a9-91b74804f78a admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:51.454229 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ce800-1bf4-4aef-a8a9-91b74804f78a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:51.456370 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ce800-1bf4-4aef-a8a9-91b74804f78a admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:51.487923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1240/2480] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:44:51.499360 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042097a9-9169-4777-b7a6-26efe98b812b None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:51.500762 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-042097a9-9169-4777-b7a6-26efe98b812b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:51.538166 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1241/2481] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:44:51 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:44:51.539346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ce800-1bf4-4aef-a8a9-91b74804f78a admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:51.581706 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042097a9-9169-4777-b7a6-26efe98b812b None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:51.601828 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:51.609164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ce800-1bf4-4aef-a8a9-91b74804f78a admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:51.614672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ea376-c2c2-415f-91ee-ba541f1dbe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:51.615369 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ea376-c2c2-415f-91ee-ba541f1dbe86 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:51.615653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ea376-c2c2-415f-91ee-ba541f1dbe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:51.615923 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ea376-c2c2-415f-91ee-ba541f1dbe86 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:51.616606 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ea376-c2c2-415f-91ee-ba541f1dbe86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:51.618630 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ea376-c2c2-415f-91ee-ba541f1dbe86 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:51.652244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f336ec9-aaa5-46ab-8a53-801f07990d29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:51.652998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f336ec9-aaa5-46ab-8a53-801f07990d29 service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:51.653357 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f336ec9-aaa5-46ab-8a53-801f07990d29 service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:51.653732 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f336ec9-aaa5-46ab-8a53-801f07990d29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:51.711636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f336ec9-aaa5-46ab-8a53-801f07990d29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:51.713258 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f336ec9-aaa5-46ab-8a53-801f07990d29 service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:51.723005 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1241/2482] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:44:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:44:51.739656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1242/2483] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:44:51 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:44:51.744124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f336ec9-aaa5-46ab-8a53-801f07990d29 service nova] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:51.762420 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f336ec9-aaa5-46ab-8a53-801f07990d29 service nova] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:51.769258 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46be4f9-da69-46f9-ad97-37075c84f447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:51.770051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46be4f9-da69-46f9-ad97-37075c84f447 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:51.770341 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46be4f9-da69-46f9-ad97-37075c84f447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:51.777598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46be4f9-da69-46f9-ad97-37075c84f447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:51.777598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46be4f9-da69-46f9-ad97-37075c84f447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:51.777598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46be4f9-da69-46f9-ad97-37075c84f447 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:51.802417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1242/2484] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:44:51.805454 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ea376-c2c2-415f-91ee-ba541f1dbe86 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:51.817177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ea376-c2c2-415f-91ee-ba541f1dbe86 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:51.829485 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd9235-4045-41a7-a3e1-19c5c89111ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:51.830202 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd9235-4045-41a7-a3e1-19c5c89111ed admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:51.833154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd9235-4045-41a7-a3e1-19c5c89111ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:51.833154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd9235-4045-41a7-a3e1-19c5c89111ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:51.833154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd9235-4045-41a7-a3e1-19c5c89111ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:51.834181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd9235-4045-41a7-a3e1-19c5c89111ed admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:51.854516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1243/2485] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:44:51.855909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46be4f9-da69-46f9-ad97-37075c84f447 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:51.862901 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46be4f9-da69-46f9-ad97-37075c84f447 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:51.868124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508ff80-5000-4d7f-b9e1-cf650a03cf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:51.869020 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508ff80-5000-4d7f-b9e1-cf650a03cf2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:51.869306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508ff80-5000-4d7f-b9e1-cf650a03cf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:51.869710 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508ff80-5000-4d7f-b9e1-cf650a03cf2f admin admin] PATH_INFO: `/v3/projects/8b1e54b554514bfe869a783ca1dcf347/users/5024f5908f154a71a255da63f01c2594/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:51.892902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508ff80-5000-4d7f-b9e1-cf650a03cf2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1e54b554514bfe869a783ca1dcf347, user_id=5024f5908f154a71a255da63f01c2594, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:51.892902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508ff80-5000-4d7f-b9e1-cf650a03cf2f admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:51.977634 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1243/2486] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:44:51 2022] PUT /identity/v3/projects/8b1e54b554514bfe869a783ca1dcf347/users/5024f5908f154a71a255da63f01c2594/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:44:51.999836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b5b3a-fa75-439b-a1f4-f9ebc7161290 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:51.999836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b5b3a-fa75-439b-a1f4-f9ebc7161290 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:51.999836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b5b3a-fa75-439b-a1f4-f9ebc7161290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:52.002173 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508ff80-5000-4d7f-b9e1-cf650a03cf2f admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:52.002173 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7508ff80-5000-4d7f-b9e1-cf650a03cf2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:52.037564 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-f98b5b3a-fa75-439b-a1f4-f9ebc7161290 None None] MFA Rules not processed for user `5024f5908f154a71a255da63f01c2594`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:52.039011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f98b5b3a-fa75-439b-a1f4-f9ebc7161290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:52.108020 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508ff80-5000-4d7f-b9e1-cf650a03cf2f admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:52.114859 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89184a0-d711-49f5-b2fe-47936fb06a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:52.116021 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89184a0-d711-49f5-b2fe-47936fb06a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:52.116463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89184a0-d711-49f5-b2fe-47936fb06a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:52.116799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89184a0-d711-49f5-b2fe-47936fb06a3b admin admin] PATH_INFO: `/v3/users/0bda7f1817834930a8da2cc394a2398f` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:52.118192 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89184a0-d711-49f5-b2fe-47936fb06a3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bda7f1817834930a8da2cc394a2398f)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:52.121324 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89184a0-d711-49f5-b2fe-47936fb06a3b admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:52.128723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:52.142378 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1244/2487] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:52.148207 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b5b3a-fa75-439b-a1f4-f9ebc7161290 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:52.204080 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:52.248864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b5b3a-fa75-439b-a1f4-f9ebc7161290 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:52.254973 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a0ae2-a228-4db0-85bd-e219be61fa19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:52.255915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a0ae2-a228-4db0-85bd-e219be61fa19 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:52.255915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a0ae2-a228-4db0-85bd-e219be61fa19 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:52.256182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a0ae2-a228-4db0-85bd-e219be61fa19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:52.264448 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a0ae2-a228-4db0-85bd-e219be61fa19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:52.266154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a0ae2-a228-4db0-85bd-e219be61fa19 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:52.276062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1245/2488] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:44:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:44:52.355002 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e89184a0-d711-49f5-b2fe-47936fb06a3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bda7f1817834930a8da2cc394a2398f'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:52.371312 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e89184a0-d711-49f5-b2fe-47936fb06a3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bda7f1817834930a8da2cc394a2398f'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:52.382057 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e89184a0-d711-49f5-b2fe-47936fb06a3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bda7f1817834930a8da2cc394a2398f'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:52.382805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e89184a0-d711-49f5-b2fe-47936fb06a3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bda7f1817834930a8da2cc394a2398f'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:52.383528 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e89184a0-d711-49f5-b2fe-47936fb06a3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bda7f1817834930a8da2cc394a2398f'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:52.444898 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1244/2489] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:44:51 2022] DELETE /identity/v3/users/0bda7f1817834930a8da2cc394a2398f => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:52.449312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf30a54-638c-4e99-a629-e61b3a2dbb66 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:52.449636 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf30a54-638c-4e99-a629-e61b3a2dbb66 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:52.449920 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf30a54-638c-4e99-a629-e61b3a2dbb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:52.467376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-3cf30a54-638c-4e99-a629-e61b3a2dbb66 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:52.468591 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-3cf30a54-638c-4e99-a629-e61b3a2dbb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:52.529676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1246/2490] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:52.540295 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89184a0-d711-49f5-b2fe-47936fb06a3b admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:52.541771 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e89184a0-d711-49f5-b2fe-47936fb06a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:52.602398 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89184a0-d711-49f5-b2fe-47936fb06a3b admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:52.605988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d15bec-f2cd-4b57-be37-dff42bdedaa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:52.606625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d15bec-f2cd-4b57-be37-dff42bdedaa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:52.608078 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d15bec-f2cd-4b57-be37-dff42bdedaa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:52.608078 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d15bec-f2cd-4b57-be37-dff42bdedaa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:52.616745 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d15bec-f2cd-4b57-be37-dff42bdedaa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:52.618271 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d15bec-f2cd-4b57-be37-dff42bdedaa9 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:52.628154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1245/2491] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:44:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:44:53.206852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf30a54-638c-4e99-a629-e61b3a2dbb66 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:53.209003 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-3cf30a54-638c-4e99-a629-e61b3a2dbb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:53.234286 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf30a54-638c-4e99-a629-e61b3a2dbb66 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:53.241815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6289a4d-ce9d-4a30-85cd-fa5a952b1d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:53.251384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6289a4d-ce9d-4a30-85cd-fa5a952b1d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:53.251825 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6289a4d-ce9d-4a30-85cd-fa5a952b1d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:53.252163 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6289a4d-ce9d-4a30-85cd-fa5a952b1d37 admin admin] PATH_INFO: `/v3/projects/ccaf2630d5934fcb8de6e5249991460b` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:53.254298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6289a4d-ce9d-4a30-85cd-fa5a952b1d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccaf2630d5934fcb8de6e5249991460b)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:53.256338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6289a4d-ce9d-4a30-85cd-fa5a952b1d37 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:53.400981 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a6289a4d-ce9d-4a30-85cd-fa5a952b1d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccaf2630d5934fcb8de6e5249991460b', 'request_id': 'req-a6289a4d-ce9d-4a30-85cd-fa5a952b1d37'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:53.407157 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a6289a4d-ce9d-4a30-85cd-fa5a952b1d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccaf2630d5934fcb8de6e5249991460b', 'request_id': 'req-a6289a4d-ce9d-4a30-85cd-fa5a952b1d37'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:53.412579 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a6289a4d-ce9d-4a30-85cd-fa5a952b1d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccaf2630d5934fcb8de6e5249991460b', 'request_id': 'req-a6289a4d-ce9d-4a30-85cd-fa5a952b1d37'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:53.510240 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a6289a4d-ce9d-4a30-85cd-fa5a952b1d37 admin admin] The token cache is being invalidate because project ccaf2630d5934fcb8de6e5249991460b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:44:53.510532 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a6289a4d-ce9d-4a30-85cd-fa5a952b1d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:53.511179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-a6289a4d-ce9d-4a30-85cd-fa5a952b1d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:44:53.516495 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1247/2492] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:44:53 2022] DELETE /identity/v3/projects/ccaf2630d5934fcb8de6e5249991460b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:53.518507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d862502-a34c-4fe4-be62-b1d9437b98be None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:53.518995 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d862502-a34c-4fe4-be62-b1d9437b98be None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:53.519092 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d862502-a34c-4fe4-be62-b1d9437b98be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:53.537859 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-5d862502-a34c-4fe4-be62-b1d9437b98be None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:53.539085 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-5d862502-a34c-4fe4-be62-b1d9437b98be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:53.600781 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1246/2493] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:44:53.608614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32058ace-9fc1-44e0-a732-ab7eaad795ff None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:53.609175 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32058ace-9fc1-44e0-a732-ab7eaad795ff None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:53.609453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32058ace-9fc1-44e0-a732-ab7eaad795ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:53.629109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-32058ace-9fc1-44e0-a732-ab7eaad795ff None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:53.630532 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-32058ace-9fc1-44e0-a732-ab7eaad795ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:53.638963 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1248/2494] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:44:53.644470 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d862502-a34c-4fe4-be62-b1d9437b98be None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:53.654738 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d862502-a34c-4fe4-be62-b1d9437b98be None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:53.659815 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a68178-56f7-446a-a01f-bd752484c36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:53.660508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a68178-56f7-446a-a01f-bd752484c36e admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:53.660795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a68178-56f7-446a-a01f-bd752484c36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:53.661075 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a68178-56f7-446a-a01f-bd752484c36e admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:53.661845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a68178-56f7-446a-a01f-bd752484c36e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:44:53.662165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a68178-56f7-446a-a01f-bd752484c36e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:53.663793 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a68178-56f7-446a-a01f-bd752484c36e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:53.676639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1247/2495] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:44:53.681067 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32058ace-9fc1-44e0-a732-ab7eaad795ff None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:53.691132 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32058ace-9fc1-44e0-a732-ab7eaad795ff None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:53.696021 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00eb1e5-f859-45a9-9d62-bf56d9449380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:53.696864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00eb1e5-f859-45a9-9d62-bf56d9449380 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:53.697157 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00eb1e5-f859-45a9-9d62-bf56d9449380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:53.697433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00eb1e5-f859-45a9-9d62-bf56d9449380 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:53.698163 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00eb1e5-f859-45a9-9d62-bf56d9449380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:53.700192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00eb1e5-f859-45a9-9d62-bf56d9449380 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:53.829463 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1249/2496] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:44:53 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:44:53.833953 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a68178-56f7-446a-a01f-bd752484c36e admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:53.844037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a68178-56f7-446a-a01f-bd752484c36e admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:53.852968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:53.900534 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f6ed1-03fc-431c-92c4-c3e7137e0ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:53.901131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6ed1-03fc-431c-92c4-c3e7137e0ccf admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:53.901442 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6ed1-03fc-431c-92c4-c3e7137e0ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:53.901747 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f6ed1-03fc-431c-92c4-c3e7137e0ccf admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:53.902439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f6ed1-03fc-431c-92c4-c3e7137e0ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:53.904369 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f6ed1-03fc-431c-92c4-c3e7137e0ccf admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:54.015977 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1248/2497] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:44:53 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:44:54.016694 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00eb1e5-f859-45a9-9d62-bf56d9449380 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:54.028083 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00eb1e5-f859-45a9-9d62-bf56d9449380 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:54.035580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a11541-6fdc-41df-9010-ad51dbd11af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:54.036258 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a11541-6fdc-41df-9010-ad51dbd11af5 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:54.036547 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a11541-6fdc-41df-9010-ad51dbd11af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:54.036829 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a11541-6fdc-41df-9010-ad51dbd11af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:54.037604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a11541-6fdc-41df-9010-ad51dbd11af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:54.039213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a11541-6fdc-41df-9010-ad51dbd11af5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:54.055355 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1250/2498] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:44:54.055474 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f6ed1-03fc-431c-92c4-c3e7137e0ccf admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:54.066457 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f6ed1-03fc-431c-92c4-c3e7137e0ccf admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:54.071701 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10bb48-0856-4103-badd-3fce46c7142a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:54.072442 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10bb48-0856-4103-badd-3fce46c7142a admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:54.072687 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10bb48-0856-4103-badd-3fce46c7142a admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:54.072982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10bb48-0856-4103-badd-3fce46c7142a admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:54.073746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10bb48-0856-4103-badd-3fce46c7142a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:54.075468 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10bb48-0856-4103-badd-3fce46c7142a admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:54.086213 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1249/2499] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:44:54.094500 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a11541-6fdc-41df-9010-ad51dbd11af5 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:54.105732 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a11541-6fdc-41df-9010-ad51dbd11af5 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:54.113784 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948f6a2-45f2-4728-8ad2-6a6101541415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:54.115367 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948f6a2-45f2-4728-8ad2-6a6101541415 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:54.116056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948f6a2-45f2-4728-8ad2-6a6101541415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:54.116056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948f6a2-45f2-4728-8ad2-6a6101541415 admin admin] PATH_INFO: `/v3/projects/6c0e54622cd24293b6f43882c6a88f2f/users/8a61307830a54ea38c6c0681f5bbd0de/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:54.124204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:54.139794 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948f6a2-45f2-4728-8ad2-6a6101541415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c0e54622cd24293b6f43882c6a88f2f, user_id=8a61307830a54ea38c6c0681f5bbd0de, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:54.142512 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948f6a2-45f2-4728-8ad2-6a6101541415 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:54.292099 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1251/2500] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:44:54 2022] PUT /identity/v3/projects/6c0e54622cd24293b6f43882c6a88f2f/users/8a61307830a54ea38c6c0681f5bbd0de/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:44:54.304665 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e82e8-2b63-44a5-9900-3caf0a5a304b None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:54.304961 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e82e8-2b63-44a5-9900-3caf0a5a304b None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:54.305249 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e82e8-2b63-44a5-9900-3caf0a5a304b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:54.341913 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-091e82e8-2b63-44a5-9900-3caf0a5a304b None None] MFA Rules not processed for user `8a61307830a54ea38c6c0681f5bbd0de`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:54.343380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-091e82e8-2b63-44a5-9900-3caf0a5a304b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:54.461477 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1250/2501] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:54.466758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948f6a2-45f2-4728-8ad2-6a6101541415 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:54.541427 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948f6a2-45f2-4728-8ad2-6a6101541415 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:54.546125 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b905859-1af8-4dac-af11-e6a6daa93598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:54.546774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b905859-1af8-4dac-af11-e6a6daa93598 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:54.547055 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b905859-1af8-4dac-af11-e6a6daa93598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:54.547329 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b905859-1af8-4dac-af11-e6a6daa93598 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:54.548084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b905859-1af8-4dac-af11-e6a6daa93598 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:54.550686 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b905859-1af8-4dac-af11-e6a6daa93598 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:54.637460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1252/2502] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:44:54 2022] POST /identity/v3/projects => generated 371 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:44:54.640949 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e82e8-2b63-44a5-9900-3caf0a5a304b None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:54.652005 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e82e8-2b63-44a5-9900-3caf0a5a304b None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:54.708289 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873a647-d1b3-4b24-bf7a-65d00a866c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:54.708863 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873a647-d1b3-4b24-bf7a-65d00a866c23 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:54.709149 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873a647-d1b3-4b24-bf7a-65d00a866c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:54.709428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873a647-d1b3-4b24-bf7a-65d00a866c23 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:54.710157 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873a647-d1b3-4b24-bf7a-65d00a866c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:54.712077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873a647-d1b3-4b24-bf7a-65d00a866c23 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:54.809069 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1251/2503] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:44:54 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:44:54.812723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b905859-1af8-4dac-af11-e6a6daa93598 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:54.823310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b905859-1af8-4dac-af11-e6a6daa93598 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:54.828253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f89662-cb60-413a-a574-30c06899c8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:54.828950 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f89662-cb60-413a-a574-30c06899c8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:54.829237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f89662-cb60-413a-a574-30c06899c8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:54.829518 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f89662-cb60-413a-a574-30c06899c8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:54.830280 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f89662-cb60-413a-a574-30c06899c8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:54.832412 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f89662-cb60-413a-a574-30c06899c8f1 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:54.844429 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1253/2504] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:44:54.849273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873a647-d1b3-4b24-bf7a-65d00a866c23 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:54.860802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873a647-d1b3-4b24-bf7a-65d00a866c23 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:54.865821 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c2814-ac4c-4759-86c8-7fca24cfe464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:54.867894 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c2814-ac4c-4759-86c8-7fca24cfe464 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:54.867894 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c2814-ac4c-4759-86c8-7fca24cfe464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:54.867894 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c2814-ac4c-4759-86c8-7fca24cfe464 admin admin] PATH_INFO: `/v3/projects/1bf0e8c0c9bc4945af1911b8940d777d/users/6528a5a5547e4fa4834c133989131fc0/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:54.875765 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:54.882253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c2814-ac4c-4759-86c8-7fca24cfe464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf0e8c0c9bc4945af1911b8940d777d, user_id=6528a5a5547e4fa4834c133989131fc0, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:54.884906 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c2814-ac4c-4759-86c8-7fca24cfe464 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:54.988336 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1252/2505] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:44:54 2022] PUT /identity/v3/projects/1bf0e8c0c9bc4945af1911b8940d777d/users/6528a5a5547e4fa4834c133989131fc0/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:44:54.993668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f89662-cb60-413a-a574-30c06899c8f1 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:55.005245 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f89662-cb60-413a-a574-30c06899c8f1 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:55.070511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60208a60-b283-4822-a433-7f34648c0a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:55.071189 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60208a60-b283-4822-a433-7f34648c0a78 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:55.071473 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60208a60-b283-4822-a433-7f34648c0a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:55.071752 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60208a60-b283-4822-a433-7f34648c0a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:55.072481 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60208a60-b283-4822-a433-7f34648c0a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:55.074092 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60208a60-b283-4822-a433-7f34648c0a78 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:55.093497 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1254/2506] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:44:55.098493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c2814-ac4c-4759-86c8-7fca24cfe464 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:55.110518 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c2814-ac4c-4759-86c8-7fca24cfe464 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:55.115840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bedde-d8ac-43ce-bb3c-37f9ad87422e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:55.116936 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bedde-d8ac-43ce-bb3c-37f9ad87422e admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:55.117034 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bedde-d8ac-43ce-bb3c-37f9ad87422e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:55.117519 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5bedde-d8ac-43ce-bb3c-37f9ad87422e admin admin] PATH_INFO: `/v3/projects/1bf0e8c0c9bc4945af1911b8940d777d/users/6528a5a5547e4fa4834c133989131fc0/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:55.119650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bedde-d8ac-43ce-bb3c-37f9ad87422e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf0e8c0c9bc4945af1911b8940d777d, user_id=6528a5a5547e4fa4834c133989131fc0, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:55.122423 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5bedde-d8ac-43ce-bb3c-37f9ad87422e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:55.135156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1253/2507] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:44:55 2022] PUT /identity/v3/projects/1bf0e8c0c9bc4945af1911b8940d777d/users/6528a5a5547e4fa4834c133989131fc0/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:44:55.154370 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bb3fd-29ff-4b2e-aa3c-15bdad258018 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:55.154670 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bb3fd-29ff-4b2e-aa3c-15bdad258018 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:55.154980 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bb3fd-29ff-4b2e-aa3c-15bdad258018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:55.181939 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-cf6bb3fd-29ff-4b2e-aa3c-15bdad258018 None None] MFA Rules not processed for user `6528a5a5547e4fa4834c133989131fc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:44:55.183192 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-cf6bb3fd-29ff-4b2e-aa3c-15bdad258018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:55.225693 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:44:55.252317 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1255/2508] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:44:55 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:44:55.264339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bedde-d8ac-43ce-bb3c-37f9ad87422e admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:55.266102 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-4f5bedde-d8ac-43ce-bb3c-37f9ad87422e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:44:55.325620 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5bedde-d8ac-43ce-bb3c-37f9ad87422e admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:55.329547 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c9010-5bb9-43c4-8c55-964ad950b68f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:55.330232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c9010-5bb9-43c4-8c55-964ad950b68f service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:55.330518 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c9010-5bb9-43c4-8c55-964ad950b68f service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:55.331435 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c9010-5bb9-43c4-8c55-964ad950b68f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:55.340558 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c9010-5bb9-43c4-8c55-964ad950b68f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:55.342083 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c9010-5bb9-43c4-8c55-964ad950b68f service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:55.351669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1254/2509] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:44:55 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:44:55.641119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bb3fd-29ff-4b2e-aa3c-15bdad258018 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:44:55.656123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bb3fd-29ff-4b2e-aa3c-15bdad258018 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:44:55.656123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9aefa6-949b-4bb9-9725-5216db3ed589 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:44:55.657054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aefa6-949b-4bb9-9725-5216db3ed589 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:44:55.657054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aefa6-949b-4bb9-9725-5216db3ed589 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:44:55.657054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9aefa6-949b-4bb9-9725-5216db3ed589 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:44:55.719704 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9aefa6-949b-4bb9-9725-5216db3ed589 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:44:55.721228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9aefa6-949b-4bb9-9725-5216db3ed589 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:44:55.737435 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1256/2510] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:44:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:45:01.386129 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c9010-5bb9-43c4-8c55-964ad950b68f service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:01.386129 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-836c9010-5bb9-43c4-8c55-964ad950b68f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:01.452241 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c9010-5bb9-43c4-8c55-964ad950b68f service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:01.457610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96924f56-a33d-413f-bd8e-92d43bc332f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:01.458570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96924f56-a33d-413f-bd8e-92d43bc332f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:01.458855 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96924f56-a33d-413f-bd8e-92d43bc332f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:01.459129 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96924f56-a33d-413f-bd8e-92d43bc332f6 admin admin] PATH_INFO: `/v3/users/5024f5908f154a71a255da63f01c2594` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:01.460353 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96924f56-a33d-413f-bd8e-92d43bc332f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5024f5908f154a71a255da63f01c2594)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:01.462317 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96924f56-a33d-413f-bd8e-92d43bc332f6 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:01.660419 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-96924f56-a33d-413f-bd8e-92d43bc332f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5024f5908f154a71a255da63f01c2594'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:01.672711 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-96924f56-a33d-413f-bd8e-92d43bc332f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5024f5908f154a71a255da63f01c2594'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:01.680269 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-96924f56-a33d-413f-bd8e-92d43bc332f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5024f5908f154a71a255da63f01c2594'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:01.680976 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-96924f56-a33d-413f-bd8e-92d43bc332f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5024f5908f154a71a255da63f01c2594'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:01.681631 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-96924f56-a33d-413f-bd8e-92d43bc332f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5024f5908f154a71a255da63f01c2594'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:01.685248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:01.738887 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1255/2511] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:45:01 2022] DELETE /identity/v3/users/5024f5908f154a71a255da63f01c2594 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:01.743414 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36760193-be82-4e58-a10f-f7fb59313857 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:01.743877 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36760193-be82-4e58-a10f-f7fb59313857 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:01.743974 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36760193-be82-4e58-a10f-f7fb59313857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:01.761842 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-36760193-be82-4e58-a10f-f7fb59313857 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:01.763060 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-36760193-be82-4e58-a10f-f7fb59313857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:01.822038 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1257/2512] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:01.832049 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96924f56-a33d-413f-bd8e-92d43bc332f6 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:01.833444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-96924f56-a33d-413f-bd8e-92d43bc332f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:01.891319 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96924f56-a33d-413f-bd8e-92d43bc332f6 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:01.895005 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebac071-a9ee-4474-a73d-9f25b6406cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:01.895652 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebac071-a9ee-4474-a73d-9f25b6406cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:01.895935 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebac071-a9ee-4474-a73d-9f25b6406cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:01.896366 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebac071-a9ee-4474-a73d-9f25b6406cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:01.905731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebac071-a9ee-4474-a73d-9f25b6406cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:01.907176 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebac071-a9ee-4474-a73d-9f25b6406cc1 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:01.917486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1256/2513] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:45:02.383758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36760193-be82-4e58-a10f-f7fb59313857 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:02.385343 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-36760193-be82-4e58-a10f-f7fb59313857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:02.398680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36760193-be82-4e58-a10f-f7fb59313857 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:02.403011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50583c-b831-472d-9617-94619ad41fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:02.403880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50583c-b831-472d-9617-94619ad41fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:02.404164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50583c-b831-472d-9617-94619ad41fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:02.404436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50583c-b831-472d-9617-94619ad41fe9 admin admin] PATH_INFO: `/v3/projects/8b1e54b554514bfe869a783ca1dcf347` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:02.405789 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50583c-b831-472d-9617-94619ad41fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b1e54b554514bfe869a783ca1dcf347)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:02.407576 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50583c-b831-472d-9617-94619ad41fe9 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:02.519261 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-cc50583c-b831-472d-9617-94619ad41fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b1e54b554514bfe869a783ca1dcf347', 'request_id': 'req-cc50583c-b831-472d-9617-94619ad41fe9'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:02.525366 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-cc50583c-b831-472d-9617-94619ad41fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b1e54b554514bfe869a783ca1dcf347', 'request_id': 'req-cc50583c-b831-472d-9617-94619ad41fe9'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:02.530943 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-cc50583c-b831-472d-9617-94619ad41fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b1e54b554514bfe869a783ca1dcf347', 'request_id': 'req-cc50583c-b831-472d-9617-94619ad41fe9'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:02.629662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:02.633845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-cc50583c-b831-472d-9617-94619ad41fe9 admin admin] The token cache is being invalidate because project 8b1e54b554514bfe869a783ca1dcf347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:45:02.634233 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-cc50583c-b831-472d-9617-94619ad41fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:02.635280 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-cc50583c-b831-472d-9617-94619ad41fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:02.638128 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1258/2514] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:45:02 2022] DELETE /identity/v3/projects/8b1e54b554514bfe869a783ca1dcf347 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:02.643941 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0781d-0b26-4b9f-817f-3acec6ab370d None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:02.643941 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0781d-0b26-4b9f-817f-3acec6ab370d None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:02.643941 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0781d-0b26-4b9f-817f-3acec6ab370d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:02.665401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-7db0781d-0b26-4b9f-817f-3acec6ab370d None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:02.666681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7db0781d-0b26-4b9f-817f-3acec6ab370d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:02.729048 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1257/2515] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:02.736667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf18bff-4ac4-44a8-aa9a-3ec248e3456e None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:02.736955 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf18bff-4ac4-44a8-aa9a-3ec248e3456e None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:02.737234 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf18bff-4ac4-44a8-aa9a-3ec248e3456e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:02.756704 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-daf18bff-4ac4-44a8-aa9a-3ec248e3456e None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:02.757917 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-daf18bff-4ac4-44a8-aa9a-3ec248e3456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:02.765723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1259/2516] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:02.769958 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0781d-0b26-4b9f-817f-3acec6ab370d None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:02.779722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0781d-0b26-4b9f-817f-3acec6ab370d None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:02.784509 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b23f75-f4e2-4502-875f-13bd46db5a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:02.785710 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b23f75-f4e2-4502-875f-13bd46db5a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:02.785996 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b23f75-f4e2-4502-875f-13bd46db5a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:02.786275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b23f75-f4e2-4502-875f-13bd46db5a7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:02.787005 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b23f75-f4e2-4502-875f-13bd46db5a7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:45:02.787317 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b23f75-f4e2-4502-875f-13bd46db5a7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:02.788925 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b23f75-f4e2-4502-875f-13bd46db5a7f admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:02.801129 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1258/2517] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:45:02.805195 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf18bff-4ac4-44a8-aa9a-3ec248e3456e None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:02.814166 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf18bff-4ac4-44a8-aa9a-3ec248e3456e None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:02.819133 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2c449-750c-4995-b076-b91c1bd7b9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:02.819815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2c449-750c-4995-b076-b91c1bd7b9fd admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:02.820103 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2c449-750c-4995-b076-b91c1bd7b9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:02.820383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2c449-750c-4995-b076-b91c1bd7b9fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:02.821075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2c449-750c-4995-b076-b91c1bd7b9fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:02.823115 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2c449-750c-4995-b076-b91c1bd7b9fd admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:02.928347 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1260/2518] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:45:02 2022] POST /identity/v3/projects => generated 355 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:45:02.932320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b23f75-f4e2-4502-875f-13bd46db5a7f admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:02.942471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b23f75-f4e2-4502-875f-13bd46db5a7f admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:02.999846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d03bd-46aa-4e8b-8d34-36167d1e5a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:03.000496 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d03bd-46aa-4e8b-8d34-36167d1e5a45 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:03.000781 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d03bd-46aa-4e8b-8d34-36167d1e5a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:03.001059 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d03bd-46aa-4e8b-8d34-36167d1e5a45 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:03.001813 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d03bd-46aa-4e8b-8d34-36167d1e5a45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:03.003758 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d03bd-46aa-4e8b-8d34-36167d1e5a45 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:03.080727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1259/2519] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:45:02 2022] POST /identity/v3/users => generated 278 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:45:03.089502 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2c449-750c-4995-b076-b91c1bd7b9fd admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:03.100614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2c449-750c-4995-b076-b91c1bd7b9fd admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:03.105228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5b8b8-0223-4581-b796-ad936807a0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:03.105910 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b8b8-0223-4581-b796-ad936807a0cc admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:03.106194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b8b8-0223-4581-b796-ad936807a0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:03.106468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5b8b8-0223-4581-b796-ad936807a0cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:03.107464 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5b8b8-0223-4581-b796-ad936807a0cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:03.109082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5b8b8-0223-4581-b796-ad936807a0cc admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:03.122474 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1261/2520] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:45:03.123626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d03bd-46aa-4e8b-8d34-36167d1e5a45 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:03.136154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d03bd-46aa-4e8b-8d34-36167d1e5a45 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:03.140323 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d7ce6-52d9-4628-a0e2-d8b93edf3338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:03.140979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d7ce6-52d9-4628-a0e2-d8b93edf3338 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:03.141264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d7ce6-52d9-4628-a0e2-d8b93edf3338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:03.141566 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d7ce6-52d9-4628-a0e2-d8b93edf3338 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:03.142415 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d7ce6-52d9-4628-a0e2-d8b93edf3338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:03.144010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d7ce6-52d9-4628-a0e2-d8b93edf3338 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:03.154825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1260/2521] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:45:03.159108 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5b8b8-0223-4581-b796-ad936807a0cc admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:03.170651 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5b8b8-0223-4581-b796-ad936807a0cc admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:03.175309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28152308-4848-43db-a6e2-fc70b0f2a5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:03.176233 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28152308-4848-43db-a6e2-fc70b0f2a5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:03.176519 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28152308-4848-43db-a6e2-fc70b0f2a5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:03.176826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28152308-4848-43db-a6e2-fc70b0f2a5b3 admin admin] PATH_INFO: `/v3/projects/5512a10baa89457295475d28e333703f/users/fcd0d8b114b442af93c44810788c36c1/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:03.191398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28152308-4848-43db-a6e2-fc70b0f2a5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5512a10baa89457295475d28e333703f, user_id=fcd0d8b114b442af93c44810788c36c1, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:03.194024 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28152308-4848-43db-a6e2-fc70b0f2a5b3 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:03.281063 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1262/2522] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:45:03 2022] PUT /identity/v3/projects/5512a10baa89457295475d28e333703f/users/fcd0d8b114b442af93c44810788c36c1/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:03.293011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3008b84-da18-49b3-b50c-8c8cbb9fa3aa None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:03.293313 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3008b84-da18-49b3-b50c-8c8cbb9fa3aa None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:03.293625 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3008b84-da18-49b3-b50c-8c8cbb9fa3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:03.300412 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:03.319871 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-b3008b84-da18-49b3-b50c-8c8cbb9fa3aa None None] MFA Rules not processed for user `fcd0d8b114b442af93c44810788c36c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:03.321144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b3008b84-da18-49b3-b50c-8c8cbb9fa3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:03.387166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1261/2523] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:03 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:03.391636 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28152308-4848-43db-a6e2-fc70b0f2a5b3 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:03.452457 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28152308-4848-43db-a6e2-fc70b0f2a5b3 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:03.457701 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bfa76-2fba-4954-9d62-5a1fe4da4b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:03.458351 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bfa76-2fba-4954-9d62-5a1fe4da4b29 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:03.458634 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bfa76-2fba-4954-9d62-5a1fe4da4b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:03.458911 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8bfa76-2fba-4954-9d62-5a1fe4da4b29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:03.459595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8bfa76-2fba-4954-9d62-5a1fe4da4b29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:03.461497 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8bfa76-2fba-4954-9d62-5a1fe4da4b29 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:03.548499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1263/2524] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:45:03 2022] POST /identity/v3/projects => generated 355 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:45:03.552572 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3008b84-da18-49b3-b50c-8c8cbb9fa3aa None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:03.563286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3008b84-da18-49b3-b50c-8c8cbb9fa3aa None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:03.619788 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6b2a5-24f6-47f3-b3e8-db08793cb539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:03.620448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6b2a5-24f6-47f3-b3e8-db08793cb539 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:03.620738 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6b2a5-24f6-47f3-b3e8-db08793cb539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:03.621017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6b2a5-24f6-47f3-b3e8-db08793cb539 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:03.621794 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6b2a5-24f6-47f3-b3e8-db08793cb539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:03.623713 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6b2a5-24f6-47f3-b3e8-db08793cb539 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:03.697118 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1262/2525] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:45:03 2022] POST /identity/v3/users => generated 284 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:45:03.709994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bfa76-2fba-4954-9d62-5a1fe4da4b29 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:03.712822 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8bfa76-2fba-4954-9d62-5a1fe4da4b29 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:03.717498 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5af625-a170-4420-b80e-4588d5ede5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:03.718177 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5af625-a170-4420-b80e-4588d5ede5ca admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:03.718460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5af625-a170-4420-b80e-4588d5ede5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:03.718738 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5af625-a170-4420-b80e-4588d5ede5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:03.719480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5af625-a170-4420-b80e-4588d5ede5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:03.721105 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5af625-a170-4420-b80e-4588d5ede5ca admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:03.731592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1264/2526] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:45:03.736024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6b2a5-24f6-47f3-b3e8-db08793cb539 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:03.746761 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6b2a5-24f6-47f3-b3e8-db08793cb539 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:03.751818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b5572-c3c9-45d4-b3f9-9a95f458f1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:03.752764 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b5572-c3c9-45d4-b3f9-9a95f458f1be admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:03.753050 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b5572-c3c9-45d4-b3f9-9a95f458f1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:03.753328 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b5572-c3c9-45d4-b3f9-9a95f458f1be admin admin] PATH_INFO: `/v3/projects/6d158183a2eb47edbe8959049f10fe6a/users/4b26f5b3997d4184856f27e57e7630fe/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:03.771001 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b5572-c3c9-45d4-b3f9-9a95f458f1be admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d158183a2eb47edbe8959049f10fe6a, user_id=4b26f5b3997d4184856f27e57e7630fe, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:03.773676 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b5572-c3c9-45d4-b3f9-9a95f458f1be admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:03.858546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1263/2527] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:45:03 2022] PUT /identity/v3/projects/6d158183a2eb47edbe8959049f10fe6a/users/4b26f5b3997d4184856f27e57e7630fe/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:45:03.862528 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5af625-a170-4420-b80e-4588d5ede5ca admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:03.876862 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5af625-a170-4420-b80e-4588d5ede5ca admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:03.936465 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3b1620-caec-497d-84d3-fa31f48c0322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:03.937131 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b1620-caec-497d-84d3-fa31f48c0322 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:03.937413 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b1620-caec-497d-84d3-fa31f48c0322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:03.937722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3b1620-caec-497d-84d3-fa31f48c0322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:03.938444 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b1620-caec-497d-84d3-fa31f48c0322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:03.940046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3b1620-caec-497d-84d3-fa31f48c0322 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:03.950581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1265/2528] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:45:03.954918 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b5572-c3c9-45d4-b3f9-9a95f458f1be admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:03.965847 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b5572-c3c9-45d4-b3f9-9a95f458f1be admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:03.970478 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43072b3b-5cc3-42f2-96cf-abef372d6333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:03.971336 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43072b3b-5cc3-42f2-96cf-abef372d6333 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:03.971622 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43072b3b-5cc3-42f2-96cf-abef372d6333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:03.971900 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43072b3b-5cc3-42f2-96cf-abef372d6333 admin admin] PATH_INFO: `/v3/projects/6d158183a2eb47edbe8959049f10fe6a/users/4b26f5b3997d4184856f27e57e7630fe/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:03.974506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43072b3b-5cc3-42f2-96cf-abef372d6333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d158183a2eb47edbe8959049f10fe6a, user_id=4b26f5b3997d4184856f27e57e7630fe, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:03.977154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43072b3b-5cc3-42f2-96cf-abef372d6333 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:03.987713 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1264/2529] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:45:03 2022] PUT /identity/v3/projects/6d158183a2eb47edbe8959049f10fe6a/users/4b26f5b3997d4184856f27e57e7630fe/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:03.997541 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec710c2e-20e5-4dfd-898a-a74fa2704f6c None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:03.999123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec710c2e-20e5-4dfd-898a-a74fa2704f6c None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:03.999123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec710c2e-20e5-4dfd-898a-a74fa2704f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:04.011684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:04.026846 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-ec710c2e-20e5-4dfd-898a-a74fa2704f6c None None] MFA Rules not processed for user `4b26f5b3997d4184856f27e57e7630fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:04.028121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ec710c2e-20e5-4dfd-898a-a74fa2704f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:04.096783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1266/2530] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:03 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:04.109074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43072b3b-5cc3-42f2-96cf-abef372d6333 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:04.110861 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-43072b3b-5cc3-42f2-96cf-abef372d6333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:04.165449 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:04.170369 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43072b3b-5cc3-42f2-96cf-abef372d6333 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:04.174067 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0487d-6c98-483c-8368-157a8bd803db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:04.174742 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0487d-6c98-483c-8368-157a8bd803db service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:04.175082 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0487d-6c98-483c-8368-157a8bd803db service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:04.175366 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de0487d-6c98-483c-8368-157a8bd803db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:04.188451 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0487d-6c98-483c-8368-157a8bd803db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:04.194381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de0487d-6c98-483c-8368-157a8bd803db service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:04.201573 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1265/2531] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:45:04 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:45:04.411603 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec710c2e-20e5-4dfd-898a-a74fa2704f6c None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:04.421089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec710c2e-20e5-4dfd-898a-a74fa2704f6c None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:04.424734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb3ba4-bf6a-45b2-8cfe-0eca4cd7ecef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:04.425372 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb3ba4-bf6a-45b2-8cfe-0eca4cd7ecef service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:04.425692 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb3ba4-bf6a-45b2-8cfe-0eca4cd7ecef service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:04.425969 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb3ba4-bf6a-45b2-8cfe-0eca4cd7ecef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:04.482811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb3ba4-bf6a-45b2-8cfe-0eca4cd7ecef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:04.484254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb3ba4-bf6a-45b2-8cfe-0eca4cd7ecef service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:04.493618 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1267/2532] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:45:04 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:45:14.229235 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=5 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:14.489657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=59 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:22.439906 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0487d-6c98-483c-8368-157a8bd803db service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:22.441429 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7de0487d-6c98-483c-8368-157a8bd803db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:22.605294 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de0487d-6c98-483c-8368-157a8bd803db service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:22.611231 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f38868-ba54-463c-a873-3e5e2f19152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:22.612090 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f38868-ba54-463c-a873-3e5e2f19152d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:22.612371 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f38868-ba54-463c-a873-3e5e2f19152d admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:22.612639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f38868-ba54-463c-a873-3e5e2f19152d admin admin] PATH_INFO: `/v3/users/8519fad7798245f4b7b11f3b7182494d` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:22.613864 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f38868-ba54-463c-a873-3e5e2f19152d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8519fad7798245f4b7b11f3b7182494d)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:22.616309 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f38868-ba54-463c-a873-3e5e2f19152d admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:22.817131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-d4f38868-ba54-463c-a873-3e5e2f19152d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8519fad7798245f4b7b11f3b7182494d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:22.829705 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-d4f38868-ba54-463c-a873-3e5e2f19152d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8519fad7798245f4b7b11f3b7182494d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:22.836996 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-d4f38868-ba54-463c-a873-3e5e2f19152d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8519fad7798245f4b7b11f3b7182494d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:22.837739 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-d4f38868-ba54-463c-a873-3e5e2f19152d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8519fad7798245f4b7b11f3b7182494d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:22.838329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-d4f38868-ba54-463c-a873-3e5e2f19152d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8519fad7798245f4b7b11f3b7182494d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:22.938454 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1266/2533] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:45:22 2022] DELETE /identity/v3/users/8519fad7798245f4b7b11f3b7182494d => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:22.943290 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe29416-48e7-4958-ba46-67c9a7f91003 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:22.943807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe29416-48e7-4958-ba46-67c9a7f91003 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:22.943915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe29416-48e7-4958-ba46-67c9a7f91003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:22.969808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-8fe29416-48e7-4958-ba46-67c9a7f91003 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:22.971062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-8fe29416-48e7-4958-ba46-67c9a7f91003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:23.030762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1268/2534] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:23.040976 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f38868-ba54-463c-a873-3e5e2f19152d admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:23.042653 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-d4f38868-ba54-463c-a873-3e5e2f19152d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:23.063888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:23.115337 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f38868-ba54-463c-a873-3e5e2f19152d admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:23.119032 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fb7f8-7632-40bf-bf6b-a87df9cf8960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:23.119696 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb7f8-7632-40bf-bf6b-a87df9cf8960 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:23.119958 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb7f8-7632-40bf-bf6b-a87df9cf8960 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:23.120232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb7f8-7632-40bf-bf6b-a87df9cf8960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:23.129208 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106fb7f8-7632-40bf-bf6b-a87df9cf8960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:23.130708 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106fb7f8-7632-40bf-bf6b-a87df9cf8960 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:23.140081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1267/2535] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:45:23.545931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe29416-48e7-4958-ba46-67c9a7f91003 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:23.547460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-8fe29416-48e7-4958-ba46-67c9a7f91003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:23.561246 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe29416-48e7-4958-ba46-67c9a7f91003 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:23.568803 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06102b-a6ac-4e6e-9ae6-c8c3e3be5967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:23.569852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06102b-a6ac-4e6e-9ae6-c8c3e3be5967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:23.570160 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06102b-a6ac-4e6e-9ae6-c8c3e3be5967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:23.570415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06102b-a6ac-4e6e-9ae6-c8c3e3be5967 admin admin] PATH_INFO: `/v3/projects/6e64dc0f148c467f9264d77500a37316` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:23.571709 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06102b-a6ac-4e6e-9ae6-c8c3e3be5967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e64dc0f148c467f9264d77500a37316)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:23.574968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06102b-a6ac-4e6e-9ae6-c8c3e3be5967 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:23.697344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5e06102b-a6ac-4e6e-9ae6-c8c3e3be5967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e64dc0f148c467f9264d77500a37316', 'request_id': 'req-5e06102b-a6ac-4e6e-9ae6-c8c3e3be5967'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:23.703941 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5e06102b-a6ac-4e6e-9ae6-c8c3e3be5967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e64dc0f148c467f9264d77500a37316', 'request_id': 'req-5e06102b-a6ac-4e6e-9ae6-c8c3e3be5967'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:23.710914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5e06102b-a6ac-4e6e-9ae6-c8c3e3be5967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e64dc0f148c467f9264d77500a37316', 'request_id': 'req-5e06102b-a6ac-4e6e-9ae6-c8c3e3be5967'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:23.787230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5e06102b-a6ac-4e6e-9ae6-c8c3e3be5967 admin admin] The token cache is being invalidate because project 6e64dc0f148c467f9264d77500a37316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:45:23.787522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5e06102b-a6ac-4e6e-9ae6-c8c3e3be5967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:23.792362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-5e06102b-a6ac-4e6e-9ae6-c8c3e3be5967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:23.792362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1269/2536] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:45:23 2022] DELETE /identity/v3/projects/6e64dc0f148c467f9264d77500a37316 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:23.795037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1df7fa-5032-4c67-9cc0-b37bd90aacc8 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:23.795501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1df7fa-5032-4c67-9cc0-b37bd90aacc8 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:23.795791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1df7fa-5032-4c67-9cc0-b37bd90aacc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:23.848029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-ff1df7fa-5032-4c67-9cc0-b37bd90aacc8 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:23.849380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ff1df7fa-5032-4c67-9cc0-b37bd90aacc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:23.914252 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1268/2537] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:45:23.922266 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf125cb-b1da-4a02-a521-b7ea2fb7c551 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:23.922581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf125cb-b1da-4a02-a521-b7ea2fb7c551 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:23.922860 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf125cb-b1da-4a02-a521-b7ea2fb7c551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:23.943328 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-8bf125cb-b1da-4a02-a521-b7ea2fb7c551 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:23.944611 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-8bf125cb-b1da-4a02-a521-b7ea2fb7c551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:23.953411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1270/2538] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:23.961710 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1df7fa-5032-4c67-9cc0-b37bd90aacc8 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:23.968272 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1df7fa-5032-4c67-9cc0-b37bd90aacc8 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:23.973015 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb6c8e-aa3a-4ef9-95e5-1af86acc5db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:23.973725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb6c8e-aa3a-4ef9-95e5-1af86acc5db8 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:23.974008 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb6c8e-aa3a-4ef9-95e5-1af86acc5db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:23.974281 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb6c8e-aa3a-4ef9-95e5-1af86acc5db8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:23.975014 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb6c8e-aa3a-4ef9-95e5-1af86acc5db8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:45:23.975320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb6c8e-aa3a-4ef9-95e5-1af86acc5db8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:23.977164 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb6c8e-aa3a-4ef9-95e5-1af86acc5db8 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:23.989879 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1269/2539] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:45:23.994327 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf125cb-b1da-4a02-a521-b7ea2fb7c551 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:24.003622 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf125cb-b1da-4a02-a521-b7ea2fb7c551 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:24.008939 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f74b6f-a771-41d0-96dd-09a6d0d9ad47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:24.009625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f74b6f-a771-41d0-96dd-09a6d0d9ad47 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:24.009913 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f74b6f-a771-41d0-96dd-09a6d0d9ad47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:24.010308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f74b6f-a771-41d0-96dd-09a6d0d9ad47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:24.010866 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f74b6f-a771-41d0-96dd-09a6d0d9ad47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:24.012815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f74b6f-a771-41d0-96dd-09a6d0d9ad47 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:24.099130 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1271/2540] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:45:23 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:45:24.103421 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb6c8e-aa3a-4ef9-95e5-1af86acc5db8 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:24.113887 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb6c8e-aa3a-4ef9-95e5-1af86acc5db8 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:24.173090 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794e538-fc19-46d3-9449-2de0f8d643fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:24.173818 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794e538-fc19-46d3-9449-2de0f8d643fb admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:24.174147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794e538-fc19-46d3-9449-2de0f8d643fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:24.174423 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794e538-fc19-46d3-9449-2de0f8d643fb admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:24.175170 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794e538-fc19-46d3-9449-2de0f8d643fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:24.177913 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794e538-fc19-46d3-9449-2de0f8d643fb admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:24.279436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:24.285390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1270/2541] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:45:24 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:45:24.290280 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f74b6f-a771-41d0-96dd-09a6d0d9ad47 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:24.308289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f74b6f-a771-41d0-96dd-09a6d0d9ad47 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:24.322911 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5177c-6ae3-4f81-816d-4a78d7450540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:24.322911 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5177c-6ae3-4f81-816d-4a78d7450540 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:24.322911 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5177c-6ae3-4f81-816d-4a78d7450540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:24.322911 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5177c-6ae3-4f81-816d-4a78d7450540 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:24.323335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5177c-6ae3-4f81-816d-4a78d7450540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:24.323335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5177c-6ae3-4f81-816d-4a78d7450540 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:24.328143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1272/2542] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:45:24.332996 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794e538-fc19-46d3-9449-2de0f8d643fb admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:24.343492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794e538-fc19-46d3-9449-2de0f8d643fb admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:24.351626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584f649-ca58-4e1f-b925-7ebac80ecfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:24.351626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584f649-ca58-4e1f-b925-7ebac80ecfa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:24.351626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584f649-ca58-4e1f-b925-7ebac80ecfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:24.351918 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584f649-ca58-4e1f-b925-7ebac80ecfa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:24.352394 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584f649-ca58-4e1f-b925-7ebac80ecfa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:24.354120 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c584f649-ca58-4e1f-b925-7ebac80ecfa3 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:24.369022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1271/2543] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:45:24.370311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5177c-6ae3-4f81-816d-4a78d7450540 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:24.380551 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5177c-6ae3-4f81-816d-4a78d7450540 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:24.385366 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbeec5-1cf1-4202-a18d-af3e3a0dc9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:24.386283 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbeec5-1cf1-4202-a18d-af3e3a0dc9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:24.386568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbeec5-1cf1-4202-a18d-af3e3a0dc9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:24.386848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbeec5-1cf1-4202-a18d-af3e3a0dc9ba admin admin] PATH_INFO: `/v3/projects/c9007646c738451aaebc5817087ec60f/users/4a5d975b49984bb38bba6704c3feff7d/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:24.401470 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbeec5-1cf1-4202-a18d-af3e3a0dc9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9007646c738451aaebc5817087ec60f, user_id=4a5d975b49984bb38bba6704c3feff7d, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:24.404134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afbeec5-1cf1-4202-a18d-af3e3a0dc9ba admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:24.498263 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1273/2544] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:45:24 2022] PUT /identity/v3/projects/c9007646c738451aaebc5817087ec60f/users/4a5d975b49984bb38bba6704c3feff7d/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:24.503282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d05512-d26a-45f0-bddb-2b2976876989 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:24.503626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d05512-d26a-45f0-bddb-2b2976876989 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:24.503888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d05512-d26a-45f0-bddb-2b2976876989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:24.520400 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-b7d05512-d26a-45f0-bddb-2b2976876989 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:24.521629 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b7d05512-d26a-45f0-bddb-2b2976876989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:24.583202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1272/2545] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:24.592557 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbeec5-1cf1-4202-a18d-af3e3a0dc9ba admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:24.594278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-3afbeec5-1cf1-4202-a18d-af3e3a0dc9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:24.609504 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:24.654098 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbeec5-1cf1-4202-a18d-af3e3a0dc9ba admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:24.658160 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35b3a6-762e-4edc-9b8a-51bd2b67675c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:24.659124 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35b3a6-762e-4edc-9b8a-51bd2b67675c service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:24.659124 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35b3a6-762e-4edc-9b8a-51bd2b67675c service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:24.659400 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35b3a6-762e-4edc-9b8a-51bd2b67675c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:24.669453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35b3a6-762e-4edc-9b8a-51bd2b67675c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:24.670992 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35b3a6-762e-4edc-9b8a-51bd2b67675c service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:24.681695 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1274/2546] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:45:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:45:30.767446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae34532-819f-4877-9e52-10c5fefb953f None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:30.767905 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae34532-819f-4877-9e52-10c5fefb953f None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:30.768033 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae34532-819f-4877-9e52-10c5fefb953f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:30.802649 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-8ae34532-819f-4877-9e52-10c5fefb953f None None] MFA Rules not processed for user `4a5d975b49984bb38bba6704c3feff7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:30.804087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-8ae34532-819f-4877-9e52-10c5fefb953f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:30.877619 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1273/2547] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:30.882632 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35b3a6-762e-4edc-9b8a-51bd2b67675c service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:30.892726 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35b3a6-762e-4edc-9b8a-51bd2b67675c service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:30.897288 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9de74-c7b7-465a-bd39-f602177a9c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:30.897976 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9de74-c7b7-465a-bd39-f602177a9c74 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:30.899302 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9de74-c7b7-465a-bd39-f602177a9c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:30.899302 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9de74-c7b7-465a-bd39-f602177a9c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:30.899302 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9de74-c7b7-465a-bd39-f602177a9c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:30.901086 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9de74-c7b7-465a-bd39-f602177a9c74 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:30.977259 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1275/2548] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:45:30 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:45:30.981327 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae34532-819f-4877-9e52-10c5fefb953f None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:30.992873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae34532-819f-4877-9e52-10c5fefb953f None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:31.058763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d4884-f782-47c3-82e1-93c9b41d20e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:31.059462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d4884-f782-47c3-82e1-93c9b41d20e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:31.059739 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d4884-f782-47c3-82e1-93c9b41d20e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:31.060022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d4884-f782-47c3-82e1-93c9b41d20e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:31.060873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d4884-f782-47c3-82e1-93c9b41d20e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:31.062726 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d4884-f782-47c3-82e1-93c9b41d20e9 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:31.149939 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1274/2549] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:45:30 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:45:31.153791 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9de74-c7b7-465a-bd39-f602177a9c74 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:31.164803 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9de74-c7b7-465a-bd39-f602177a9c74 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:31.169915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d740a2-1bd0-4fa3-b683-1dc4ef1d349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:31.170581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d740a2-1bd0-4fa3-b683-1dc4ef1d349a admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:31.170867 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d740a2-1bd0-4fa3-b683-1dc4ef1d349a admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:31.171144 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d740a2-1bd0-4fa3-b683-1dc4ef1d349a admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:31.171868 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d740a2-1bd0-4fa3-b683-1dc4ef1d349a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:31.173493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d740a2-1bd0-4fa3-b683-1dc4ef1d349a admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:31.185396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1276/2550] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:45:31.194006 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d4884-f782-47c3-82e1-93c9b41d20e9 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:31.216161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d4884-f782-47c3-82e1-93c9b41d20e9 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:31.221858 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b21bd5-0bf9-4211-a6ba-8379e0944e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:31.222809 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b21bd5-0bf9-4211-a6ba-8379e0944e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:31.223057 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b21bd5-0bf9-4211-a6ba-8379e0944e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:31.224226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b21bd5-0bf9-4211-a6ba-8379e0944e9e admin admin] PATH_INFO: `/v3/projects/d6474ba2c46b4b08b4f5840791d5a187/users/d0a53a73685b4fc4a329a56b06b04989/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:31.226760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:31.247039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b21bd5-0bf9-4211-a6ba-8379e0944e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6474ba2c46b4b08b4f5840791d5a187, user_id=d0a53a73685b4fc4a329a56b06b04989, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:31.250026 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b21bd5-0bf9-4211-a6ba-8379e0944e9e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:31.346170 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1275/2551] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:45:31 2022] PUT /identity/v3/projects/d6474ba2c46b4b08b4f5840791d5a187/users/d0a53a73685b4fc4a329a56b06b04989/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:31.350889 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d740a2-1bd0-4fa3-b683-1dc4ef1d349a admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:31.362472 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d740a2-1bd0-4fa3-b683-1dc4ef1d349a admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:31.473198 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff7341-ce44-4305-89ac-3c0e4e57cccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:31.474879 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff7341-ce44-4305-89ac-3c0e4e57cccf admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:31.475412 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff7341-ce44-4305-89ac-3c0e4e57cccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:31.475856 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff7341-ce44-4305-89ac-3c0e4e57cccf admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:31.476750 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff7341-ce44-4305-89ac-3c0e4e57cccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:31.478403 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff7341-ce44-4305-89ac-3c0e4e57cccf admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:31.490954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1277/2552] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:45:31.494210 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b21bd5-0bf9-4211-a6ba-8379e0944e9e admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:31.505228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b21bd5-0bf9-4211-a6ba-8379e0944e9e admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:31.512527 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b466e4-ebd6-4015-85da-892b618c88a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:31.514232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b466e4-ebd6-4015-85da-892b618c88a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:31.514526 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b466e4-ebd6-4015-85da-892b618c88a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:31.514762 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b466e4-ebd6-4015-85da-892b618c88a1 admin admin] PATH_INFO: `/v3/projects/d6474ba2c46b4b08b4f5840791d5a187/users/d0a53a73685b4fc4a329a56b06b04989/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:31.518134 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b466e4-ebd6-4015-85da-892b618c88a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6474ba2c46b4b08b4f5840791d5a187, user_id=d0a53a73685b4fc4a329a56b06b04989, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:31.521342 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b466e4-ebd6-4015-85da-892b618c88a1 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:31.540606 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1276/2553] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:45:31 2022] PUT /identity/v3/projects/d6474ba2c46b4b08b4f5840791d5a187/users/d0a53a73685b4fc4a329a56b06b04989/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:33.354264 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff7341-ce44-4305-89ac-3c0e4e57cccf admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:33.356507 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-81ff7341-ce44-4305-89ac-3c0e4e57cccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:33.406662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff7341-ce44-4305-89ac-3c0e4e57cccf admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:33.561247 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab39d3-3f1d-41e7-9d64-efe43bebbec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:33.562730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab39d3-3f1d-41e7-9d64-efe43bebbec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:33.563356 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab39d3-3f1d-41e7-9d64-efe43bebbec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:33.564038 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab39d3-3f1d-41e7-9d64-efe43bebbec3 admin admin] PATH_INFO: `/v3/users/fcd0d8b114b442af93c44810788c36c1` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:33.565965 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab39d3-3f1d-41e7-9d64-efe43bebbec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcd0d8b114b442af93c44810788c36c1)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:33.570288 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab39d3-3f1d-41e7-9d64-efe43bebbec3 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:33.604747 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:33.816444 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-86ab39d3-3f1d-41e7-9d64-efe43bebbec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcd0d8b114b442af93c44810788c36c1'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:33.846179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-86ab39d3-3f1d-41e7-9d64-efe43bebbec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcd0d8b114b442af93c44810788c36c1'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:33.856067 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-86ab39d3-3f1d-41e7-9d64-efe43bebbec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcd0d8b114b442af93c44810788c36c1'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:33.858070 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-86ab39d3-3f1d-41e7-9d64-efe43bebbec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcd0d8b114b442af93c44810788c36c1'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:33.859905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-86ab39d3-3f1d-41e7-9d64-efe43bebbec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcd0d8b114b442af93c44810788c36c1'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:33.955208 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13009efb-98b7-4ecd-97f0-8a1d871430b6 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:33.955208 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13009efb-98b7-4ecd-97f0-8a1d871430b6 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:33.955746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13009efb-98b7-4ecd-97f0-8a1d871430b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:33.957723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1278/2554] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:45:33 2022] DELETE /identity/v3/users/fcd0d8b114b442af93c44810788c36c1 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:33.978529 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-13009efb-98b7-4ecd-97f0-8a1d871430b6 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:33.979783 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-13009efb-98b7-4ecd-97f0-8a1d871430b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:34.077659 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1277/2555] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:34.092987 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab39d3-3f1d-41e7-9d64-efe43bebbec3 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:34.094804 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-86ab39d3-3f1d-41e7-9d64-efe43bebbec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:34.212905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab39d3-3f1d-41e7-9d64-efe43bebbec3 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:34.219732 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafba63-e76b-44d0-a356-5de9af7afd99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:34.220486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafba63-e76b-44d0-a356-5de9af7afd99 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:34.220843 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafba63-e76b-44d0-a356-5de9af7afd99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:34.221194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbafba63-e76b-44d0-a356-5de9af7afd99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:34.231352 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafba63-e76b-44d0-a356-5de9af7afd99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:34.233166 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbafba63-e76b-44d0-a356-5de9af7afd99 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:34.246760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1279/2556] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:45:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:45:34.480254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13009efb-98b7-4ecd-97f0-8a1d871430b6 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:34.482109 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-13009efb-98b7-4ecd-97f0-8a1d871430b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:34.503095 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13009efb-98b7-4ecd-97f0-8a1d871430b6 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:34.512293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7b1ec-fa5d-4686-8970-e93b857eff2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:34.512984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7b1ec-fa5d-4686-8970-e93b857eff2b service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:34.513276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7b1ec-fa5d-4686-8970-e93b857eff2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:34.513774 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7b1ec-fa5d-4686-8970-e93b857eff2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:34.517313 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-77a7b1ec-fa5d-4686-8970-e93b857eff2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:34.651208 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7b1ec-fa5d-4686-8970-e93b857eff2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:34.655890 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7b1ec-fa5d-4686-8970-e93b857eff2b service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:34.676871 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1278/2557] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:45:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:45:34.906420 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafba63-e76b-44d0-a356-5de9af7afd99 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:34.909211 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-fbafba63-e76b-44d0-a356-5de9af7afd99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:34.930606 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbafba63-e76b-44d0-a356-5de9af7afd99 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:34.938565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a53867-efff-4d67-8244-fb08227e03ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:34.940023 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a53867-efff-4d67-8244-fb08227e03ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:34.940402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a53867-efff-4d67-8244-fb08227e03ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:34.940755 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a53867-efff-4d67-8244-fb08227e03ad admin admin] PATH_INFO: `/v3/projects/5512a10baa89457295475d28e333703f` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:34.954912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a53867-efff-4d67-8244-fb08227e03ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=5512a10baa89457295475d28e333703f)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:34.960819 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a53867-efff-4d67-8244-fb08227e03ad admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:35.116941 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-00a53867-efff-4d67-8244-fb08227e03ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5512a10baa89457295475d28e333703f', 'request_id': 'req-00a53867-efff-4d67-8244-fb08227e03ad'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:35.133301 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-00a53867-efff-4d67-8244-fb08227e03ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5512a10baa89457295475d28e333703f', 'request_id': 'req-00a53867-efff-4d67-8244-fb08227e03ad'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:35.142363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-00a53867-efff-4d67-8244-fb08227e03ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5512a10baa89457295475d28e333703f', 'request_id': 'req-00a53867-efff-4d67-8244-fb08227e03ad'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:35.258150 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-00a53867-efff-4d67-8244-fb08227e03ad admin admin] The token cache is being invalidate because project 5512a10baa89457295475d28e333703f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:45:35.258455 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-00a53867-efff-4d67-8244-fb08227e03ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:35.259107 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-00a53867-efff-4d67-8244-fb08227e03ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:35.260952 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1280/2558] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:45:34 2022] DELETE /identity/v3/projects/5512a10baa89457295475d28e333703f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:35.265491 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7b1ec-fa5d-4686-8970-e93b857eff2b service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:35.277401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7b1ec-fa5d-4686-8970-e93b857eff2b service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:35.373130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03804106-645b-4e23-8ace-257cbc208893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:35.374012 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03804106-645b-4e23-8ace-257cbc208893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:35.374308 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03804106-645b-4e23-8ace-257cbc208893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:35.374659 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03804106-645b-4e23-8ace-257cbc208893 admin admin] PATH_INFO: `/v3/users/4b26f5b3997d4184856f27e57e7630fe` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:35.376180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03804106-645b-4e23-8ace-257cbc208893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b26f5b3997d4184856f27e57e7630fe)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:35.378550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03804106-645b-4e23-8ace-257cbc208893 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:35.385360 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:35.616485 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-03804106-645b-4e23-8ace-257cbc208893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b26f5b3997d4184856f27e57e7630fe'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:35.642748 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-03804106-645b-4e23-8ace-257cbc208893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b26f5b3997d4184856f27e57e7630fe'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:35.661221 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-03804106-645b-4e23-8ace-257cbc208893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b26f5b3997d4184856f27e57e7630fe'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:35.662256 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-03804106-645b-4e23-8ace-257cbc208893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b26f5b3997d4184856f27e57e7630fe'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:35.663187 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-03804106-645b-4e23-8ace-257cbc208893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b26f5b3997d4184856f27e57e7630fe'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:35.786853 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1279/2559] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:45:35 2022] DELETE /identity/v3/users/4b26f5b3997d4184856f27e57e7630fe => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:36.425149 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a53867-efff-4d67-8244-fb08227e03ad admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:36.427517 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-00a53867-efff-4d67-8244-fb08227e03ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:36.453839 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a53867-efff-4d67-8244-fb08227e03ad admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:36.488148 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:36.561263 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2719ee5-791a-49dc-bccd-05181c287bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:36.563025 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2719ee5-791a-49dc-bccd-05181c287bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:36.563477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2719ee5-791a-49dc-bccd-05181c287bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:36.564086 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2719ee5-791a-49dc-bccd-05181c287bf1 admin admin] PATH_INFO: `/v3/projects/6d158183a2eb47edbe8959049f10fe6a` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:36.566658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2719ee5-791a-49dc-bccd-05181c287bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d158183a2eb47edbe8959049f10fe6a)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:36.569903 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2719ee5-791a-49dc-bccd-05181c287bf1 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:36.756097 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c2719ee5-791a-49dc-bccd-05181c287bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d158183a2eb47edbe8959049f10fe6a', 'request_id': 'req-c2719ee5-791a-49dc-bccd-05181c287bf1'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:36.775443 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c2719ee5-791a-49dc-bccd-05181c287bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d158183a2eb47edbe8959049f10fe6a', 'request_id': 'req-c2719ee5-791a-49dc-bccd-05181c287bf1'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:36.790861 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c2719ee5-791a-49dc-bccd-05181c287bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d158183a2eb47edbe8959049f10fe6a', 'request_id': 'req-c2719ee5-791a-49dc-bccd-05181c287bf1'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:36.904123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c2719ee5-791a-49dc-bccd-05181c287bf1 admin admin] The token cache is being invalidate because project 6d158183a2eb47edbe8959049f10fe6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:45:36.904435 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c2719ee5-791a-49dc-bccd-05181c287bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:36.905062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c2719ee5-791a-49dc-bccd-05181c287bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:36.907757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1281/2560] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:45:36 2022] DELETE /identity/v3/projects/6d158183a2eb47edbe8959049f10fe6a => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:36.913155 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db873e-effa-433f-a2b3-ae46267ec4c7 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:36.914144 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db873e-effa-433f-a2b3-ae46267ec4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:36.914649 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db873e-effa-433f-a2b3-ae46267ec4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:36.940024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-01db873e-effa-433f-a2b3-ae46267ec4c7 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:36.949560 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-01db873e-effa-433f-a2b3-ae46267ec4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:37.016618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1280/2561] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:37.017709 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bdae9-a83d-4e3a-9f63-c243714bd5f7 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:37.022600 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bdae9-a83d-4e3a-9f63-c243714bd5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:37.022600 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830bdae9-a83d-4e3a-9f63-c243714bd5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:37.048271 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-830bdae9-a83d-4e3a-9f63-c243714bd5f7 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:37.052892 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-830bdae9-a83d-4e3a-9f63-c243714bd5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:37.074487 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1282/2562] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:37.078492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db873e-effa-433f-a2b3-ae46267ec4c7 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:37.099904 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db873e-effa-433f-a2b3-ae46267ec4c7 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:37.105706 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004a1ad-5626-4cc9-98c6-4ed4deb54c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:37.106392 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004a1ad-5626-4cc9-98c6-4ed4deb54c39 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:37.106745 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004a1ad-5626-4cc9-98c6-4ed4deb54c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:37.107031 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004a1ad-5626-4cc9-98c6-4ed4deb54c39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:37.108037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004a1ad-5626-4cc9-98c6-4ed4deb54c39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:45:37.108349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004a1ad-5626-4cc9-98c6-4ed4deb54c39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:37.114463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004a1ad-5626-4cc9-98c6-4ed4deb54c39 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:37.137736 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1281/2563] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:45:37.141807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830bdae9-a83d-4e3a-9f63-c243714bd5f7 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:37.157403 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830bdae9-a83d-4e3a-9f63-c243714bd5f7 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:37.165706 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffc8f1-b4b9-49ab-982c-46beb2fe1e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:37.168042 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffc8f1-b4b9-49ab-982c-46beb2fe1e06 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:37.168440 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffc8f1-b4b9-49ab-982c-46beb2fe1e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:37.168961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffc8f1-b4b9-49ab-982c-46beb2fe1e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:37.169798 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffc8f1-b4b9-49ab-982c-46beb2fe1e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:37.171900 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffc8f1-b4b9-49ab-982c-46beb2fe1e06 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:37.313015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1283/2564] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:45:37 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:45:37.317086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004a1ad-5626-4cc9-98c6-4ed4deb54c39 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:37.328191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004a1ad-5626-4cc9-98c6-4ed4deb54c39 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:37.399425 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd63ffe-2bab-4faa-83ca-6307ddcf4cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:37.400819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd63ffe-2bab-4faa-83ca-6307ddcf4cea admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:37.401356 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd63ffe-2bab-4faa-83ca-6307ddcf4cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:37.401745 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd63ffe-2bab-4faa-83ca-6307ddcf4cea admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:37.402529 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd63ffe-2bab-4faa-83ca-6307ddcf4cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:37.405123 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd63ffe-2bab-4faa-83ca-6307ddcf4cea admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:37.513588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:37.521630 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1282/2565] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:45:37 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:45:37.523739 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffc8f1-b4b9-49ab-982c-46beb2fe1e06 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:37.542673 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffc8f1-b4b9-49ab-982c-46beb2fe1e06 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:37.550598 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba077bd8-f8df-4fd4-9bca-336c40031a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:37.552355 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba077bd8-f8df-4fd4-9bca-336c40031a0b admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:37.552355 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba077bd8-f8df-4fd4-9bca-336c40031a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:37.552755 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba077bd8-f8df-4fd4-9bca-336c40031a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:37.553694 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba077bd8-f8df-4fd4-9bca-336c40031a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:37.556239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba077bd8-f8df-4fd4-9bca-336c40031a0b admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:37.583255 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1284/2566] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:45:37.587183 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd63ffe-2bab-4faa-83ca-6307ddcf4cea admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:37.601779 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd63ffe-2bab-4faa-83ca-6307ddcf4cea admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:37.608988 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d077e-f044-4296-81c3-13121bf28b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:37.609732 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d077e-f044-4296-81c3-13121bf28b9f admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:37.610058 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d077e-f044-4296-81c3-13121bf28b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:37.610343 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d077e-f044-4296-81c3-13121bf28b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:37.611090 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d077e-f044-4296-81c3-13121bf28b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:37.612715 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d077e-f044-4296-81c3-13121bf28b9f admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:37.626163 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1283/2567] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:45:37.631066 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba077bd8-f8df-4fd4-9bca-336c40031a0b admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:37.643907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba077bd8-f8df-4fd4-9bca-336c40031a0b admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:37.654486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b448f5-4206-47d0-8144-afbd9d0cdff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:37.654486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b448f5-4206-47d0-8144-afbd9d0cdff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:37.654486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b448f5-4206-47d0-8144-afbd9d0cdff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:37.654773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b448f5-4206-47d0-8144-afbd9d0cdff7 admin admin] PATH_INFO: `/v3/projects/32ff9d0e87324f21ac9308056456af53/users/d0e79efdc6a8463fb45f3ecdb8f081e6/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:37.671351 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b448f5-4206-47d0-8144-afbd9d0cdff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ff9d0e87324f21ac9308056456af53, user_id=d0e79efdc6a8463fb45f3ecdb8f081e6, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:37.674671 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b448f5-4206-47d0-8144-afbd9d0cdff7 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:37.819807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1285/2568] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:45:37 2022] PUT /identity/v3/projects/32ff9d0e87324f21ac9308056456af53/users/d0e79efdc6a8463fb45f3ecdb8f081e6/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:45:37.831852 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec9fbe-118f-48ca-bd99-21f58adf438e None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:37.831852 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec9fbe-118f-48ca-bd99-21f58adf438e None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:37.831852 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec9fbe-118f-48ca-bd99-21f58adf438e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:37.884865 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-c3ec9fbe-118f-48ca-bd99-21f58adf438e None None] MFA Rules not processed for user `d0e79efdc6a8463fb45f3ecdb8f081e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:37.886473 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c3ec9fbe-118f-48ca-bd99-21f58adf438e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:38.036562 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1284/2569] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:38.041384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b448f5-4206-47d0-8144-afbd9d0cdff7 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:38.120255 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:38.140056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b448f5-4206-47d0-8144-afbd9d0cdff7 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:38.145995 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9f39c-1076-4ecf-babc-3375e3add2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:38.146773 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9f39c-1076-4ecf-babc-3375e3add2c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:38.147125 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9f39c-1076-4ecf-babc-3375e3add2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:38.147468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9f39c-1076-4ecf-babc-3375e3add2c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:38.148365 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9f39c-1076-4ecf-babc-3375e3add2c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:38.150432 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9f39c-1076-4ecf-babc-3375e3add2c6 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:38.265787 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1286/2570] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:45:38 2022] POST /identity/v3/projects => generated 381 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:45:38.268085 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec9fbe-118f-48ca-bd99-21f58adf438e None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:38.280555 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec9fbe-118f-48ca-bd99-21f58adf438e None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:38.389444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1302c-f1d5-4c27-9e57-528d5c40a099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:38.390905 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1302c-f1d5-4c27-9e57-528d5c40a099 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:38.391622 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1302c-f1d5-4c27-9e57-528d5c40a099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:38.392095 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1302c-f1d5-4c27-9e57-528d5c40a099 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:38.392987 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1302c-f1d5-4c27-9e57-528d5c40a099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:38.395160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1302c-f1d5-4c27-9e57-528d5c40a099 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:38.511495 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1285/2571] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:45:38 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:45:38.515551 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9f39c-1076-4ecf-babc-3375e3add2c6 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:38.530142 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9f39c-1076-4ecf-babc-3375e3add2c6 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:38.540198 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a0da5-ca72-453f-95df-bbc0697a55ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:38.540942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a0da5-ca72-453f-95df-bbc0697a55ce admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:38.541228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a0da5-ca72-453f-95df-bbc0697a55ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:38.541503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a0da5-ca72-453f-95df-bbc0697a55ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:38.542283 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a0da5-ca72-453f-95df-bbc0697a55ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:38.549362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a0da5-ca72-453f-95df-bbc0697a55ce admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:38.570427 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1287/2572] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:45:38.573744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1302c-f1d5-4c27-9e57-528d5c40a099 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:38.612028 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1302c-f1d5-4c27-9e57-528d5c40a099 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:38.614768 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee092f-0206-406a-97ad-53eff2a9ae1f None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:38.615139 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee092f-0206-406a-97ad-53eff2a9ae1f None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:38.615592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee092f-0206-406a-97ad-53eff2a9ae1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:38.619247 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e33a09-f44d-40f4-8612-082cc50e6a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:38.621070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e33a09-f44d-40f4-8612-082cc50e6a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:38.621437 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e33a09-f44d-40f4-8612-082cc50e6a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:38.622121 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e33a09-f44d-40f4-8612-082cc50e6a78 admin admin] PATH_INFO: `/v3/projects/49de55c844ae4ca88f121a4dd8d92431/users/6b469f587b584e3da7553c0bbc47bade/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:38.641762 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e33a09-f44d-40f4-8612-082cc50e6a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49de55c844ae4ca88f121a4dd8d92431, user_id=6b469f587b584e3da7553c0bbc47bade, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:38.644534 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e33a09-f44d-40f4-8612-082cc50e6a78 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:38.669023 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-16ee092f-0206-406a-97ad-53eff2a9ae1f None None] MFA Rules not processed for user `d0a53a73685b4fc4a329a56b06b04989`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:38.670319 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-16ee092f-0206-406a-97ad-53eff2a9ae1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:38.724027 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1286/2573] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:45:38 2022] PUT /identity/v3/projects/49de55c844ae4ca88f121a4dd8d92431/users/6b469f587b584e3da7553c0bbc47bade/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:38.734108 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e33a09-f44d-40f4-8612-082cc50e6a78 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:38.807334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:38.816610 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1288/2574] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:38.824487 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee092f-0206-406a-97ad-53eff2a9ae1f None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:38.826188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-16ee092f-0206-406a-97ad-53eff2a9ae1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:38.835436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e33a09-f44d-40f4-8612-082cc50e6a78 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:38.843185 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb1bae-37ec-4c2b-b841-cb854df08ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:38.843527 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb1bae-37ec-4c2b-b841-cb854df08ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:38.843879 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb1bae-37ec-4c2b-b841-cb854df08ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:38.844225 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bb1bae-37ec-4c2b-b841-cb854df08ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:38.845091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb1bae-37ec-4c2b-b841-cb854df08ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:38.846914 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bb1bae-37ec-4c2b-b841-cb854df08ae2 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:38.866261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1287/2575] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:45:38 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:45:38.867405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb1bae-37ec-4c2b-b841-cb854df08ae2 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:38.882271 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bb1bae-37ec-4c2b-b841-cb854df08ae2 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:38.890260 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5397157-c9cb-4419-9b15-101dffa56b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:38.893050 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5397157-c9cb-4419-9b15-101dffa56b62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:38.893050 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5397157-c9cb-4419-9b15-101dffa56b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:38.893050 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5397157-c9cb-4419-9b15-101dffa56b62 admin admin] PATH_INFO: `/v3/projects/49de55c844ae4ca88f121a4dd8d92431/users/6b469f587b584e3da7553c0bbc47bade/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:38.894819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5397157-c9cb-4419-9b15-101dffa56b62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49de55c844ae4ca88f121a4dd8d92431, user_id=6b469f587b584e3da7553c0bbc47bade, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:38.898288 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5397157-c9cb-4419-9b15-101dffa56b62 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:38.917007 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1288/2576] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:45:38 2022] PUT /identity/v3/projects/49de55c844ae4ca88f121a4dd8d92431/users/6b469f587b584e3da7553c0bbc47bade/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:38.929232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a6e2d-2e89-48a7-add6-6cb45d2efe78 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:38.929675 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a6e2d-2e89-48a7-add6-6cb45d2efe78 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:38.930027 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a6e2d-2e89-48a7-add6-6cb45d2efe78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:38.960005 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-cb4a6e2d-2e89-48a7-add6-6cb45d2efe78 None None] MFA Rules not processed for user `6b469f587b584e3da7553c0bbc47bade`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:38.960989 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee092f-0206-406a-97ad-53eff2a9ae1f None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:38.961424 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-cb4a6e2d-2e89-48a7-add6-6cb45d2efe78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:38.987978 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:39.041052 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1201aa-bf4c-4abf-9c9c-aafb21b57b2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:39.041733 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1201aa-bf4c-4abf-9c9c-aafb21b57b2a service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:39.042173 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1201aa-bf4c-4abf-9c9c-aafb21b57b2a service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:39.042451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1201aa-bf4c-4abf-9c9c-aafb21b57b2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:39.045574 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1289/2577] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:45:39.046045 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-7e1201aa-bf4c-4abf-9c9c-aafb21b57b2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:39.055821 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a6e2d-2e89-48a7-add6-6cb45d2efe78 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:39.057701 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-cb4a6e2d-2e89-48a7-add6-6cb45d2efe78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:39.107833 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1201aa-bf4c-4abf-9c9c-aafb21b57b2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:39.109455 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1201aa-bf4c-4abf-9c9c-aafb21b57b2a service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:39.116460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a6e2d-2e89-48a7-add6-6cb45d2efe78 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:39.118790 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1289/2578] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:45:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:45:39.123305 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0c7af-a607-42bc-8470-867ea5bc7450 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:39.124977 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0c7af-a607-42bc-8470-867ea5bc7450 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:39.125178 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0c7af-a607-42bc-8470-867ea5bc7450 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:39.125542 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0c7af-a607-42bc-8470-867ea5bc7450 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:39.135088 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0c7af-a607-42bc-8470-867ea5bc7450 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:39.136519 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0c7af-a607-42bc-8470-867ea5bc7450 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:39.146760 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1290/2579] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:45:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:45:39.248625 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1201aa-bf4c-4abf-9c9c-aafb21b57b2a service nova] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:39.258296 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1201aa-bf4c-4abf-9c9c-aafb21b57b2a service nova] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:39.262138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d206f16-d3c2-4a99-95e1-99aa6559abd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:39.262776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d206f16-d3c2-4a99-95e1-99aa6559abd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:39.263094 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d206f16-d3c2-4a99-95e1-99aa6559abd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:39.263372 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d206f16-d3c2-4a99-95e1-99aa6559abd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:39.320968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d206f16-d3c2-4a99-95e1-99aa6559abd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:39.322412 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d206f16-d3c2-4a99-95e1-99aa6559abd0 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:39.331295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1290/2580] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:45:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:45:42.496058 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069d5bc-9965-4e2f-80cf-f3b189ac27bc None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:42.496627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069d5bc-9965-4e2f-80cf-f3b189ac27bc None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:42.496829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069d5bc-9965-4e2f-80cf-f3b189ac27bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:42.515583 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-7069d5bc-9965-4e2f-80cf-f3b189ac27bc None None] MFA Rules not processed for user `4a5d975b49984bb38bba6704c3feff7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:42.516823 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7069d5bc-9965-4e2f-80cf-f3b189ac27bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:42.525909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1291/2581] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:42.674176 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d206f16-d3c2-4a99-95e1-99aa6559abd0 service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:42.781007 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:42.785684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d206f16-d3c2-4a99-95e1-99aa6559abd0 service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:42.790762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51819b0-872e-4437-9bdb-45826917fa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:42.791641 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51819b0-872e-4437-9bdb-45826917fa8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:42.791926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51819b0-872e-4437-9bdb-45826917fa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:42.792204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51819b0-872e-4437-9bdb-45826917fa8a admin admin] PATH_INFO: `/v3/users/d0e79efdc6a8463fb45f3ecdb8f081e6` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:42.793411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51819b0-872e-4437-9bdb-45826917fa8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e79efdc6a8463fb45f3ecdb8f081e6)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:42.795791 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51819b0-872e-4437-9bdb-45826917fa8a admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:43.082464 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c51819b0-872e-4437-9bdb-45826917fa8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e79efdc6a8463fb45f3ecdb8f081e6'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:43.096607 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c51819b0-872e-4437-9bdb-45826917fa8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e79efdc6a8463fb45f3ecdb8f081e6'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:43.107004 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c51819b0-872e-4437-9bdb-45826917fa8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e79efdc6a8463fb45f3ecdb8f081e6'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:43.108037 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c51819b0-872e-4437-9bdb-45826917fa8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e79efdc6a8463fb45f3ecdb8f081e6'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:43.108999 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c51819b0-872e-4437-9bdb-45826917fa8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e79efdc6a8463fb45f3ecdb8f081e6'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:43.189100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1291/2582] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:45:42 2022] DELETE /identity/v3/users/d0e79efdc6a8463fb45f3ecdb8f081e6 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:43.193959 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ae185-6d30-47a5-8b5a-49cdb19166b3 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:43.194922 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ae185-6d30-47a5-8b5a-49cdb19166b3 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:43.195530 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ae185-6d30-47a5-8b5a-49cdb19166b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:43.215604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-a59ae185-6d30-47a5-8b5a-49cdb19166b3 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:43.218730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a59ae185-6d30-47a5-8b5a-49cdb19166b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:43.267046 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:43.290979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1292/2583] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:43.300978 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51819b0-872e-4437-9bdb-45826917fa8a admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:43.303756 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-c51819b0-872e-4437-9bdb-45826917fa8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:43.435088 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51819b0-872e-4437-9bdb-45826917fa8a admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:43.457005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6442d0c-d60f-44e9-83aa-3061578a5574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:43.458519 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6442d0c-d60f-44e9-83aa-3061578a5574 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:43.458917 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6442d0c-d60f-44e9-83aa-3061578a5574 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:43.459340 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6442d0c-d60f-44e9-83aa-3061578a5574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:43.473052 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6442d0c-d60f-44e9-83aa-3061578a5574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:43.475603 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6442d0c-d60f-44e9-83aa-3061578a5574 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:43.487748 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1292/2584] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:45:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:45:44.283087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ae185-6d30-47a5-8b5a-49cdb19166b3 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:44.285323 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a59ae185-6d30-47a5-8b5a-49cdb19166b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:44.299120 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ae185-6d30-47a5-8b5a-49cdb19166b3 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:44.304627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35af7f-d97f-420c-b156-568c28ed365e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:44.305858 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35af7f-d97f-420c-b156-568c28ed365e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:44.306240 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35af7f-d97f-420c-b156-568c28ed365e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:44.306615 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35af7f-d97f-420c-b156-568c28ed365e admin admin] PATH_INFO: `/v3/projects/32ff9d0e87324f21ac9308056456af53` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:44.307925 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35af7f-d97f-420c-b156-568c28ed365e admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ff9d0e87324f21ac9308056456af53)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:44.309993 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35af7f-d97f-420c-b156-568c28ed365e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:44.464120 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9d35af7f-d97f-420c-b156-568c28ed365e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ff9d0e87324f21ac9308056456af53', 'request_id': 'req-9d35af7f-d97f-420c-b156-568c28ed365e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:44.470728 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9d35af7f-d97f-420c-b156-568c28ed365e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ff9d0e87324f21ac9308056456af53', 'request_id': 'req-9d35af7f-d97f-420c-b156-568c28ed365e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:44.561010 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9d35af7f-d97f-420c-b156-568c28ed365e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ff9d0e87324f21ac9308056456af53', 'request_id': 'req-9d35af7f-d97f-420c-b156-568c28ed365e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:44.576448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9d35af7f-d97f-420c-b156-568c28ed365e admin admin] The token cache is being invalidate because project 32ff9d0e87324f21ac9308056456af53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:45:44.576448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9d35af7f-d97f-420c-b156-568c28ed365e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:44.576448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9d35af7f-d97f-420c-b156-568c28ed365e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:44.577206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1293/2585] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:45:44 2022] DELETE /identity/v3/projects/32ff9d0e87324f21ac9308056456af53 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:44.581217 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6442d0c-d60f-44e9-83aa-3061578a5574 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:44.593699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6442d0c-d60f-44e9-83aa-3061578a5574 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:44.659906 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d3985-c637-4170-8738-c6feeec91071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:44.661340 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d3985-c637-4170-8738-c6feeec91071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:44.670697 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d3985-c637-4170-8738-c6feeec91071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:44.670697 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d3985-c637-4170-8738-c6feeec91071 admin admin] PATH_INFO: `/v3/users/6b469f587b584e3da7553c0bbc47bade` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:44.670697 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d3985-c637-4170-8738-c6feeec91071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b469f587b584e3da7553c0bbc47bade)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:44.670697 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d3985-c637-4170-8738-c6feeec91071 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:44.670697 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:44.930015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-393d3985-c637-4170-8738-c6feeec91071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b469f587b584e3da7553c0bbc47bade'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:44.946211 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-393d3985-c637-4170-8738-c6feeec91071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b469f587b584e3da7553c0bbc47bade'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:44.953893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-393d3985-c637-4170-8738-c6feeec91071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b469f587b584e3da7553c0bbc47bade'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:44.954655 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-393d3985-c637-4170-8738-c6feeec91071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b469f587b584e3da7553c0bbc47bade'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:44.955288 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-393d3985-c637-4170-8738-c6feeec91071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b469f587b584e3da7553c0bbc47bade'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:45.075586 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1293/2586] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:45:44 2022] DELETE /identity/v3/users/6b469f587b584e3da7553c0bbc47bade => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:45.555011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35af7f-d97f-420c-b156-568c28ed365e admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:45.556473 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9d35af7f-d97f-420c-b156-568c28ed365e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:45.571382 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35af7f-d97f-420c-b156-568c28ed365e admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:45.643810 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa1564-790e-4e67-a256-f541ecd675f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:45.644722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1564-790e-4e67-a256-f541ecd675f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:45.645009 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1564-790e-4e67-a256-f541ecd675f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:45.645949 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1564-790e-4e67-a256-f541ecd675f0 admin admin] PATH_INFO: `/v3/projects/49de55c844ae4ca88f121a4dd8d92431` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:45.647147 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa1564-790e-4e67-a256-f541ecd675f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49de55c844ae4ca88f121a4dd8d92431)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:45.649087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa1564-790e-4e67-a256-f541ecd675f0 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:45.779506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-0ffa1564-790e-4e67-a256-f541ecd675f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49de55c844ae4ca88f121a4dd8d92431', 'request_id': 'req-0ffa1564-790e-4e67-a256-f541ecd675f0'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:45.785469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-0ffa1564-790e-4e67-a256-f541ecd675f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49de55c844ae4ca88f121a4dd8d92431', 'request_id': 'req-0ffa1564-790e-4e67-a256-f541ecd675f0'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:45.852069 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-0ffa1564-790e-4e67-a256-f541ecd675f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49de55c844ae4ca88f121a4dd8d92431', 'request_id': 'req-0ffa1564-790e-4e67-a256-f541ecd675f0'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:45.865250 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-0ffa1564-790e-4e67-a256-f541ecd675f0 admin admin] The token cache is being invalidate because project 49de55c844ae4ca88f121a4dd8d92431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:45:45.865546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-0ffa1564-790e-4e67-a256-f541ecd675f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:45.866292 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-0ffa1564-790e-4e67-a256-f541ecd675f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:45.867901 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1294/2587] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:45:45 2022] DELETE /identity/v3/projects/49de55c844ae4ca88f121a4dd8d92431 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:45.873039 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76a82e-db61-4f14-aef0-0be19dfeae63 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:45.873562 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76a82e-db61-4f14-aef0-0be19dfeae63 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:45.873679 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76a82e-db61-4f14-aef0-0be19dfeae63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:45.894371 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-ae76a82e-db61-4f14-aef0-0be19dfeae63 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:45.895517 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ae76a82e-db61-4f14-aef0-0be19dfeae63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:45.959902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1294/2588] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:45.967591 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4eaeb-2789-4ec4-9f7d-5ef20345a35e None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:45.967910 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4eaeb-2789-4ec4-9f7d-5ef20345a35e None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:45.968193 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4eaeb-2789-4ec4-9f7d-5ef20345a35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:45.974938 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:45.987666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-5ab4eaeb-2789-4ec4-9f7d-5ef20345a35e None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:45.989487 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-5ab4eaeb-2789-4ec4-9f7d-5ef20345a35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:45.997749 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1295/2589] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:46.002269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76a82e-db61-4f14-aef0-0be19dfeae63 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:46.012776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76a82e-db61-4f14-aef0-0be19dfeae63 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:46.017402 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46520e-78c8-4d8c-876a-277e4bf725f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:46.020651 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46520e-78c8-4d8c-876a-277e4bf725f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:46.020651 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46520e-78c8-4d8c-876a-277e4bf725f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:46.020651 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f46520e-78c8-4d8c-876a-277e4bf725f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:46.020651 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46520e-78c8-4d8c-876a-277e4bf725f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:45:46.020651 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46520e-78c8-4d8c-876a-277e4bf725f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:46.021307 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f46520e-78c8-4d8c-876a-277e4bf725f4 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:46.033486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1295/2590] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:45:46.038424 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4eaeb-2789-4ec4-9f7d-5ef20345a35e None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:46.048359 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4eaeb-2789-4ec4-9f7d-5ef20345a35e None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:46.053678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e9f1e-8327-4875-a829-607c5c1c12b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:46.055132 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e9f1e-8327-4875-a829-607c5c1c12b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:46.055132 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e9f1e-8327-4875-a829-607c5c1c12b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:46.055132 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e9f1e-8327-4875-a829-607c5c1c12b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:46.055627 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e9f1e-8327-4875-a829-607c5c1c12b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:46.057708 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e9f1e-8327-4875-a829-607c5c1c12b4 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:46.157264 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1296/2591] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:45:46 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:45:46.161438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46520e-78c8-4d8c-876a-277e4bf725f4 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:46.171691 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f46520e-78c8-4d8c-876a-277e4bf725f4 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:46.230350 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af9133-194c-4ba1-9a3f-484ea9d711a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:46.231316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af9133-194c-4ba1-9a3f-484ea9d711a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:46.231599 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af9133-194c-4ba1-9a3f-484ea9d711a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:46.231872 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af9133-194c-4ba1-9a3f-484ea9d711a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:46.232821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af9133-194c-4ba1-9a3f-484ea9d711a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:46.234852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af9133-194c-4ba1-9a3f-484ea9d711a6 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:46.244538 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:46.304497 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1296/2592] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:45:46 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:45:46.308783 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e9f1e-8327-4875-a829-607c5c1c12b4 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:46.320018 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e9f1e-8327-4875-a829-607c5c1c12b4 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:46.324890 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc5d48-2742-4356-8571-f1507ab9f493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:46.325610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc5d48-2742-4356-8571-f1507ab9f493 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:46.325908 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc5d48-2742-4356-8571-f1507ab9f493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:46.326189 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bc5d48-2742-4356-8571-f1507ab9f493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:46.326922 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc5d48-2742-4356-8571-f1507ab9f493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:46.328533 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bc5d48-2742-4356-8571-f1507ab9f493 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:46.342292 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1297/2593] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:45:46.346648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af9133-194c-4ba1-9a3f-484ea9d711a6 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:46.357781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af9133-194c-4ba1-9a3f-484ea9d711a6 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:46.363475 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5685a6-71c7-446b-aafa-c722a8f984cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:46.368901 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5685a6-71c7-446b-aafa-c722a8f984cc admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:46.368901 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5685a6-71c7-446b-aafa-c722a8f984cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:46.368901 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5685a6-71c7-446b-aafa-c722a8f984cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:46.368901 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5685a6-71c7-446b-aafa-c722a8f984cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:46.368901 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5685a6-71c7-446b-aafa-c722a8f984cc admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:46.377397 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1297/2594] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:45:46.382216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc5d48-2742-4356-8571-f1507ab9f493 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:46.392620 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bc5d48-2742-4356-8571-f1507ab9f493 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:46.398352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d8e5f-6220-4d9a-aab9-26da51f5de5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:46.399275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d8e5f-6220-4d9a-aab9-26da51f5de5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:46.399560 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d8e5f-6220-4d9a-aab9-26da51f5de5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:46.399840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d8e5f-6220-4d9a-aab9-26da51f5de5b admin admin] PATH_INFO: `/v3/projects/a62d5ded050444c3a516eba8ce2447de/users/9cde993b02314e95a9181e8ae11244e7/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:46.416559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d8e5f-6220-4d9a-aab9-26da51f5de5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a62d5ded050444c3a516eba8ce2447de, user_id=9cde993b02314e95a9181e8ae11244e7, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:46.420372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d8e5f-6220-4d9a-aab9-26da51f5de5b admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:46.485018 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1298/2595] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:45:46 2022] PUT /identity/v3/projects/a62d5ded050444c3a516eba8ce2447de/users/9cde993b02314e95a9181e8ae11244e7/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:46.496232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897b8bb-6394-4c5a-a284-c27c8ea40aac None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:46.496527 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897b8bb-6394-4c5a-a284-c27c8ea40aac None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:46.496811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897b8bb-6394-4c5a-a284-c27c8ea40aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:46.523964 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-a897b8bb-6394-4c5a-a284-c27c8ea40aac None None] MFA Rules not processed for user `9cde993b02314e95a9181e8ae11244e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:46.525364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-a897b8bb-6394-4c5a-a284-c27c8ea40aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:46.608418 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1298/2596] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:46.619802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d8e5f-6220-4d9a-aab9-26da51f5de5b admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:46.622411 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-1e5d8e5f-6220-4d9a-aab9-26da51f5de5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:46.709652 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d8e5f-6220-4d9a-aab9-26da51f5de5b admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:46.714569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d9907-210e-48c4-8c99-5ebe64b46928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:46.714569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d9907-210e-48c4-8c99-5ebe64b46928 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:46.716023 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d9907-210e-48c4-8c99-5ebe64b46928 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:46.716318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d9907-210e-48c4-8c99-5ebe64b46928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:46.728270 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d9907-210e-48c4-8c99-5ebe64b46928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:46.729878 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787d9907-210e-48c4-8c99-5ebe64b46928 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:46.760214 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1299/2597] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:45:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:45:51.070746 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897b8bb-6394-4c5a-a284-c27c8ea40aac None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:51.141184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897b8bb-6394-4c5a-a284-c27c8ea40aac None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:51.145930 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfe478-87ca-4d85-bf69-58cdb805e4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:51.147310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfe478-87ca-4d85-bf69-58cdb805e4cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:51.147612 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfe478-87ca-4d85-bf69-58cdb805e4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:51.147885 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfe478-87ca-4d85-bf69-58cdb805e4cf admin admin] PATH_INFO: `/v3/users/9cde993b02314e95a9181e8ae11244e7` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:51.149052 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfe478-87ca-4d85-bf69-58cdb805e4cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cde993b02314e95a9181e8ae11244e7)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:51.151048 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfe478-87ca-4d85-bf69-58cdb805e4cf admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:51.349965 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-0abfe478-87ca-4d85-bf69-58cdb805e4cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cde993b02314e95a9181e8ae11244e7'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:51.363619 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-0abfe478-87ca-4d85-bf69-58cdb805e4cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cde993b02314e95a9181e8ae11244e7'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:51.370908 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-0abfe478-87ca-4d85-bf69-58cdb805e4cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cde993b02314e95a9181e8ae11244e7'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:51.371588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-0abfe478-87ca-4d85-bf69-58cdb805e4cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cde993b02314e95a9181e8ae11244e7'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:51.372223 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-0abfe478-87ca-4d85-bf69-58cdb805e4cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cde993b02314e95a9181e8ae11244e7'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:51.374801 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:51.486311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1299/2598] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:45:51 2022] DELETE /identity/v3/users/9cde993b02314e95a9181e8ae11244e7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:51.490890 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855d315-0432-4526-bb40-f0f1a56ffe8d None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:51.491438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855d315-0432-4526-bb40-f0f1a56ffe8d None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:51.491438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855d315-0432-4526-bb40-f0f1a56ffe8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:51.509417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-9855d315-0432-4526-bb40-f0f1a56ffe8d None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:51.510898 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9855d315-0432-4526-bb40-f0f1a56ffe8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:51.571918 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1300/2599] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:51.581869 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfe478-87ca-4d85-bf69-58cdb805e4cf admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:51.583386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-0abfe478-87ca-4d85-bf69-58cdb805e4cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:51.643514 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfe478-87ca-4d85-bf69-58cdb805e4cf admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:51.647851 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585de95d-abf8-436c-bba6-b8f602bb893d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:51.648505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585de95d-abf8-436c-bba6-b8f602bb893d service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:51.648791 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585de95d-abf8-436c-bba6-b8f602bb893d service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:51.649069 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585de95d-abf8-436c-bba6-b8f602bb893d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:51.658740 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585de95d-abf8-436c-bba6-b8f602bb893d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:51.660179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585de95d-abf8-436c-bba6-b8f602bb893d service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:51.670839 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1300/2600] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:45:52.123460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855d315-0432-4526-bb40-f0f1a56ffe8d None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:52.124938 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9855d315-0432-4526-bb40-f0f1a56ffe8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:52.139505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855d315-0432-4526-bb40-f0f1a56ffe8d None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:52.145875 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e73724-68d7-4382-9908-1a778fbdfa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:52.146748 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e73724-68d7-4382-9908-1a778fbdfa8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:52.147051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e73724-68d7-4382-9908-1a778fbdfa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:52.147503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e73724-68d7-4382-9908-1a778fbdfa8e admin admin] PATH_INFO: `/v3/projects/a62d5ded050444c3a516eba8ce2447de` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:52.148860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e73724-68d7-4382-9908-1a778fbdfa8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a62d5ded050444c3a516eba8ce2447de)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:52.151224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e73724-68d7-4382-9908-1a778fbdfa8e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:52.177444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:52.292806 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-b7e73724-68d7-4382-9908-1a778fbdfa8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a62d5ded050444c3a516eba8ce2447de', 'request_id': 'req-b7e73724-68d7-4382-9908-1a778fbdfa8e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:52.298359 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-b7e73724-68d7-4382-9908-1a778fbdfa8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a62d5ded050444c3a516eba8ce2447de', 'request_id': 'req-b7e73724-68d7-4382-9908-1a778fbdfa8e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:52.366851 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-b7e73724-68d7-4382-9908-1a778fbdfa8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a62d5ded050444c3a516eba8ce2447de', 'request_id': 'req-b7e73724-68d7-4382-9908-1a778fbdfa8e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:52.378297 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-b7e73724-68d7-4382-9908-1a778fbdfa8e admin admin] The token cache is being invalidate because project a62d5ded050444c3a516eba8ce2447de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:45:52.378588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-b7e73724-68d7-4382-9908-1a778fbdfa8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:52.379226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-b7e73724-68d7-4382-9908-1a778fbdfa8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:52.380773 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1301/2601] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:45:52 2022] DELETE /identity/v3/projects/a62d5ded050444c3a516eba8ce2447de => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:52.385809 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e906f87-7a70-4eb0-8232-4fae0eca9861 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:52.386284 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e906f87-7a70-4eb0-8232-4fae0eca9861 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:52.386389 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e906f87-7a70-4eb0-8232-4fae0eca9861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:52.404161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-6e906f87-7a70-4eb0-8232-4fae0eca9861 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:52.405362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-6e906f87-7a70-4eb0-8232-4fae0eca9861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:52.464618 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1301/2602] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:52.473276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d875b-8b54-48b0-adbd-2d191b45a944 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:52.473599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d875b-8b54-48b0-adbd-2d191b45a944 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:52.473881 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d875b-8b54-48b0-adbd-2d191b45a944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:52.493876 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-574d875b-8b54-48b0-adbd-2d191b45a944 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:52.495079 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-574d875b-8b54-48b0-adbd-2d191b45a944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:52.503064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1302/2603] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:52.507070 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e906f87-7a70-4eb0-8232-4fae0eca9861 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:52.516558 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e906f87-7a70-4eb0-8232-4fae0eca9861 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:52.521132 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91397a3-4b17-4a27-9fd5-41beb0cfaae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:52.521812 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91397a3-4b17-4a27-9fd5-41beb0cfaae1 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:52.522100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91397a3-4b17-4a27-9fd5-41beb0cfaae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:52.522384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91397a3-4b17-4a27-9fd5-41beb0cfaae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:52.523600 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91397a3-4b17-4a27-9fd5-41beb0cfaae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:45:52.523909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91397a3-4b17-4a27-9fd5-41beb0cfaae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:52.525507 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91397a3-4b17-4a27-9fd5-41beb0cfaae1 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:52.536839 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1302/2604] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:45:52.541614 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d875b-8b54-48b0-adbd-2d191b45a944 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:52.550733 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d875b-8b54-48b0-adbd-2d191b45a944 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:52.557077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3f73f-fd75-4844-ac5c-073bf0d62049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:52.557761 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3f73f-fd75-4844-ac5c-073bf0d62049 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:52.558042 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3f73f-fd75-4844-ac5c-073bf0d62049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:52.558319 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c3f73f-fd75-4844-ac5c-073bf0d62049 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:52.559017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3f73f-fd75-4844-ac5c-073bf0d62049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:52.561274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c3f73f-fd75-4844-ac5c-073bf0d62049 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:52.665948 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1303/2605] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:45:52 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:45:52.670628 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91397a3-4b17-4a27-9fd5-41beb0cfaae1 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:52.681028 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91397a3-4b17-4a27-9fd5-41beb0cfaae1 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:52.737623 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5538e8-e716-4c93-901d-6d1e3d33a614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:52.738329 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5538e8-e716-4c93-901d-6d1e3d33a614 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:52.738612 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5538e8-e716-4c93-901d-6d1e3d33a614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:52.738886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5538e8-e716-4c93-901d-6d1e3d33a614 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:52.739611 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5538e8-e716-4c93-901d-6d1e3d33a614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:52.741640 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5538e8-e716-4c93-901d-6d1e3d33a614 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:52.829916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1303/2606] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:45:52 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:45:52.834042 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3f73f-fd75-4844-ac5c-073bf0d62049 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:52.845367 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c3f73f-fd75-4844-ac5c-073bf0d62049 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:52.850292 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3442d2c-14fc-4ee3-bc63-2942f02594ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:52.850981 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3442d2c-14fc-4ee3-bc63-2942f02594ba admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:52.851289 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3442d2c-14fc-4ee3-bc63-2942f02594ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:52.851565 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3442d2c-14fc-4ee3-bc63-2942f02594ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:52.852298 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3442d2c-14fc-4ee3-bc63-2942f02594ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:52.853944 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3442d2c-14fc-4ee3-bc63-2942f02594ba admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:52.864792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1304/2607] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:45:52.868896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5538e8-e716-4c93-901d-6d1e3d33a614 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:52.879199 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5538e8-e716-4c93-901d-6d1e3d33a614 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:52.884378 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2ac80-f3d9-4a25-afa2-a6ee99dcbaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:52.885037 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2ac80-f3d9-4a25-afa2-a6ee99dcbaec admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:52.885315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2ac80-f3d9-4a25-afa2-a6ee99dcbaec admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:52.885630 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2ac80-f3d9-4a25-afa2-a6ee99dcbaec admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:52.886361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2ac80-f3d9-4a25-afa2-a6ee99dcbaec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:52.887931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2ac80-f3d9-4a25-afa2-a6ee99dcbaec admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:52.898386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1304/2608] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:45:52.902373 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3442d2c-14fc-4ee3-bc63-2942f02594ba admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:52.912444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3442d2c-14fc-4ee3-bc63-2942f02594ba admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:52.917205 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94bfc4-9d5d-4195-8bb5-e08a118fd616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:52.918110 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94bfc4-9d5d-4195-8bb5-e08a118fd616 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:52.918395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94bfc4-9d5d-4195-8bb5-e08a118fd616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:52.918673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94bfc4-9d5d-4195-8bb5-e08a118fd616 admin admin] PATH_INFO: `/v3/projects/e177128192634d729c3a251015100279/users/b4904577d29147d8b4d495c6d4cc0d12/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:52.933174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94bfc4-9d5d-4195-8bb5-e08a118fd616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e177128192634d729c3a251015100279, user_id=b4904577d29147d8b4d495c6d4cc0d12, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:52.935950 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94bfc4-9d5d-4195-8bb5-e08a118fd616 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:53.047679 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1305/2609] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:45:52 2022] PUT /identity/v3/projects/e177128192634d729c3a251015100279/users/b4904577d29147d8b4d495c6d4cc0d12/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:45:53.057968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb065af9-a933-4f48-96ea-e4d58ecbe615 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:53.058265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb065af9-a933-4f48-96ea-e4d58ecbe615 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:53.058550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb065af9-a933-4f48-96ea-e4d58ecbe615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:53.064437 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:53.085843 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-bb065af9-a933-4f48-96ea-e4d58ecbe615 None None] MFA Rules not processed for user `b4904577d29147d8b4d495c6d4cc0d12`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:53.087046 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-bb065af9-a933-4f48-96ea-e4d58ecbe615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:53.156535 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1305/2610] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:53.160757 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94bfc4-9d5d-4195-8bb5-e08a118fd616 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:53.222945 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94bfc4-9d5d-4195-8bb5-e08a118fd616 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:53.227723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0251d5c-6d19-432d-9d48-f17ff7b7bbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:53.228377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0251d5c-6d19-432d-9d48-f17ff7b7bbc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:53.228661 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0251d5c-6d19-432d-9d48-f17ff7b7bbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:53.228936 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0251d5c-6d19-432d-9d48-f17ff7b7bbc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:53.229651 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0251d5c-6d19-432d-9d48-f17ff7b7bbc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:53.231556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0251d5c-6d19-432d-9d48-f17ff7b7bbc6 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:53.328563 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1306/2611] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:45:53 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:45:53.331796 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb065af9-a933-4f48-96ea-e4d58ecbe615 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:53.342586 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb065af9-a933-4f48-96ea-e4d58ecbe615 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:53.399160 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d145d-dc10-43f7-95d4-fa8eebf72cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:53.399822 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d145d-dc10-43f7-95d4-fa8eebf72cef admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:53.400105 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d145d-dc10-43f7-95d4-fa8eebf72cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:53.400384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5d145d-dc10-43f7-95d4-fa8eebf72cef admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:53.401068 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d145d-dc10-43f7-95d4-fa8eebf72cef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:53.403026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5d145d-dc10-43f7-95d4-fa8eebf72cef admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:53.491492 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1306/2612] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:45:53 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:45:53.495498 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0251d5c-6d19-432d-9d48-f17ff7b7bbc6 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:53.506162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0251d5c-6d19-432d-9d48-f17ff7b7bbc6 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:53.511296 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a361b0-116d-4eff-b069-b4f826e4a484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:53.511946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a361b0-116d-4eff-b069-b4f826e4a484 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:53.512224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a361b0-116d-4eff-b069-b4f826e4a484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:53.512496 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a361b0-116d-4eff-b069-b4f826e4a484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:53.513217 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a361b0-116d-4eff-b069-b4f826e4a484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:53.514869 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a361b0-116d-4eff-b069-b4f826e4a484 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:53.525902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1307/2613] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:45:53.531652 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d145d-dc10-43f7-95d4-fa8eebf72cef admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:53.539594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5d145d-dc10-43f7-95d4-fa8eebf72cef admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:53.544216 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9eb05-d356-4ec7-8f66-40328d290033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:53.544856 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9eb05-d356-4ec7-8f66-40328d290033 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:53.545136 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9eb05-d356-4ec7-8f66-40328d290033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:53.545408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9eb05-d356-4ec7-8f66-40328d290033 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:53.546156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9eb05-d356-4ec7-8f66-40328d290033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:53.547751 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9eb05-d356-4ec7-8f66-40328d290033 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:53.557505 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1307/2614] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:45:53.561363 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a361b0-116d-4eff-b069-b4f826e4a484 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:53.571725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a361b0-116d-4eff-b069-b4f826e4a484 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:53.576341 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c940e-38ce-4633-8473-edf0adc7e48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:53.577251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c940e-38ce-4633-8473-edf0adc7e48e admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:53.577572 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c940e-38ce-4633-8473-edf0adc7e48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:53.577854 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593c940e-38ce-4633-8473-edf0adc7e48e admin admin] PATH_INFO: `/v3/projects/e856f506304a4568b683191b3d1e95a1/users/75ffba3439a046269cdf7ba3298b5dd0/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:53.590354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:53.593259 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c940e-38ce-4633-8473-edf0adc7e48e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e856f506304a4568b683191b3d1e95a1, user_id=75ffba3439a046269cdf7ba3298b5dd0, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:53.595899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593c940e-38ce-4633-8473-edf0adc7e48e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:53.691948 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1308/2615] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:45:53 2022] PUT /identity/v3/projects/e856f506304a4568b683191b3d1e95a1/users/75ffba3439a046269cdf7ba3298b5dd0/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:45:53.702641 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e8679-759f-4ca2-993f-abf22733388b None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:53.702931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e8679-759f-4ca2-993f-abf22733388b None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:53.703204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e8679-759f-4ca2-993f-abf22733388b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:53.731374 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-7b2e8679-759f-4ca2-993f-abf22733388b None None] MFA Rules not processed for user `75ffba3439a046269cdf7ba3298b5dd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:53.732998 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-7b2e8679-759f-4ca2-993f-abf22733388b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:53.798049 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:53.801927 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1308/2616] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:53.806440 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c940e-38ce-4633-8473-edf0adc7e48e admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:53.870325 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593c940e-38ce-4633-8473-edf0adc7e48e admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:53.875475 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb063c-3d2b-4971-8e8b-8620601c7da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:53.876132 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb063c-3d2b-4971-8e8b-8620601c7da0 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:53.876419 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb063c-3d2b-4971-8e8b-8620601c7da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:53.876698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb063c-3d2b-4971-8e8b-8620601c7da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:53.877488 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb063c-3d2b-4971-8e8b-8620601c7da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:53.879428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb063c-3d2b-4971-8e8b-8620601c7da0 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:53.981395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1309/2617] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:45:53 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:45:53.985615 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e8679-759f-4ca2-993f-abf22733388b None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:53.997076 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e8679-759f-4ca2-993f-abf22733388b None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:54.070423 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d623d78-272a-4efc-b5a1-5296d26c7127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:54.071108 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d623d78-272a-4efc-b5a1-5296d26c7127 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:54.071399 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d623d78-272a-4efc-b5a1-5296d26c7127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:54.071668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d623d78-272a-4efc-b5a1-5296d26c7127 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:54.072368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d623d78-272a-4efc-b5a1-5296d26c7127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:54.074417 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d623d78-272a-4efc-b5a1-5296d26c7127 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:54.144310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1309/2618] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:45:53 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:45:54.148970 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb063c-3d2b-4971-8e8b-8620601c7da0 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:54.159561 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb063c-3d2b-4971-8e8b-8620601c7da0 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:54.165049 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db85815-8459-43b6-baf2-41444d276101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:54.165672 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db85815-8459-43b6-baf2-41444d276101 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:54.165957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db85815-8459-43b6-baf2-41444d276101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:54.166232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db85815-8459-43b6-baf2-41444d276101 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:54.167102 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db85815-8459-43b6-baf2-41444d276101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:54.168720 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db85815-8459-43b6-baf2-41444d276101 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:54.186243 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1310/2619] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:45:54.186533 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d623d78-272a-4efc-b5a1-5296d26c7127 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:54.197611 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d623d78-272a-4efc-b5a1-5296d26c7127 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:54.202289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e994e-9051-444c-9418-baec6d297064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:54.203170 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e994e-9051-444c-9418-baec6d297064 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:54.203449 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e994e-9051-444c-9418-baec6d297064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:54.203746 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e994e-9051-444c-9418-baec6d297064 admin admin] PATH_INFO: `/v3/projects/a51ceef8cd1348cf81c6ed7e68b2dfcf/users/103444111d4c45b0a400e225d21043f2/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:54.219765 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e994e-9051-444c-9418-baec6d297064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a51ceef8cd1348cf81c6ed7e68b2dfcf, user_id=103444111d4c45b0a400e225d21043f2, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:54.222568 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e994e-9051-444c-9418-baec6d297064 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:54.271854 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1310/2620] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:45:54 2022] PUT /identity/v3/projects/a51ceef8cd1348cf81c6ed7e68b2dfcf/users/103444111d4c45b0a400e225d21043f2/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:54.275784 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db85815-8459-43b6-baf2-41444d276101 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:54.286301 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db85815-8459-43b6-baf2-41444d276101 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:54.342556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b50920-d86c-4d28-b5eb-37a1506acb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:54.343222 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b50920-d86c-4d28-b5eb-37a1506acb93 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:54.343506 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b50920-d86c-4d28-b5eb-37a1506acb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:54.343784 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b50920-d86c-4d28-b5eb-37a1506acb93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:54.344539 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b50920-d86c-4d28-b5eb-37a1506acb93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:54.346173 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b50920-d86c-4d28-b5eb-37a1506acb93 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:54.359939 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1311/2621] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:45:54.362503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e994e-9051-444c-9418-baec6d297064 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:54.373658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e994e-9051-444c-9418-baec6d297064 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:54.381560 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52849b33-e75b-4f51-a47c-4bb7baf0fd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:54.382578 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52849b33-e75b-4f51-a47c-4bb7baf0fd39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:54.382863 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52849b33-e75b-4f51-a47c-4bb7baf0fd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:54.383143 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52849b33-e75b-4f51-a47c-4bb7baf0fd39 admin admin] PATH_INFO: `/v3/projects/a51ceef8cd1348cf81c6ed7e68b2dfcf/users/103444111d4c45b0a400e225d21043f2/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:54.385179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52849b33-e75b-4f51-a47c-4bb7baf0fd39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a51ceef8cd1348cf81c6ed7e68b2dfcf, user_id=103444111d4c45b0a400e225d21043f2, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:54.387951 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52849b33-e75b-4f51-a47c-4bb7baf0fd39 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:54.399068 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1311/2622] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:45:54 2022] PUT /identity/v3/projects/a51ceef8cd1348cf81c6ed7e68b2dfcf/users/103444111d4c45b0a400e225d21043f2/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:45:54.466377 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecf2f7-04b8-49d5-b1bc-85260745f520 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:54.466670 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecf2f7-04b8-49d5-b1bc-85260745f520 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:54.466955 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecf2f7-04b8-49d5-b1bc-85260745f520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:54.494730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-f9ecf2f7-04b8-49d5-b1bc-85260745f520 None None] MFA Rules not processed for user `103444111d4c45b0a400e225d21043f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:54.496285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f9ecf2f7-04b8-49d5-b1bc-85260745f520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:54.548998 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:54.570323 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1312/2623] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:54.582757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52849b33-e75b-4f51-a47c-4bb7baf0fd39 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:54.584459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-52849b33-e75b-4f51-a47c-4bb7baf0fd39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:54.643939 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52849b33-e75b-4f51-a47c-4bb7baf0fd39 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:54.648221 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc53cf-6348-41df-b9cd-f8195094887e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:54.648865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc53cf-6348-41df-b9cd-f8195094887e service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:54.649198 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc53cf-6348-41df-b9cd-f8195094887e service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:54.649453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc53cf-6348-41df-b9cd-f8195094887e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:54.706243 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc53cf-6348-41df-b9cd-f8195094887e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:54.707697 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc53cf-6348-41df-b9cd-f8195094887e service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:54.717538 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1312/2624] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:45:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:45:56.316667 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecf2f7-04b8-49d5-b1bc-85260745f520 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:56.316667 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f9ecf2f7-04b8-49d5-b1bc-85260745f520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:56.376585 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecf2f7-04b8-49d5-b1bc-85260745f520 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:56.380438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a8542-3365-4a7c-b904-d7acc791d0d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:56.385574 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a8542-3365-4a7c-b904-d7acc791d0d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:56.385574 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a8542-3365-4a7c-b904-d7acc791d0d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:56.385574 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a8542-3365-4a7c-b904-d7acc791d0d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:56.385574 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e01a8542-3365-4a7c-b904-d7acc791d0d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:56.457770 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a8542-3365-4a7c-b904-d7acc791d0d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:56.460123 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a8542-3365-4a7c-b904-d7acc791d0d0 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:56.471474 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1313/2625] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:45:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:45:56.632082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc53cf-6348-41df-b9cd-f8195094887e service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:56.632082 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc53cf-6348-41df-b9cd-f8195094887e service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:56.635195 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f27f0-011d-4312-a925-e1b5f3ad883c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:56.635842 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f27f0-011d-4312-a925-e1b5f3ad883c service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:56.636129 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f27f0-011d-4312-a925-e1b5f3ad883c service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:56.636406 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f27f0-011d-4312-a925-e1b5f3ad883c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:56.640751 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:45:56.705984 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f27f0-011d-4312-a925-e1b5f3ad883c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:56.707897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f27f0-011d-4312-a925-e1b5f3ad883c service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:56.719754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1313/2626] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:45:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:45:58.330960 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a8542-3365-4a7c-b904-d7acc791d0d0 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:58.346702 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a8542-3365-4a7c-b904-d7acc791d0d0 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:58.354697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803570e-be56-4142-952a-efb07e3035df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:58.355363 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803570e-be56-4142-952a-efb07e3035df service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:58.355708 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803570e-be56-4142-952a-efb07e3035df service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:58.355989 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803570e-be56-4142-952a-efb07e3035df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:58.379664 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803570e-be56-4142-952a-efb07e3035df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:58.382185 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e803570e-be56-4142-952a-efb07e3035df service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:58.413310 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1314/2627] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:45:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:45:59.028308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f27f0-011d-4312-a925-e1b5f3ad883c service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:59.029744 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f49f27f0-011d-4312-a925-e1b5f3ad883c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:59.045492 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f27f0-011d-4312-a925-e1b5f3ad883c service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:59.050474 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b05396-3737-4579-b7a8-121b2d33fe94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:59.051627 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b05396-3737-4579-b7a8-121b2d33fe94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:59.052131 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b05396-3737-4579-b7a8-121b2d33fe94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:59.052421 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b05396-3737-4579-b7a8-121b2d33fe94 admin admin] PATH_INFO: `/v3/users/8a61307830a54ea38c6c0681f5bbd0de` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:59.053758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b05396-3737-4579-b7a8-121b2d33fe94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a61307830a54ea38c6c0681f5bbd0de)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:59.056305 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b05396-3737-4579-b7a8-121b2d33fe94 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:59.272912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-e9b05396-3737-4579-b7a8-121b2d33fe94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a61307830a54ea38c6c0681f5bbd0de'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:59.298437 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-e9b05396-3737-4579-b7a8-121b2d33fe94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a61307830a54ea38c6c0681f5bbd0de'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:59.314904 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-e9b05396-3737-4579-b7a8-121b2d33fe94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a61307830a54ea38c6c0681f5bbd0de'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:59.315688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-e9b05396-3737-4579-b7a8-121b2d33fe94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a61307830a54ea38c6c0681f5bbd0de'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:59.316312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-e9b05396-3737-4579-b7a8-121b2d33fe94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a61307830a54ea38c6c0681f5bbd0de'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:45:59.422336 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1314/2628] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:45:59 2022] DELETE /identity/v3/users/8a61307830a54ea38c6c0681f5bbd0de => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:45:59.427049 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67b62d-9e81-4ce5-8f7c-d9a0f995a643 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:59.427623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67b62d-9e81-4ce5-8f7c-d9a0f995a643 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:59.427623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67b62d-9e81-4ce5-8f7c-d9a0f995a643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:59.446445 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-dd67b62d-9e81-4ce5-8f7c-d9a0f995a643 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:45:59.448007 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-dd67b62d-9e81-4ce5-8f7c-d9a0f995a643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:59.521502 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1315/2629] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:45:59.532359 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b05396-3737-4579-b7a8-121b2d33fe94 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:45:59.533944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e9b05396-3737-4579-b7a8-121b2d33fe94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:45:59.615419 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b05396-3737-4579-b7a8-121b2d33fe94 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:45:59.632523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc6a38-eb94-4999-a6b2-49325b7a0624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:45:59.634468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc6a38-eb94-4999-a6b2-49325b7a0624 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:45:59.635010 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc6a38-eb94-4999-a6b2-49325b7a0624 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:45:59.635759 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc6a38-eb94-4999-a6b2-49325b7a0624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:45:59.648346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc6a38-eb94-4999-a6b2-49325b7a0624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:45:59.650758 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc6a38-eb94-4999-a6b2-49325b7a0624 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:45:59.673617 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1315/2630] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:46:00.146491 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67b62d-9e81-4ce5-8f7c-d9a0f995a643 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:00.150681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-dd67b62d-9e81-4ce5-8f7c-d9a0f995a643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:00.171983 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67b62d-9e81-4ce5-8f7c-d9a0f995a643 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:00.176920 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11faa12b-aad8-4773-81d1-eb0339f38fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:00.177840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faa12b-aad8-4773-81d1-eb0339f38fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:00.178122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faa12b-aad8-4773-81d1-eb0339f38fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:00.178399 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11faa12b-aad8-4773-81d1-eb0339f38fb9 admin admin] PATH_INFO: `/v3/projects/6c0e54622cd24293b6f43882c6a88f2f` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:00.179576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11faa12b-aad8-4773-81d1-eb0339f38fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c0e54622cd24293b6f43882c6a88f2f)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:00.182024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11faa12b-aad8-4773-81d1-eb0339f38fb9 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:00.206695 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:00.210057 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc6a38-eb94-4999-a6b2-49325b7a0624 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:00.211702 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-8edc6a38-eb94-4999-a6b2-49325b7a0624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:00.226145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc6a38-eb94-4999-a6b2-49325b7a0624 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:00.241300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f87b4-9412-434a-8851-83e65fcc85c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:00.242233 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f87b4-9412-434a-8851-83e65fcc85c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:00.242523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f87b4-9412-434a-8851-83e65fcc85c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:00.242862 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f87b4-9412-434a-8851-83e65fcc85c6 admin admin] PATH_INFO: `/v3/users/b9ee38a03587412c93da307525e83851` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:00.244731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f87b4-9412-434a-8851-83e65fcc85c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9ee38a03587412c93da307525e83851)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:00.246759 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f87b4-9412-434a-8851-83e65fcc85c6 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:00.262987 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:00.283648 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-11faa12b-aad8-4773-81d1-eb0339f38fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c0e54622cd24293b6f43882c6a88f2f', 'request_id': 'req-11faa12b-aad8-4773-81d1-eb0339f38fb9'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:00.291099 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-11faa12b-aad8-4773-81d1-eb0339f38fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c0e54622cd24293b6f43882c6a88f2f', 'request_id': 'req-11faa12b-aad8-4773-81d1-eb0339f38fb9'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:00.393352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-11faa12b-aad8-4773-81d1-eb0339f38fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c0e54622cd24293b6f43882c6a88f2f', 'request_id': 'req-11faa12b-aad8-4773-81d1-eb0339f38fb9'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:00.405645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-11faa12b-aad8-4773-81d1-eb0339f38fb9 admin admin] The token cache is being invalidate because project 6c0e54622cd24293b6f43882c6a88f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:00.405936 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-11faa12b-aad8-4773-81d1-eb0339f38fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:00.406580 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-11faa12b-aad8-4773-81d1-eb0339f38fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:00.408153 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1316/2631] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:00 2022] DELETE /identity/v3/projects/6c0e54622cd24293b6f43882c6a88f2f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:00.411902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11faa12b-aad8-4773-81d1-eb0339f38fb9 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:00.413198 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-11faa12b-aad8-4773-81d1-eb0339f38fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:00.476739 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11faa12b-aad8-4773-81d1-eb0339f38fb9 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:00.482013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3401dbd-a0e5-4c67-8e6f-7a9589013f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:00.484753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3401dbd-a0e5-4c67-8e6f-7a9589013f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:00.485282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3401dbd-a0e5-4c67-8e6f-7a9589013f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:00.491090 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3401dbd-a0e5-4c67-8e6f-7a9589013f3f admin admin] PATH_INFO: `/v3/users/6528a5a5547e4fa4834c133989131fc0` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:00.491090 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3401dbd-a0e5-4c67-8e6f-7a9589013f3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6528a5a5547e4fa4834c133989131fc0)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:00.491090 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3401dbd-a0e5-4c67-8e6f-7a9589013f3f admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:00.498927 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-792f87b4-9412-434a-8851-83e65fcc85c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9ee38a03587412c93da307525e83851'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:00.512129 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-792f87b4-9412-434a-8851-83e65fcc85c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9ee38a03587412c93da307525e83851'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:00.518998 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-792f87b4-9412-434a-8851-83e65fcc85c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9ee38a03587412c93da307525e83851'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:00.519705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-792f87b4-9412-434a-8851-83e65fcc85c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9ee38a03587412c93da307525e83851'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:00.520310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-792f87b4-9412-434a-8851-83e65fcc85c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9ee38a03587412c93da307525e83851'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:00.610223 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1316/2632] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:00 2022] DELETE /identity/v3/users/b9ee38a03587412c93da307525e83851 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:00.699434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a3401dbd-a0e5-4c67-8e6f-7a9589013f3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6528a5a5547e4fa4834c133989131fc0'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:00.712721 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a3401dbd-a0e5-4c67-8e6f-7a9589013f3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6528a5a5547e4fa4834c133989131fc0'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:00.721474 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a3401dbd-a0e5-4c67-8e6f-7a9589013f3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6528a5a5547e4fa4834c133989131fc0'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:00.722306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a3401dbd-a0e5-4c67-8e6f-7a9589013f3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6528a5a5547e4fa4834c133989131fc0'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:00.723000 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a3401dbd-a0e5-4c67-8e6f-7a9589013f3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6528a5a5547e4fa4834c133989131fc0'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:00.812482 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1317/2633] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:00 2022] DELETE /identity/v3/users/6528a5a5547e4fa4834c133989131fc0 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:00.954137 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f87b4-9412-434a-8851-83e65fcc85c6 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:00.955808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-792f87b4-9412-434a-8851-83e65fcc85c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:01.025699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f87b4-9412-434a-8851-83e65fcc85c6 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:01.088358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7566e-63a4-4988-87e8-2d869f0d0c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:01.089546 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7566e-63a4-4988-87e8-2d869f0d0c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:01.089848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7566e-63a4-4988-87e8-2d869f0d0c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:01.090131 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a7566e-63a4-4988-87e8-2d869f0d0c47 admin admin] PATH_INFO: `/v3/projects/66075e773eca4ba4b72d7265e941fde6` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:01.091348 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7566e-63a4-4988-87e8-2d869f0d0c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66075e773eca4ba4b72d7265e941fde6)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:01.093259 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a7566e-63a4-4988-87e8-2d869f0d0c47 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:01.208971 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:01.215504 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-d0a7566e-63a4-4988-87e8-2d869f0d0c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66075e773eca4ba4b72d7265e941fde6', 'request_id': 'req-d0a7566e-63a4-4988-87e8-2d869f0d0c47'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:01.221747 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-d0a7566e-63a4-4988-87e8-2d869f0d0c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66075e773eca4ba4b72d7265e941fde6', 'request_id': 'req-d0a7566e-63a4-4988-87e8-2d869f0d0c47'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:01.234486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-d0a7566e-63a4-4988-87e8-2d869f0d0c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66075e773eca4ba4b72d7265e941fde6', 'request_id': 'req-d0a7566e-63a4-4988-87e8-2d869f0d0c47'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:01.330804 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-d0a7566e-63a4-4988-87e8-2d869f0d0c47 admin admin] The token cache is being invalidate because project 66075e773eca4ba4b72d7265e941fde6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:01.330804 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-d0a7566e-63a4-4988-87e8-2d869f0d0c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:01.330804 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-d0a7566e-63a4-4988-87e8-2d869f0d0c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:01.330804 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1317/2634] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:00 2022] DELETE /identity/v3/projects/66075e773eca4ba4b72d7265e941fde6 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:01.331374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d5d02-c42c-47bb-aecc-91d921156293 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:01.331374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d5d02-c42c-47bb-aecc-91d921156293 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:01.331374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d5d02-c42c-47bb-aecc-91d921156293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:01.347131 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-735d5d02-c42c-47bb-aecc-91d921156293 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:01.348195 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-735d5d02-c42c-47bb-aecc-91d921156293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:01.369866 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:01.386215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7566e-63a4-4988-87e8-2d869f0d0c47 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:01.387760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-d0a7566e-63a4-4988-87e8-2d869f0d0c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:01.416856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1318/2635] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:01.422999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7407bd-22b1-4aae-92ad-37088d5ec156 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:01.423379 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7407bd-22b1-4aae-92ad-37088d5ec156 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:01.423666 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7407bd-22b1-4aae-92ad-37088d5ec156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:01.442303 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-cc7407bd-22b1-4aae-92ad-37088d5ec156 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:01.445395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-cc7407bd-22b1-4aae-92ad-37088d5ec156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:01.451857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1319/2636] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:01.456006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a7566e-63a4-4988-87e8-2d869f0d0c47 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:01.457565 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7407bd-22b1-4aae-92ad-37088d5ec156 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:01.460979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e3d96-ba10-4f4b-8c3c-f42410e48e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:01.462430 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e3d96-ba10-4f4b-8c3c-f42410e48e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:01.462717 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e3d96-ba10-4f4b-8c3c-f42410e48e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:01.463000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e3d96-ba10-4f4b-8c3c-f42410e48e42 admin admin] PATH_INFO: `/v3/projects/1bf0e8c0c9bc4945af1911b8940d777d` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:01.464329 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e3d96-ba10-4f4b-8c3c-f42410e48e42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bf0e8c0c9bc4945af1911b8940d777d)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:01.466403 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e3d96-ba10-4f4b-8c3c-f42410e48e42 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:01.470857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7407bd-22b1-4aae-92ad-37088d5ec156 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:01.476816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540326a5-ec98-4af9-be4d-377fd01d1da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:01.485427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540326a5-ec98-4af9-be4d-377fd01d1da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:01.485427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540326a5-ec98-4af9-be4d-377fd01d1da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:01.485427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540326a5-ec98-4af9-be4d-377fd01d1da7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:01.485427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540326a5-ec98-4af9-be4d-377fd01d1da7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:46:01.485427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540326a5-ec98-4af9-be4d-377fd01d1da7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:01.485427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540326a5-ec98-4af9-be4d-377fd01d1da7 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:01.494188 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1320/2637] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:46:01.498371 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540326a5-ec98-4af9-be4d-377fd01d1da7 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:01.508130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540326a5-ec98-4af9-be4d-377fd01d1da7 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:01.514508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ba72b-fd84-4af9-b030-6ef4e885f42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:01.514508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ba72b-fd84-4af9-b030-6ef4e885f42b admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:01.514508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ba72b-fd84-4af9-b030-6ef4e885f42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:01.514508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ba72b-fd84-4af9-b030-6ef4e885f42b admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:01.514865 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ba72b-fd84-4af9-b030-6ef4e885f42b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:01.516961 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ba72b-fd84-4af9-b030-6ef4e885f42b admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:01.576479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-bd5e3d96-ba10-4f4b-8c3c-f42410e48e42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bf0e8c0c9bc4945af1911b8940d777d', 'request_id': 'req-bd5e3d96-ba10-4f4b-8c3c-f42410e48e42'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:01.582774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-bd5e3d96-ba10-4f4b-8c3c-f42410e48e42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bf0e8c0c9bc4945af1911b8940d777d', 'request_id': 'req-bd5e3d96-ba10-4f4b-8c3c-f42410e48e42'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:01.588733 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-bd5e3d96-ba10-4f4b-8c3c-f42410e48e42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bf0e8c0c9bc4945af1911b8940d777d', 'request_id': 'req-bd5e3d96-ba10-4f4b-8c3c-f42410e48e42'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:01.648124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1321/2638] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:46:01 2022] POST /identity/v3/projects => generated 367 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:46:01.652588 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ba72b-fd84-4af9-b030-6ef4e885f42b admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:01.676253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-bd5e3d96-ba10-4f4b-8c3c-f42410e48e42 admin admin] The token cache is being invalidate because project 1bf0e8c0c9bc4945af1911b8940d777d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:01.677732 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-bd5e3d96-ba10-4f4b-8c3c-f42410e48e42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:01.677732 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-bd5e3d96-ba10-4f4b-8c3c-f42410e48e42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:01.679912 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1318/2639] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:01 2022] DELETE /identity/v3/projects/1bf0e8c0c9bc4945af1911b8940d777d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:01.684898 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022968de-5f3a-4cd8-96dd-863ae899b964 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:01.685267 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022968de-5f3a-4cd8-96dd-863ae899b964 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:01.685722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022968de-5f3a-4cd8-96dd-863ae899b964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:01.707495 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-022968de-5f3a-4cd8-96dd-863ae899b964 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:01.708650 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-022968de-5f3a-4cd8-96dd-863ae899b964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:01.728448 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ba72b-fd84-4af9-b030-6ef4e885f42b admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:01.744856 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df251e7-0292-4eff-b62a-76e229aa1067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:01.745821 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df251e7-0292-4eff-b62a-76e229aa1067 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:01.746522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df251e7-0292-4eff-b62a-76e229aa1067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:01.746954 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df251e7-0292-4eff-b62a-76e229aa1067 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:01.747819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df251e7-0292-4eff-b62a-76e229aa1067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:01.755231 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df251e7-0292-4eff-b62a-76e229aa1067 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:01.781344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1319/2640] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:01.789063 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829dc16-7626-4c14-a155-a022c45482a6 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:01.789358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829dc16-7626-4c14-a155-a022c45482a6 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:01.790327 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829dc16-7626-4c14-a155-a022c45482a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:01.808653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-5829dc16-7626-4c14-a155-a022c45482a6 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:01.810006 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5829dc16-7626-4c14-a155-a022c45482a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:01.817989 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1320/2641] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:01.822138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829dc16-7626-4c14-a155-a022c45482a6 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:01.831000 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829dc16-7626-4c14-a155-a022c45482a6 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:01.835738 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d71eac-e921-405a-a331-a8594d8c9588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:01.836375 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d71eac-e921-405a-a331-a8594d8c9588 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:01.836686 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d71eac-e921-405a-a331-a8594d8c9588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:01.836958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d71eac-e921-405a-a331-a8594d8c9588 admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:01.837709 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d71eac-e921-405a-a331-a8594d8c9588 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:46:01.838015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d71eac-e921-405a-a331-a8594d8c9588 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:01.839697 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d71eac-e921-405a-a331-a8594d8c9588 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:01.851415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1321/2642] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:46:01.856049 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d71eac-e921-405a-a331-a8594d8c9588 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:01.864215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1322/2643] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:46:01 2022] POST /identity/v3/users => generated 284 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:46:01.865964 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d71eac-e921-405a-a331-a8594d8c9588 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:01.868697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df251e7-0292-4eff-b62a-76e229aa1067 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:01.870545 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-8df251e7-0292-4eff-b62a-76e229aa1067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:01.871392 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b323b64-f152-44eb-927d-9210259bc37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:01.872024 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b323b64-f152-44eb-927d-9210259bc37f admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:01.872303 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b323b64-f152-44eb-927d-9210259bc37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:01.872574 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b323b64-f152-44eb-927d-9210259bc37f admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:01.873244 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b323b64-f152-44eb-927d-9210259bc37f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:01.875156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b323b64-f152-44eb-927d-9210259bc37f admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:01.882569 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df251e7-0292-4eff-b62a-76e229aa1067 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:01.887210 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3f918-9269-47fd-b8e7-1a7764c739fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:01.887914 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3f918-9269-47fd-b8e7-1a7764c739fe admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:01.888205 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3f918-9269-47fd-b8e7-1a7764c739fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:01.888484 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3f918-9269-47fd-b8e7-1a7764c739fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:01.889234 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3f918-9269-47fd-b8e7-1a7764c739fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:01.890982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3f918-9269-47fd-b8e7-1a7764c739fe admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:01.901896 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1323/2644] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:46:01.905750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3f918-9269-47fd-b8e7-1a7764c739fe admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:01.915723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3f918-9269-47fd-b8e7-1a7764c739fe admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:01.920381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2707922-6434-455a-93e0-21e8ad734ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:01.921721 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2707922-6434-455a-93e0-21e8ad734ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:01.922008 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2707922-6434-455a-93e0-21e8ad734ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:01.922286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2707922-6434-455a-93e0-21e8ad734ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:01.923005 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2707922-6434-455a-93e0-21e8ad734ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:01.924647 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2707922-6434-455a-93e0-21e8ad734ec7 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:01.936468 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1324/2645] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:46:01.943723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2707922-6434-455a-93e0-21e8ad734ec7 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:01.950138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2707922-6434-455a-93e0-21e8ad734ec7 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:01.955030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40dc8d-ea18-42dd-b73e-bf4e45423b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:01.955997 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40dc8d-ea18-42dd-b73e-bf4e45423b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:01.956273 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40dc8d-ea18-42dd-b73e-bf4e45423b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:01.956547 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40dc8d-ea18-42dd-b73e-bf4e45423b6e admin admin] PATH_INFO: `/v3/projects/21dcea2104214f5d99818c2e9318af66/users/99bce8e7add7469cb09e1ac7e60d8579/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:01.962714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:01.973076 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1322/2646] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:46:01 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:46:01.973259 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40dc8d-ea18-42dd-b73e-bf4e45423b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=21dcea2104214f5d99818c2e9318af66, user_id=99bce8e7add7469cb09e1ac7e60d8579, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:01.974209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b323b64-f152-44eb-927d-9210259bc37f admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:01.975987 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40dc8d-ea18-42dd-b73e-bf4e45423b6e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:02.045692 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b323b64-f152-44eb-927d-9210259bc37f admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:02.045692 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09692f-4d40-48e3-90c4-d9b27298b5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:02.045692 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09692f-4d40-48e3-90c4-d9b27298b5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:02.045692 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09692f-4d40-48e3-90c4-d9b27298b5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:02.046084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09692f-4d40-48e3-90c4-d9b27298b5f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:02.046084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09692f-4d40-48e3-90c4-d9b27298b5f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:02.047110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc09692f-4d40-48e3-90c4-d9b27298b5f0 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:02.075008 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1325/2647] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:01 2022] PUT /identity/v3/projects/21dcea2104214f5d99818c2e9318af66/users/99bce8e7add7469cb09e1ac7e60d8579/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:02.085972 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc473639-651e-4301-8612-68605f83b047 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:02.086265 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc473639-651e-4301-8612-68605f83b047 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:02.087109 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc473639-651e-4301-8612-68605f83b047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:02.114485 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-cc473639-651e-4301-8612-68605f83b047 None None] MFA Rules not processed for user `99bce8e7add7469cb09e1ac7e60d8579`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:02.115692 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-cc473639-651e-4301-8612-68605f83b047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:02.132332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:02.152654 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1323/2648] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:46:01 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:46:02.153828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09692f-4d40-48e3-90c4-d9b27298b5f0 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:02.165680 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc09692f-4d40-48e3-90c4-d9b27298b5f0 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:02.183416 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1326/2649] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:02.194440 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc473639-651e-4301-8612-68605f83b047 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:02.196039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-cc473639-651e-4301-8612-68605f83b047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:02.222169 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0907b0d-8935-42ed-817c-6f6dd62c6b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:02.222757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0907b0d-8935-42ed-817c-6f6dd62c6b77 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:02.223041 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0907b0d-8935-42ed-817c-6f6dd62c6b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:02.223315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0907b0d-8935-42ed-817c-6f6dd62c6b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:02.224033 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0907b0d-8935-42ed-817c-6f6dd62c6b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:02.225649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0907b0d-8935-42ed-817c-6f6dd62c6b77 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:02.236483 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1324/2650] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:02.240468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0907b0d-8935-42ed-817c-6f6dd62c6b77 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:02.249933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0907b0d-8935-42ed-817c-6f6dd62c6b77 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:02.253626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc473639-651e-4301-8612-68605f83b047 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:02.256023 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d633d-d296-4fa1-9990-da7f7ec6472e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:02.256889 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d633d-d296-4fa1-9990-da7f7ec6472e admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:02.257178 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d633d-d296-4fa1-9990-da7f7ec6472e admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:02.257514 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d633d-d296-4fa1-9990-da7f7ec6472e admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:02.258026 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce37813-e45f-4989-ac0c-dfe46fb09146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:02.258490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d633d-d296-4fa1-9990-da7f7ec6472e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:02.258698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce37813-e45f-4989-ac0c-dfe46fb09146 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:02.259012 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce37813-e45f-4989-ac0c-dfe46fb09146 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:02.259283 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce37813-e45f-4989-ac0c-dfe46fb09146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:02.260202 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d633d-d296-4fa1-9990-da7f7ec6472e admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:02.268204 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce37813-e45f-4989-ac0c-dfe46fb09146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:02.269678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce37813-e45f-4989-ac0c-dfe46fb09146 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:02.270640 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1325/2651] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:46:02.275946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d633d-d296-4fa1-9990-da7f7ec6472e admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:02.280291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1327/2652] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:46:02.286015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d633d-d296-4fa1-9990-da7f7ec6472e admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:02.291583 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4709b1-4bbc-4ecb-ac9e-25a4df8af877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:02.292451 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4709b1-4bbc-4ecb-ac9e-25a4df8af877 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:02.292736 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4709b1-4bbc-4ecb-ac9e-25a4df8af877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:02.293493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4709b1-4bbc-4ecb-ac9e-25a4df8af877 admin admin] PATH_INFO: `/v3/projects/550797b5d5694a21a93d6aab8638d182/users/9f860dbc8a4b42f6bcba77208db4085b/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:02.308774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4709b1-4bbc-4ecb-ac9e-25a4df8af877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=550797b5d5694a21a93d6aab8638d182, user_id=9f860dbc8a4b42f6bcba77208db4085b, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:02.311512 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4709b1-4bbc-4ecb-ac9e-25a4df8af877 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:02.374895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1326/2653] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:02 2022] PUT /identity/v3/projects/550797b5d5694a21a93d6aab8638d182/users/9f860dbc8a4b42f6bcba77208db4085b/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:02.386450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799607a-23f0-453d-847b-d18eb793bd66 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:02.386738 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799607a-23f0-453d-847b-d18eb793bd66 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:02.387020 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7799607a-23f0-453d-847b-d18eb793bd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:02.416698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-7799607a-23f0-453d-847b-d18eb793bd66 None None] MFA Rules not processed for user `9f860dbc8a4b42f6bcba77208db4085b`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:02.418834 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7799607a-23f0-453d-847b-d18eb793bd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:02.487314 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1328/2654] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:02.491757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4709b1-4bbc-4ecb-ac9e-25a4df8af877 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:02.502101 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:02.556511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4709b1-4bbc-4ecb-ac9e-25a4df8af877 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:02.561493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda1232-0a61-40a7-ba9e-259840e87957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:02.562178 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda1232-0a61-40a7-ba9e-259840e87957 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:02.562464 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda1232-0a61-40a7-ba9e-259840e87957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:02.562742 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda1232-0a61-40a7-ba9e-259840e87957 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:02.563431 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda1232-0a61-40a7-ba9e-259840e87957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:02.565442 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda1232-0a61-40a7-ba9e-259840e87957 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:02.671522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1327/2655] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:46:02 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:46:02.675456 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799607a-23f0-453d-847b-d18eb793bd66 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:02.686180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7799607a-23f0-453d-847b-d18eb793bd66 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:02.733533 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:02.755401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d587b3-d6ad-466b-b851-e9118bbdd55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:02.755401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d587b3-d6ad-466b-b851-e9118bbdd55b admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:02.755401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d587b3-d6ad-466b-b851-e9118bbdd55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:02.755401 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d587b3-d6ad-466b-b851-e9118bbdd55b admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:02.756163 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d587b3-d6ad-466b-b851-e9118bbdd55b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:02.756163 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d587b3-d6ad-466b-b851-e9118bbdd55b admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:02.895910 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1329/2656] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:46:02 2022] POST /identity/v3/users => generated 299 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:46:02.900064 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda1232-0a61-40a7-ba9e-259840e87957 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:02.910227 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda1232-0a61-40a7-ba9e-259840e87957 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:02.914688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733dc6c-d8bf-4712-bbb4-9cba0d1986cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:02.915349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733dc6c-d8bf-4712-bbb4-9cba0d1986cd admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:02.915633 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733dc6c-d8bf-4712-bbb4-9cba0d1986cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:02.915904 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733dc6c-d8bf-4712-bbb4-9cba0d1986cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:02.916637 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733dc6c-d8bf-4712-bbb4-9cba0d1986cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:02.918258 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733dc6c-d8bf-4712-bbb4-9cba0d1986cd admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:02.932321 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1328/2657] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:02.933442 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d587b3-d6ad-466b-b851-e9118bbdd55b admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:02.944711 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d587b3-d6ad-466b-b851-e9118bbdd55b admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:02.950306 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb1883-68a5-4da3-a56b-2ff49f1d4fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:02.951188 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb1883-68a5-4da3-a56b-2ff49f1d4fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:02.951476 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb1883-68a5-4da3-a56b-2ff49f1d4fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:02.951757 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb1883-68a5-4da3-a56b-2ff49f1d4fb0 admin admin] PATH_INFO: `/v3/projects/7e765784c2994d8a81fb412184a3eba2/users/94ef05c43d9043268c0ef4a35b839c66/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:02.966735 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb1883-68a5-4da3-a56b-2ff49f1d4fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e765784c2994d8a81fb412184a3eba2, user_id=94ef05c43d9043268c0ef4a35b839c66, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:02.969441 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb1883-68a5-4da3-a56b-2ff49f1d4fb0 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:03.114861 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1330/2658] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:02 2022] PUT /identity/v3/projects/7e765784c2994d8a81fb412184a3eba2/users/94ef05c43d9043268c0ef4a35b839c66/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:03.123968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733dc6c-d8bf-4712-bbb4-9cba0d1986cd admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:03.124821 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb1883-68a5-4da3-a56b-2ff49f1d4fb0 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:03.126686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-43fb1883-68a5-4da3-a56b-2ff49f1d4fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:03.130288 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733dc6c-d8bf-4712-bbb4-9cba0d1986cd admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:03.196748 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a1dab-cb49-47ba-94f7-c94cef64d8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:03.197624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a1dab-cb49-47ba-94f7-c94cef64d8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:03.202364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a1dab-cb49-47ba-94f7-c94cef64d8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:03.202364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a1dab-cb49-47ba-94f7-c94cef64d8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:03.202364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a1dab-cb49-47ba-94f7-c94cef64d8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:03.202364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812a1dab-cb49-47ba-94f7-c94cef64d8a8 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:03.211367 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1329/2659] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:03.215602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a1dab-cb49-47ba-94f7-c94cef64d8a8 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:03.220099 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb1883-68a5-4da3-a56b-2ff49f1d4fb0 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:03.224911 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4a90c-f662-4e4a-9bdb-29d41db8699a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:03.225474 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812a1dab-cb49-47ba-94f7-c94cef64d8a8 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:03.225955 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4a90c-f662-4e4a-9bdb-29d41db8699a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:03.226092 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4a90c-f662-4e4a-9bdb-29d41db8699a admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:03.226369 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4a90c-f662-4e4a-9bdb-29d41db8699a admin admin] PATH_INFO: `/v3/users/b4904577d29147d8b4d495c6d4cc0d12` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:03.228097 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4a90c-f662-4e4a-9bdb-29d41db8699a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4904577d29147d8b4d495c6d4cc0d12)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:03.230047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4a90c-f662-4e4a-9bdb-29d41db8699a admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:03.230834 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb17f6f-9ecc-4c75-8d9c-e9808fea3b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:03.231702 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb17f6f-9ecc-4c75-8d9c-e9808fea3b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:03.231985 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb17f6f-9ecc-4c75-8d9c-e9808fea3b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:03.232268 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb17f6f-9ecc-4c75-8d9c-e9808fea3b20 admin admin] PATH_INFO: `/v3/projects/7e765784c2994d8a81fb412184a3eba2/users/94ef05c43d9043268c0ef4a35b839c66/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:03.234576 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb17f6f-9ecc-4c75-8d9c-e9808fea3b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e765784c2994d8a81fb412184a3eba2, user_id=94ef05c43d9043268c0ef4a35b839c66, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:03.237346 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb17f6f-9ecc-4c75-8d9c-e9808fea3b20 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:03.249820 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1330/2660] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:03 2022] PUT /identity/v3/projects/7e765784c2994d8a81fb412184a3eba2/users/94ef05c43d9043268c0ef4a35b839c66/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:03.260164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89a987-29e7-489a-a436-6dd66dc98734 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:03.260479 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89a987-29e7-489a-a436-6dd66dc98734 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:03.260761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89a987-29e7-489a-a436-6dd66dc98734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:03.288011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-1d89a987-29e7-489a-a436-6dd66dc98734 None None] MFA Rules not processed for user `94ef05c43d9043268c0ef4a35b839c66`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:03.289237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-1d89a987-29e7-489a-a436-6dd66dc98734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:03.339201 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:03.356656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1331/2661] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:03.368811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89a987-29e7-489a-a436-6dd66dc98734 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:03.427207 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89a987-29e7-489a-a436-6dd66dc98734 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:03.431939 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db4e33-7225-4e24-a992-977684d51f82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:03.432679 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db4e33-7225-4e24-a992-977684d51f82 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:03.432965 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db4e33-7225-4e24-a992-977684d51f82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:03.433249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db4e33-7225-4e24-a992-977684d51f82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:03.442724 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db4e33-7225-4e24-a992-977684d51f82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:03.444175 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db4e33-7225-4e24-a992-977684d51f82 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:03.453674 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1332/2662] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:46:03.471877 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6fe4a90c-f662-4e4a-9bdb-29d41db8699a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4904577d29147d8b4d495c6d4cc0d12'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:03.483487 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db4e33-7225-4e24-a992-977684d51f82 service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:03.486586 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6fe4a90c-f662-4e4a-9bdb-29d41db8699a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4904577d29147d8b4d495c6d4cc0d12'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:03.494493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6fe4a90c-f662-4e4a-9bdb-29d41db8699a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4904577d29147d8b4d495c6d4cc0d12'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:03.495209 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6fe4a90c-f662-4e4a-9bdb-29d41db8699a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4904577d29147d8b4d495c6d4cc0d12'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:03.495854 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6fe4a90c-f662-4e4a-9bdb-29d41db8699a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4904577d29147d8b4d495c6d4cc0d12'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:03.545066 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db4e33-7225-4e24-a992-977684d51f82 service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:03.549828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62acadc2-d67a-4d0f-81bf-3909bb70f7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:03.550681 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acadc2-d67a-4d0f-81bf-3909bb70f7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:03.550960 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acadc2-d67a-4d0f-81bf-3909bb70f7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:03.551232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acadc2-d67a-4d0f-81bf-3909bb70f7bd admin admin] PATH_INFO: `/v3/users/9f860dbc8a4b42f6bcba77208db4085b` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:03.552409 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62acadc2-d67a-4d0f-81bf-3909bb70f7bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f860dbc8a4b42f6bcba77208db4085b)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:03.554388 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62acadc2-d67a-4d0f-81bf-3909bb70f7bd admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:03.561055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1331/2663] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:03 2022] DELETE /identity/v3/users/b4904577d29147d8b4d495c6d4cc0d12 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:03.565510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f109e7a-6496-4fe5-a6da-5634350454f3 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:03.566279 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f109e7a-6496-4fe5-a6da-5634350454f3 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:03.566571 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f109e7a-6496-4fe5-a6da-5634350454f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:03.583256 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-7f109e7a-6496-4fe5-a6da-5634350454f3 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:03.584476 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7f109e7a-6496-4fe5-a6da-5634350454f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:03.615533 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:03.646004 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1332/2664] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:03.658388 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f109e7a-6496-4fe5-a6da-5634350454f3 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:03.659791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7f109e7a-6496-4fe5-a6da-5634350454f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:03.715778 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-62acadc2-d67a-4d0f-81bf-3909bb70f7bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f860dbc8a4b42f6bcba77208db4085b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:03.718685 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f109e7a-6496-4fe5-a6da-5634350454f3 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:03.722383 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedf2ed-6b0a-4755-985e-f55925bb4123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:03.723087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedf2ed-6b0a-4755-985e-f55925bb4123 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:03.723369 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedf2ed-6b0a-4755-985e-f55925bb4123 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:03.727886 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedf2ed-6b0a-4755-985e-f55925bb4123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:03.728722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-62acadc2-d67a-4d0f-81bf-3909bb70f7bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f860dbc8a4b42f6bcba77208db4085b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:03.734194 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdedf2ed-6b0a-4755-985e-f55925bb4123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:03.735695 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdedf2ed-6b0a-4755-985e-f55925bb4123 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:03.735819 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-62acadc2-d67a-4d0f-81bf-3909bb70f7bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f860dbc8a4b42f6bcba77208db4085b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:03.736403 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-62acadc2-d67a-4d0f-81bf-3909bb70f7bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f860dbc8a4b42f6bcba77208db4085b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:03.737026 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-62acadc2-d67a-4d0f-81bf-3909bb70f7bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f860dbc8a4b42f6bcba77208db4085b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:03.746038 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1333/2665] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:46:03.881821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1333/2666] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:03 2022] DELETE /identity/v3/users/9f860dbc8a4b42f6bcba77208db4085b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:03.886509 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304eb7a-1b83-4a65-91c1-2448e4183dbd None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:03.886804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304eb7a-1b83-4a65-91c1-2448e4183dbd None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:03.887086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304eb7a-1b83-4a65-91c1-2448e4183dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:03.905186 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-9304eb7a-1b83-4a65-91c1-2448e4183dbd None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:03.906418 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9304eb7a-1b83-4a65-91c1-2448e4183dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:03.967396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1334/2667] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:03.977408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62acadc2-d67a-4d0f-81bf-3909bb70f7bd admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:03.979532 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-62acadc2-d67a-4d0f-81bf-3909bb70f7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:03.994949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:04.039067 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62acadc2-d67a-4d0f-81bf-3909bb70f7bd admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:04.042941 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12c3d7-8d23-4b6b-85cf-46db29ea1539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:04.043667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12c3d7-8d23-4b6b-85cf-46db29ea1539 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:04.043952 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12c3d7-8d23-4b6b-85cf-46db29ea1539 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:04.044391 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12c3d7-8d23-4b6b-85cf-46db29ea1539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:04.053909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12c3d7-8d23-4b6b-85cf-46db29ea1539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:04.055363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12c3d7-8d23-4b6b-85cf-46db29ea1539 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:04.065649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1334/2668] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:46:04.161027 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304eb7a-1b83-4a65-91c1-2448e4183dbd None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:04.163374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9304eb7a-1b83-4a65-91c1-2448e4183dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:04.206027 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9304eb7a-1b83-4a65-91c1-2448e4183dbd None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:04.212466 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48325b2-51d0-4c1a-8336-515a2800112e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:04.213466 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48325b2-51d0-4c1a-8336-515a2800112e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:04.213973 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48325b2-51d0-4c1a-8336-515a2800112e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:04.214430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48325b2-51d0-4c1a-8336-515a2800112e admin admin] PATH_INFO: `/v3/projects/e177128192634d729c3a251015100279` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:04.215928 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48325b2-51d0-4c1a-8336-515a2800112e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e177128192634d729c3a251015100279)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:04.219513 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48325b2-51d0-4c1a-8336-515a2800112e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:04.339361 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a48325b2-51d0-4c1a-8336-515a2800112e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e177128192634d729c3a251015100279', 'request_id': 'req-a48325b2-51d0-4c1a-8336-515a2800112e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:04.345046 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a48325b2-51d0-4c1a-8336-515a2800112e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e177128192634d729c3a251015100279', 'request_id': 'req-a48325b2-51d0-4c1a-8336-515a2800112e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:04.421368 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a48325b2-51d0-4c1a-8336-515a2800112e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e177128192634d729c3a251015100279', 'request_id': 'req-a48325b2-51d0-4c1a-8336-515a2800112e'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:04.433605 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a48325b2-51d0-4c1a-8336-515a2800112e admin admin] The token cache is being invalidate because project e177128192634d729c3a251015100279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:04.433897 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a48325b2-51d0-4c1a-8336-515a2800112e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:04.434541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-a48325b2-51d0-4c1a-8336-515a2800112e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:04.436094 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1335/2669] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:04 2022] DELETE /identity/v3/projects/e177128192634d729c3a251015100279 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:04.440204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12c3d7-8d23-4b6b-85cf-46db29ea1539 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:04.452705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12c3d7-8d23-4b6b-85cf-46db29ea1539 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:04.509310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a4330-f9b8-4136-af06-ff0aa542350e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:04.510204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a4330-f9b8-4136-af06-ff0aa542350e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:04.510514 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a4330-f9b8-4136-af06-ff0aa542350e admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:04.510786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a4330-f9b8-4136-af06-ff0aa542350e admin admin] PATH_INFO: `/v3/users/75ffba3439a046269cdf7ba3298b5dd0` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:04.511943 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a4330-f9b8-4136-af06-ff0aa542350e admin admin] RBAC: Authorizing `identity:delete_user(user_id=75ffba3439a046269cdf7ba3298b5dd0)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:04.513869 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a4330-f9b8-4136-af06-ff0aa542350e admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:04.591271 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48325b2-51d0-4c1a-8336-515a2800112e admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:04.591271 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a48325b2-51d0-4c1a-8336-515a2800112e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:04.599737 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:04.620703 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48325b2-51d0-4c1a-8336-515a2800112e admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:04.623029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c9379-e291-4c4c-91ab-f357e913d242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:04.623879 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c9379-e291-4c4c-91ab-f357e913d242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:04.624157 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c9379-e291-4c4c-91ab-f357e913d242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:04.624428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c9379-e291-4c4c-91ab-f357e913d242 admin admin] PATH_INFO: `/v3/projects/550797b5d5694a21a93d6aab8638d182` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:04.625655 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c9379-e291-4c4c-91ab-f357e913d242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=550797b5d5694a21a93d6aab8638d182)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:04.627566 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c9379-e291-4c4c-91ab-f357e913d242 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:04.907400 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2a1a4330-f9b8-4136-af06-ff0aa542350e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75ffba3439a046269cdf7ba3298b5dd0'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:04.907578 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-266c9379-e291-4c4c-91ab-f357e913d242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '550797b5d5694a21a93d6aab8638d182', 'request_id': 'req-266c9379-e291-4c4c-91ab-f357e913d242'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:04.919606 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-266c9379-e291-4c4c-91ab-f357e913d242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '550797b5d5694a21a93d6aab8638d182', 'request_id': 'req-266c9379-e291-4c4c-91ab-f357e913d242'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:04.926826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2a1a4330-f9b8-4136-af06-ff0aa542350e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75ffba3439a046269cdf7ba3298b5dd0'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:04.939476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2a1a4330-f9b8-4136-af06-ff0aa542350e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75ffba3439a046269cdf7ba3298b5dd0'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:04.940409 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2a1a4330-f9b8-4136-af06-ff0aa542350e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75ffba3439a046269cdf7ba3298b5dd0'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:04.941131 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-2a1a4330-f9b8-4136-af06-ff0aa542350e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75ffba3439a046269cdf7ba3298b5dd0'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:05.029348 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-266c9379-e291-4c4c-91ab-f357e913d242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '550797b5d5694a21a93d6aab8638d182', 'request_id': 'req-266c9379-e291-4c4c-91ab-f357e913d242'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:05.041999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-266c9379-e291-4c4c-91ab-f357e913d242 admin admin] The token cache is being invalidate because project 550797b5d5694a21a93d6aab8638d182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:05.042301 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-266c9379-e291-4c4c-91ab-f357e913d242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:05.043109 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-266c9379-e291-4c4c-91ab-f357e913d242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:05.044700 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1336/2670] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:04 2022] DELETE /identity/v3/projects/550797b5d5694a21a93d6aab8638d182 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:05.049694 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c9379-e291-4c4c-91ab-f357e913d242 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:05.052000 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-266c9379-e291-4c4c-91ab-f357e913d242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:05.116300 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c9379-e291-4c4c-91ab-f357e913d242 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:05.121141 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a59b0-358c-4984-b058-75fae9c994dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:05.122030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a59b0-358c-4984-b058-75fae9c994dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:05.122311 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a59b0-358c-4984-b058-75fae9c994dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:05.122581 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a59b0-358c-4984-b058-75fae9c994dc admin admin] PATH_INFO: `/v3/users/94ef05c43d9043268c0ef4a35b839c66` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:05.123787 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a59b0-358c-4984-b058-75fae9c994dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ef05c43d9043268c0ef4a35b839c66)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:05.125729 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a59b0-358c-4984-b058-75fae9c994dc admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:05.141380 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1335/2671] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:04 2022] DELETE /identity/v3/users/75ffba3439a046269cdf7ba3298b5dd0 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:05.315428 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4a1a59b0-358c-4984-b058-75fae9c994dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ef05c43d9043268c0ef4a35b839c66'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:05.328046 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4a1a59b0-358c-4984-b058-75fae9c994dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ef05c43d9043268c0ef4a35b839c66'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:05.334964 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4a1a59b0-358c-4984-b058-75fae9c994dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ef05c43d9043268c0ef4a35b839c66'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:05.335698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4a1a59b0-358c-4984-b058-75fae9c994dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ef05c43d9043268c0ef4a35b839c66'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:05.336855 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4a1a59b0-358c-4984-b058-75fae9c994dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ef05c43d9043268c0ef4a35b839c66'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:05.447133 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1337/2672] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:05 2022] DELETE /identity/v3/users/94ef05c43d9043268c0ef4a35b839c66 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:05.573199 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a4330-f9b8-4136-af06-ff0aa542350e admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:05.574705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2a1a4330-f9b8-4136-af06-ff0aa542350e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:05.620457 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:05.645725 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a4330-f9b8-4136-af06-ff0aa542350e admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:05.700951 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18019bad-c576-4d1d-9015-5ee5b6428641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:05.701859 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18019bad-c576-4d1d-9015-5ee5b6428641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:05.702168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18019bad-c576-4d1d-9015-5ee5b6428641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:05.702447 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18019bad-c576-4d1d-9015-5ee5b6428641 admin admin] PATH_INFO: `/v3/projects/e856f506304a4568b683191b3d1e95a1` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:05.703617 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18019bad-c576-4d1d-9015-5ee5b6428641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e856f506304a4568b683191b3d1e95a1)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:05.705578 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18019bad-c576-4d1d-9015-5ee5b6428641 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:05.842252 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-18019bad-c576-4d1d-9015-5ee5b6428641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e856f506304a4568b683191b3d1e95a1', 'request_id': 'req-18019bad-c576-4d1d-9015-5ee5b6428641'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:05.849908 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-18019bad-c576-4d1d-9015-5ee5b6428641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e856f506304a4568b683191b3d1e95a1', 'request_id': 'req-18019bad-c576-4d1d-9015-5ee5b6428641'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:05.856442 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-18019bad-c576-4d1d-9015-5ee5b6428641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e856f506304a4568b683191b3d1e95a1', 'request_id': 'req-18019bad-c576-4d1d-9015-5ee5b6428641'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:05.955304 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a59b0-358c-4984-b058-75fae9c994dc admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:05.956553 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-18019bad-c576-4d1d-9015-5ee5b6428641 admin admin] The token cache is being invalidate because project e856f506304a4568b683191b3d1e95a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:05.956923 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-18019bad-c576-4d1d-9015-5ee5b6428641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:05.957167 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-4a1a59b0-358c-4984-b058-75fae9c994dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:05.957722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-18019bad-c576-4d1d-9015-5ee5b6428641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:05.959623 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1336/2673] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:05 2022] DELETE /identity/v3/projects/e856f506304a4568b683191b3d1e95a1 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:05.963119 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18019bad-c576-4d1d-9015-5ee5b6428641 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:05.970248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-18019bad-c576-4d1d-9015-5ee5b6428641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:06.006322 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:06.011259 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a59b0-358c-4984-b058-75fae9c994dc admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:06.062849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18019bad-c576-4d1d-9015-5ee5b6428641 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:06.068022 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eaac81-e20a-4a34-9ad6-979a75aaff93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:06.068917 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eaac81-e20a-4a34-9ad6-979a75aaff93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:06.069349 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eaac81-e20a-4a34-9ad6-979a75aaff93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:06.069722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eaac81-e20a-4a34-9ad6-979a75aaff93 admin admin] PATH_INFO: `/v3/users/103444111d4c45b0a400e225d21043f2` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:06.071831 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eaac81-e20a-4a34-9ad6-979a75aaff93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=103444111d4c45b0a400e225d21043f2)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:06.073459 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eaac81-e20a-4a34-9ad6-979a75aaff93 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:06.105955 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a64df-5b4f-4f0a-b7a6-a07d2a321321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:06.107543 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a64df-5b4f-4f0a-b7a6-a07d2a321321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:06.108271 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a64df-5b4f-4f0a-b7a6-a07d2a321321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:06.108773 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a64df-5b4f-4f0a-b7a6-a07d2a321321 admin admin] PATH_INFO: `/v3/projects/7e765784c2994d8a81fb412184a3eba2` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:06.109210 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:06.111232 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a64df-5b4f-4f0a-b7a6-a07d2a321321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e765784c2994d8a81fb412184a3eba2)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:06.114646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a64df-5b4f-4f0a-b7a6-a07d2a321321 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:06.327631 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-61eaac81-e20a-4a34-9ad6-979a75aaff93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '103444111d4c45b0a400e225d21043f2'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:06.328277 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ca2a64df-5b4f-4f0a-b7a6-a07d2a321321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e765784c2994d8a81fb412184a3eba2', 'request_id': 'req-ca2a64df-5b4f-4f0a-b7a6-a07d2a321321'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:06.338210 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ca2a64df-5b4f-4f0a-b7a6-a07d2a321321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e765784c2994d8a81fb412184a3eba2', 'request_id': 'req-ca2a64df-5b4f-4f0a-b7a6-a07d2a321321'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:06.344905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-61eaac81-e20a-4a34-9ad6-979a75aaff93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '103444111d4c45b0a400e225d21043f2'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:06.347698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-61eaac81-e20a-4a34-9ad6-979a75aaff93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '103444111d4c45b0a400e225d21043f2'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:06.348960 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-61eaac81-e20a-4a34-9ad6-979a75aaff93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '103444111d4c45b0a400e225d21043f2'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:06.349607 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-61eaac81-e20a-4a34-9ad6-979a75aaff93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '103444111d4c45b0a400e225d21043f2'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:06.450154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ca2a64df-5b4f-4f0a-b7a6-a07d2a321321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e765784c2994d8a81fb412184a3eba2', 'request_id': 'req-ca2a64df-5b4f-4f0a-b7a6-a07d2a321321'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:06.463013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ca2a64df-5b4f-4f0a-b7a6-a07d2a321321 admin admin] The token cache is being invalidate because project 7e765784c2994d8a81fb412184a3eba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:06.463311 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ca2a64df-5b4f-4f0a-b7a6-a07d2a321321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:06.464061 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ca2a64df-5b4f-4f0a-b7a6-a07d2a321321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:06.465977 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1338/2674] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:05 2022] DELETE /identity/v3/projects/7e765784c2994d8a81fb412184a3eba2 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:06.471901 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7120d4-9895-4c7e-b2bf-34e5b20ed752 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:06.472187 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7120d4-9895-4c7e-b2bf-34e5b20ed752 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:06.472468 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7120d4-9895-4c7e-b2bf-34e5b20ed752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:06.491289 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-3b7120d4-9895-4c7e-b2bf-34e5b20ed752 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:06.492499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-3b7120d4-9895-4c7e-b2bf-34e5b20ed752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:06.535700 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1337/2675] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:05 2022] DELETE /identity/v3/users/103444111d4c45b0a400e225d21043f2 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:06.558026 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1339/2676] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:06.566148 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a0dfd-0604-4721-9685-1458fbe9e7b4 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:06.573097 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a0dfd-0604-4721-9685-1458fbe9e7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:06.573097 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a0dfd-0604-4721-9685-1458fbe9e7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:06.587115 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-9a2a0dfd-0604-4721-9685-1458fbe9e7b4 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:06.588258 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-9a2a0dfd-0604-4721-9685-1458fbe9e7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:06.665734 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7120d4-9895-4c7e-b2bf-34e5b20ed752 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:06.675215 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1338/2677] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:06.675924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7120d4-9895-4c7e-b2bf-34e5b20ed752 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:06.680705 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620f701-1ce4-478e-9547-d7b7ca50858d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:06.681363 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620f701-1ce4-478e-9547-d7b7ca50858d admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:06.681815 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620f701-1ce4-478e-9547-d7b7ca50858d admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:06.681951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8620f701-1ce4-478e-9547-d7b7ca50858d admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:06.682687 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620f701-1ce4-478e-9547-d7b7ca50858d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:46:06.682969 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620f701-1ce4-478e-9547-d7b7ca50858d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:06.684558 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8620f701-1ce4-478e-9547-d7b7ca50858d admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:06.696525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1340/2678] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:46:06.700856 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a0dfd-0604-4721-9685-1458fbe9e7b4 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:06.712333 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a0dfd-0604-4721-9685-1458fbe9e7b4 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:06.719740 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f4a28-9675-4e40-b8fb-9799d0cb8680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:06.719740 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f4a28-9675-4e40-b8fb-9799d0cb8680 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:06.719740 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f4a28-9675-4e40-b8fb-9799d0cb8680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:06.719740 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f4a28-9675-4e40-b8fb-9799d0cb8680 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:06.720135 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f4a28-9675-4e40-b8fb-9799d0cb8680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:06.721736 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f4a28-9675-4e40-b8fb-9799d0cb8680 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:06.849701 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1339/2679] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:46:06 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:46:06.854781 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620f701-1ce4-478e-9547-d7b7ca50858d admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:06.866607 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8620f701-1ce4-478e-9547-d7b7ca50858d admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:06.890801 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:06.932632 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641c81d-54f0-43d4-a334-5aefc7b5cd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:06.933308 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641c81d-54f0-43d4-a334-5aefc7b5cd63 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:06.933766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641c81d-54f0-43d4-a334-5aefc7b5cd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:06.934077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641c81d-54f0-43d4-a334-5aefc7b5cd63 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:06.934783 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641c81d-54f0-43d4-a334-5aefc7b5cd63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:06.936719 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641c81d-54f0-43d4-a334-5aefc7b5cd63 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:07.013598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1341/2680] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:46:06 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:46:07.014498 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f4a28-9675-4e40-b8fb-9799d0cb8680 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:07.016690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f72f4a28-9675-4e40-b8fb-9799d0cb8680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:07.017596 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641c81d-54f0-43d4-a334-5aefc7b5cd63 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:07.028461 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641c81d-54f0-43d4-a334-5aefc7b5cd63 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:07.033427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b4d6a-2169-4eab-8ee6-c2f058600f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:07.035693 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b4d6a-2169-4eab-8ee6-c2f058600f8d admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:07.035693 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b4d6a-2169-4eab-8ee6-c2f058600f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:07.035693 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b4d6a-2169-4eab-8ee6-c2f058600f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:07.035693 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b4d6a-2169-4eab-8ee6-c2f058600f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:07.037456 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b4d6a-2169-4eab-8ee6-c2f058600f8d admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:07.043203 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f4a28-9675-4e40-b8fb-9799d0cb8680 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:07.052122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1342/2681] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:07.052399 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4926dbe8-e8e9-4a6f-9c42-a77940c2a200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:07.052399 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926dbe8-e8e9-4a6f-9c42-a77940c2a200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:07.052399 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926dbe8-e8e9-4a6f-9c42-a77940c2a200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:07.052399 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4926dbe8-e8e9-4a6f-9c42-a77940c2a200 admin admin] PATH_INFO: `/v3/projects/a51ceef8cd1348cf81c6ed7e68b2dfcf` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:07.053150 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b4d6a-2169-4eab-8ee6-c2f058600f8d admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:07.053961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926dbe8-e8e9-4a6f-9c42-a77940c2a200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a51ceef8cd1348cf81c6ed7e68b2dfcf)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:07.056093 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4926dbe8-e8e9-4a6f-9c42-a77940c2a200 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:07.062840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b4d6a-2169-4eab-8ee6-c2f058600f8d admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:07.067754 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869e45c-b135-43a8-b7dd-12544167d630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:07.068432 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869e45c-b135-43a8-b7dd-12544167d630 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:07.068718 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869e45c-b135-43a8-b7dd-12544167d630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:07.068996 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d869e45c-b135-43a8-b7dd-12544167d630 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:07.069744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869e45c-b135-43a8-b7dd-12544167d630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:07.071890 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d869e45c-b135-43a8-b7dd-12544167d630 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:07.082056 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1343/2682] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:46:07.086355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869e45c-b135-43a8-b7dd-12544167d630 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:07.096599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d869e45c-b135-43a8-b7dd-12544167d630 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:07.106910 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889c93c-ced6-4ad9-980f-6fa6f114044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:07.108333 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889c93c-ced6-4ad9-980f-6fa6f114044a admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:07.108715 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889c93c-ced6-4ad9-980f-6fa6f114044a admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:07.109083 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889c93c-ced6-4ad9-980f-6fa6f114044a admin admin] PATH_INFO: `/v3/projects/99e26c881ed94673b9e6cd00ad4b10d5/users/01b1b37e0f1d4589bbfbd37833153bf9/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:07.130199 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889c93c-ced6-4ad9-980f-6fa6f114044a admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e26c881ed94673b9e6cd00ad4b10d5, user_id=01b1b37e0f1d4589bbfbd37833153bf9, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:07.132802 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889c93c-ced6-4ad9-980f-6fa6f114044a admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:07.231507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1344/2683] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:07 2022] PUT /identity/v3/projects/99e26c881ed94673b9e6cd00ad4b10d5/users/01b1b37e0f1d4589bbfbd37833153bf9/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:07.240979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4926dbe8-e8e9-4a6f-9c42-a77940c2a200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a51ceef8cd1348cf81c6ed7e68b2dfcf', 'request_id': 'req-4926dbe8-e8e9-4a6f-9c42-a77940c2a200'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:07.243700 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2027174-36e4-4e87-bab2-78051131f643 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:07.243991 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2027174-36e4-4e87-bab2-78051131f643 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:07.244272 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2027174-36e4-4e87-bab2-78051131f643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:07.249148 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4926dbe8-e8e9-4a6f-9c42-a77940c2a200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a51ceef8cd1348cf81c6ed7e68b2dfcf', 'request_id': 'req-4926dbe8-e8e9-4a6f-9c42-a77940c2a200'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:07.255684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4926dbe8-e8e9-4a6f-9c42-a77940c2a200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a51ceef8cd1348cf81c6ed7e68b2dfcf', 'request_id': 'req-4926dbe8-e8e9-4a6f-9c42-a77940c2a200'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:07.258967 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:07.273153 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-a2027174-36e4-4e87-bab2-78051131f643 None None] MFA Rules not processed for user `01b1b37e0f1d4589bbfbd37833153bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:07.275036 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a2027174-36e4-4e87-bab2-78051131f643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:07.337597 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1345/2684] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:07.342179 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2027174-36e4-4e87-bab2-78051131f643 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:07.366073 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4926dbe8-e8e9-4a6f-9c42-a77940c2a200 admin admin] The token cache is being invalidate because project a51ceef8cd1348cf81c6ed7e68b2dfcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:07.366290 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4926dbe8-e8e9-4a6f-9c42-a77940c2a200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:07.366973 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4926dbe8-e8e9-4a6f-9c42-a77940c2a200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:07.369090 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1340/2685] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:07 2022] DELETE /identity/v3/projects/a51ceef8cd1348cf81c6ed7e68b2dfcf => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:07.374677 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37804d8b-4898-4ebb-ac90-e422a914e55c None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:07.374992 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37804d8b-4898-4ebb-ac90-e422a914e55c None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:07.375272 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37804d8b-4898-4ebb-ac90-e422a914e55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:07.395801 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-37804d8b-4898-4ebb-ac90-e422a914e55c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:07.397011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-37804d8b-4898-4ebb-ac90-e422a914e55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:07.412263 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2027174-36e4-4e87-bab2-78051131f643 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:07.416834 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481de961-70bb-44fc-976d-530a673e9e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:07.417491 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481de961-70bb-44fc-976d-530a673e9e01 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:07.417805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481de961-70bb-44fc-976d-530a673e9e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:07.418085 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481de961-70bb-44fc-976d-530a673e9e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:07.418776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481de961-70bb-44fc-976d-530a673e9e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:07.420712 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481de961-70bb-44fc-976d-530a673e9e01 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:07.455418 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1341/2686] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:07.463141 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058edf2b-f0be-46d2-92c6-ec16782fc0ec None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:07.463427 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058edf2b-f0be-46d2-92c6-ec16782fc0ec None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:07.463699 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058edf2b-f0be-46d2-92c6-ec16782fc0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:07.482005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-058edf2b-f0be-46d2-92c6-ec16782fc0ec None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:07.483466 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-058edf2b-f0be-46d2-92c6-ec16782fc0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:07.491594 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1342/2687] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:07.496138 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058edf2b-f0be-46d2-92c6-ec16782fc0ec None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:07.505288 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058edf2b-f0be-46d2-92c6-ec16782fc0ec None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:07.510686 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99abc4e-5eab-4e15-bc63-b15bae7be017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:07.511398 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99abc4e-5eab-4e15-bc63-b15bae7be017 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:07.511688 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99abc4e-5eab-4e15-bc63-b15bae7be017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:07.511961 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99abc4e-5eab-4e15-bc63-b15bae7be017 admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:07.512673 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99abc4e-5eab-4e15-bc63-b15bae7be017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:46:07.512976 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99abc4e-5eab-4e15-bc63-b15bae7be017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:07.514698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99abc4e-5eab-4e15-bc63-b15bae7be017 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:07.526204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1343/2688] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:46:07.530289 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99abc4e-5eab-4e15-bc63-b15bae7be017 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:07.539597 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99abc4e-5eab-4e15-bc63-b15bae7be017 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:07.544385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e47bc2-2114-4c1a-9664-86bf89ee0b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:07.544987 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e47bc2-2114-4c1a-9664-86bf89ee0b8d admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:07.545276 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e47bc2-2114-4c1a-9664-86bf89ee0b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:07.545581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e47bc2-2114-4c1a-9664-86bf89ee0b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:07.546251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e47bc2-2114-4c1a-9664-86bf89ee0b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:07.548139 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e47bc2-2114-4c1a-9664-86bf89ee0b8d admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:07.557837 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1346/2689] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:46:07 2022] POST /identity/v3/projects => generated 387 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:46:07.561657 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481de961-70bb-44fc-976d-530a673e9e01 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:07.563813 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-481de961-70bb-44fc-976d-530a673e9e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:07.627352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481de961-70bb-44fc-976d-530a673e9e01 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:07.632142 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9cdad-2846-40d8-80b0-576c40498694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:07.632800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9cdad-2846-40d8-80b0-576c40498694 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:07.633081 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9cdad-2846-40d8-80b0-576c40498694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:07.633981 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9cdad-2846-40d8-80b0-576c40498694 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:07.634661 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9cdad-2846-40d8-80b0-576c40498694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:07.638819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9cdad-2846-40d8-80b0-576c40498694 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:07.664833 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1344/2690] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:46:07 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:46:07.669069 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e47bc2-2114-4c1a-9664-86bf89ee0b8d admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:07.724439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1347/2691] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:46:07 2022] POST /identity/v3/users => generated 300 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:46:07.729011 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9cdad-2846-40d8-80b0-576c40498694 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:07.733321 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e47bc2-2114-4c1a-9664-86bf89ee0b8d admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:07.738502 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb03415-f1c0-47a0-84f4-87371b7828aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:07.739182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb03415-f1c0-47a0-84f4-87371b7828aa admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:07.739744 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb03415-f1c0-47a0-84f4-87371b7828aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:07.741287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb03415-f1c0-47a0-84f4-87371b7828aa admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:07.741287 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb03415-f1c0-47a0-84f4-87371b7828aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:07.741492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9cdad-2846-40d8-80b0-576c40498694 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:07.743245 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb03415-f1c0-47a0-84f4-87371b7828aa admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:07.764133 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a0a70-4675-49e5-8e5d-869962bcb3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:07.765119 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a0a70-4675-49e5-8e5d-869962bcb3fd admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:07.765119 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a0a70-4675-49e5-8e5d-869962bcb3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:07.765412 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a0a70-4675-49e5-8e5d-869962bcb3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:07.766276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a0a70-4675-49e5-8e5d-869962bcb3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:07.768297 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a0a70-4675-49e5-8e5d-869962bcb3fd admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:07.781795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1348/2692] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:07.784060 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a0a70-4675-49e5-8e5d-869962bcb3fd admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:07.795979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a0a70-4675-49e5-8e5d-869962bcb3fd admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:07.801132 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec784769-4224-4d5b-b887-7b462e9debea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:07.802169 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec784769-4224-4d5b-b887-7b462e9debea admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:07.802539 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec784769-4224-4d5b-b887-7b462e9debea admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:07.802955 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec784769-4224-4d5b-b887-7b462e9debea admin admin] PATH_INFO: `/v3/projects/8fb20489706e44deb6d36a0a84f21a05/users/4b1ae19714464b6798fc2dd7133bc071/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:07.820928 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec784769-4224-4d5b-b887-7b462e9debea admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb20489706e44deb6d36a0a84f21a05, user_id=4b1ae19714464b6798fc2dd7133bc071, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:07.824101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec784769-4224-4d5b-b887-7b462e9debea admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:07.882714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1345/2693] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:46:07 2022] POST /identity/v3/users => generated 285 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:46:07.884233 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb03415-f1c0-47a0-84f4-87371b7828aa admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:07.894868 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb03415-f1c0-47a0-84f4-87371b7828aa admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:07.899538 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a98ff-3edb-4f20-a234-998bf669775c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:07.900205 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a98ff-3edb-4f20-a234-998bf669775c admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:07.900484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a98ff-3edb-4f20-a234-998bf669775c admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:07.900761 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a98ff-3edb-4f20-a234-998bf669775c admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:07.901494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a98ff-3edb-4f20-a234-998bf669775c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:07.903127 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a98ff-3edb-4f20-a234-998bf669775c admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:07.909650 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1349/2694] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:07 2022] PUT /identity/v3/projects/8fb20489706e44deb6d36a0a84f21a05/users/4b1ae19714464b6798fc2dd7133bc071/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:07.914012 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec784769-4224-4d5b-b887-7b462e9debea admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:07.919659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1346/2695] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:46:07.923619 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a98ff-3edb-4f20-a234-998bf669775c admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:07.935282 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a98ff-3edb-4f20-a234-998bf669775c admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:07.989310 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec784769-4224-4d5b-b887-7b462e9debea admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:07.995595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90000278-4fc4-4fc8-bccb-6cdf2a888971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:07.996338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90000278-4fc4-4fc8-bccb-6cdf2a888971 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:07.996690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90000278-4fc4-4fc8-bccb-6cdf2a888971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:07.997041 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90000278-4fc4-4fc8-bccb-6cdf2a888971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:07.997815 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90000278-4fc4-4fc8-bccb-6cdf2a888971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:07.999402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90000278-4fc4-4fc8-bccb-6cdf2a888971 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:08.010371 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1350/2696] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:46:08.014717 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90000278-4fc4-4fc8-bccb-6cdf2a888971 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:08.017199 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75601716-bdee-41b6-8f8e-526f322fe1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:08.017199 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75601716-bdee-41b6-8f8e-526f322fe1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:08.017199 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75601716-bdee-41b6-8f8e-526f322fe1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:08.017199 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75601716-bdee-41b6-8f8e-526f322fe1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:08.017651 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75601716-bdee-41b6-8f8e-526f322fe1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:08.019019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75601716-bdee-41b6-8f8e-526f322fe1d0 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:08.028087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90000278-4fc4-4fc8-bccb-6cdf2a888971 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:08.030585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1347/2697] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:46:08.038423 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75601716-bdee-41b6-8f8e-526f322fe1d0 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:08.038814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5920911-5fce-47e7-b6b8-02bfe8aa2766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:08.040599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5920911-5fce-47e7-b6b8-02bfe8aa2766 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:08.041662 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5920911-5fce-47e7-b6b8-02bfe8aa2766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:08.041662 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5920911-5fce-47e7-b6b8-02bfe8aa2766 admin admin] PATH_INFO: `/v3/projects/8fb20489706e44deb6d36a0a84f21a05/users/4b1ae19714464b6798fc2dd7133bc071/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:08.045299 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5920911-5fce-47e7-b6b8-02bfe8aa2766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fb20489706e44deb6d36a0a84f21a05, user_id=4b1ae19714464b6798fc2dd7133bc071, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:08.048907 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5920911-5fce-47e7-b6b8-02bfe8aa2766 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:08.049659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75601716-bdee-41b6-8f8e-526f322fe1d0 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:08.054584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bb400-8ba8-43ff-be72-5873404f7648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:08.056253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bb400-8ba8-43ff-be72-5873404f7648 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:08.056982 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bb400-8ba8-43ff-be72-5873404f7648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:08.058199 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bb400-8ba8-43ff-be72-5873404f7648 admin admin] PATH_INFO: `/v3/projects/de63d925d63e46c09956a61936d5ef0c/users/7b719d60ca904f43831da051a8da2577/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:08.073703 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1351/2698] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:08 2022] PUT /identity/v3/projects/8fb20489706e44deb6d36a0a84f21a05/users/4b1ae19714464b6798fc2dd7133bc071/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:08.075054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bb400-8ba8-43ff-be72-5873404f7648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de63d925d63e46c09956a61936d5ef0c, user_id=7b719d60ca904f43831da051a8da2577, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:08.078022 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bb400-8ba8-43ff-be72-5873404f7648 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:08.082897 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f5609-6eed-471e-a8e4-ffdeb2a5fb3f None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:08.083181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f5609-6eed-471e-a8e4-ffdeb2a5fb3f None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:08.083452 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f5609-6eed-471e-a8e4-ffdeb2a5fb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:08.111781 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-662f5609-6eed-471e-a8e4-ffdeb2a5fb3f None None] MFA Rules not processed for user `4b1ae19714464b6798fc2dd7133bc071`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:08.113100 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-662f5609-6eed-471e-a8e4-ffdeb2a5fb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:08.177503 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1348/2699] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:08 2022] PUT /identity/v3/projects/de63d925d63e46c09956a61936d5ef0c/users/7b719d60ca904f43831da051a8da2577/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:08.179896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71c7c-cef5-456e-a552-4be3f496adfe None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:08.180945 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71c7c-cef5-456e-a552-4be3f496adfe None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:08.181403 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb71c7c-cef5-456e-a552-4be3f496adfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:08.208221 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1352/2700] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:08.218037 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-bbb71c7c-cef5-456e-a552-4be3f496adfe None None] MFA Rules not processed for user `7b719d60ca904f43831da051a8da2577`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:08.219431 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-bbb71c7c-cef5-456e-a552-4be3f496adfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:08.220614 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f5609-6eed-471e-a8e4-ffdeb2a5fb3f None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:08.222456 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-662f5609-6eed-471e-a8e4-ffdeb2a5fb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:08.300667 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f5609-6eed-471e-a8e4-ffdeb2a5fb3f None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:08.328153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1349/2701] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:08.349181 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb71c7c-cef5-456e-a552-4be3f496adfe None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:08.351653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-bbb71c7c-cef5-456e-a552-4be3f496adfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:08.368629 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405c038-1cb3-4476-bcc2-202591c1e9e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:08.368629 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405c038-1cb3-4476-bcc2-202591c1e9e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:08.368629 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405c038-1cb3-4476-bcc2-202591c1e9e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:08.368629 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405c038-1cb3-4476-bcc2-202591c1e9e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:08.389454 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:08.438760 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb71c7c-cef5-456e-a552-4be3f496adfe None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:08.442605 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d8006f-4a9b-4be9-819f-f6af65a3ee9d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b27a4861d6b4ddfaca1a97efdaf008d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:08.443294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8006f-4a9b-4be9-819f-f6af65a3ee9d service glance] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:08.443529 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8006f-4a9b-4be9-819f-f6af65a3ee9d service glance] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:08.443938 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d8006f-4a9b-4be9-819f-f6af65a3ee9d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:08.453094 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8006f-4a9b-4be9-819f-f6af65a3ee9d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:08.454645 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d8006f-4a9b-4be9-819f-f6af65a3ee9d service glance] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:08.455367 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405c038-1cb3-4476-bcc2-202591c1e9e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:08.457103 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405c038-1cb3-4476-bcc2-202591c1e9e0 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:08.469710 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1353/2702] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:46:08.471557 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1350/2703] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:08 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:46:08.593474 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:08.769463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405c038-1cb3-4476-bcc2-202591c1e9e0 service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:08.847746 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405c038-1cb3-4476-bcc2-202591c1e9e0 service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:08.852648 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f450a-8087-4c6b-946b-5d9d20962dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:08.853738 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f450a-8087-4c6b-946b-5d9d20962dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:08.854022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f450a-8087-4c6b-946b-5d9d20962dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:08.854298 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f450a-8087-4c6b-946b-5d9d20962dd3 admin admin] PATH_INFO: `/v3/users/01b1b37e0f1d4589bbfbd37833153bf9` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:08.855652 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f450a-8087-4c6b-946b-5d9d20962dd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01b1b37e0f1d4589bbfbd37833153bf9)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:08.858023 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f450a-8087-4c6b-946b-5d9d20962dd3 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:09.015688 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:09.150356 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6e4f450a-8087-4c6b-946b-5d9d20962dd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01b1b37e0f1d4589bbfbd37833153bf9'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:09.162704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6e4f450a-8087-4c6b-946b-5d9d20962dd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01b1b37e0f1d4589bbfbd37833153bf9'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:09.169396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6e4f450a-8087-4c6b-946b-5d9d20962dd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01b1b37e0f1d4589bbfbd37833153bf9'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:09.170110 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6e4f450a-8087-4c6b-946b-5d9d20962dd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01b1b37e0f1d4589bbfbd37833153bf9'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:09.170753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-6e4f450a-8087-4c6b-946b-5d9d20962dd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01b1b37e0f1d4589bbfbd37833153bf9'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:09.234206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1354/2704] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:08 2022] DELETE /identity/v3/users/01b1b37e0f1d4589bbfbd37833153bf9 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:09.238907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaae1e-52c3-4200-a902-fd8a70be9760 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:09.239729 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaae1e-52c3-4200-a902-fd8a70be9760 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:09.240195 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfaae1e-52c3-4200-a902-fd8a70be9760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:09.260084 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-2cfaae1e-52c3-4200-a902-fd8a70be9760 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:09.261329 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2cfaae1e-52c3-4200-a902-fd8a70be9760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:09.335265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1351/2705] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:09.342007 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f450a-8087-4c6b-946b-5d9d20962dd3 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:09.343454 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-6e4f450a-8087-4c6b-946b-5d9d20962dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:09.420832 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f450a-8087-4c6b-946b-5d9d20962dd3 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:09.425710 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ba089-b7c5-43ae-90fe-1f7b634e19d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:09.426444 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ba089-b7c5-43ae-90fe-1f7b634e19d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:09.426938 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ba089-b7c5-43ae-90fe-1f7b634e19d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:09.427289 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ba089-b7c5-43ae-90fe-1f7b634e19d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:09.438756 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ba089-b7c5-43ae-90fe-1f7b634e19d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:09.440663 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ba089-b7c5-43ae-90fe-1f7b634e19d2 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:09.454607 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1355/2706] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:46:09.559124 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:09.641158 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=100 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:10.202873 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfaae1e-52c3-4200-a902-fd8a70be9760 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:10.204315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2cfaae1e-52c3-4200-a902-fd8a70be9760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:10.216659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfaae1e-52c3-4200-a902-fd8a70be9760 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:10.222076 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70d0c0-1bff-4679-87c1-e25bd2967aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:10.223103 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70d0c0-1bff-4679-87c1-e25bd2967aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:10.223226 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70d0c0-1bff-4679-87c1-e25bd2967aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:10.225321 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70d0c0-1bff-4679-87c1-e25bd2967aad admin admin] PATH_INFO: `/v3/projects/99e26c881ed94673b9e6cd00ad4b10d5` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:10.225321 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70d0c0-1bff-4679-87c1-e25bd2967aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=99e26c881ed94673b9e6cd00ad4b10d5)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:10.227399 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70d0c0-1bff-4679-87c1-e25bd2967aad admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:10.367161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6c70d0c0-1bff-4679-87c1-e25bd2967aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99e26c881ed94673b9e6cd00ad4b10d5', 'request_id': 'req-6c70d0c0-1bff-4679-87c1-e25bd2967aad'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:10.374951 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6c70d0c0-1bff-4679-87c1-e25bd2967aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99e26c881ed94673b9e6cd00ad4b10d5', 'request_id': 'req-6c70d0c0-1bff-4679-87c1-e25bd2967aad'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:10.399158 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6c70d0c0-1bff-4679-87c1-e25bd2967aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99e26c881ed94673b9e6cd00ad4b10d5', 'request_id': 'req-6c70d0c0-1bff-4679-87c1-e25bd2967aad'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:10.516245 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6c70d0c0-1bff-4679-87c1-e25bd2967aad admin admin] The token cache is being invalidate because project 99e26c881ed94673b9e6cd00ad4b10d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:10.516585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6c70d0c0-1bff-4679-87c1-e25bd2967aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:10.527270 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6c70d0c0-1bff-4679-87c1-e25bd2967aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:10.527270 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1352/2707] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:10 2022] DELETE /identity/v3/projects/99e26c881ed94673b9e6cd00ad4b10d5 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:10.527849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ba089-b7c5-43ae-90fe-1f7b634e19d2 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:10.534165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ba089-b7c5-43ae-90fe-1f7b634e19d2 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:10.587106 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:10.627126 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1220b-85df-4927-80bc-9815efaf42d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:10.628206 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1220b-85df-4927-80bc-9815efaf42d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:10.628550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1220b-85df-4927-80bc-9815efaf42d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:10.629126 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1220b-85df-4927-80bc-9815efaf42d6 admin admin] PATH_INFO: `/v3/users/4b1ae19714464b6798fc2dd7133bc071` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:10.630505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1220b-85df-4927-80bc-9815efaf42d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b1ae19714464b6798fc2dd7133bc071)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:10.632774 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1220b-85df-4927-80bc-9815efaf42d6 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:10.855116 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-1ac1220b-85df-4927-80bc-9815efaf42d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b1ae19714464b6798fc2dd7133bc071'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:10.867399 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-1ac1220b-85df-4927-80bc-9815efaf42d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b1ae19714464b6798fc2dd7133bc071'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:10.875051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-1ac1220b-85df-4927-80bc-9815efaf42d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b1ae19714464b6798fc2dd7133bc071'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:10.875795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-1ac1220b-85df-4927-80bc-9815efaf42d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b1ae19714464b6798fc2dd7133bc071'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:10.876409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-1ac1220b-85df-4927-80bc-9815efaf42d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b1ae19714464b6798fc2dd7133bc071'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:10.957121 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1356/2708] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:10 2022] DELETE /identity/v3/users/4b1ae19714464b6798fc2dd7133bc071 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:11.526675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70d0c0-1bff-4679-87c1-e25bd2967aad admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:11.529060 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-6c70d0c0-1bff-4679-87c1-e25bd2967aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:11.543649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70d0c0-1bff-4679-87c1-e25bd2967aad admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:11.643326 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9065e18-5fdf-44df-8802-c773d342f364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:11.644361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9065e18-5fdf-44df-8802-c773d342f364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:11.644652 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9065e18-5fdf-44df-8802-c773d342f364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:11.644937 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9065e18-5fdf-44df-8802-c773d342f364 admin admin] PATH_INFO: `/v3/projects/8fb20489706e44deb6d36a0a84f21a05` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:11.646269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9065e18-5fdf-44df-8802-c773d342f364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fb20489706e44deb6d36a0a84f21a05)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:11.651909 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9065e18-5fdf-44df-8802-c773d342f364 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:11.797307 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-b9065e18-5fdf-44df-8802-c773d342f364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fb20489706e44deb6d36a0a84f21a05', 'request_id': 'req-b9065e18-5fdf-44df-8802-c773d342f364'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:11.805357 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-b9065e18-5fdf-44df-8802-c773d342f364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fb20489706e44deb6d36a0a84f21a05', 'request_id': 'req-b9065e18-5fdf-44df-8802-c773d342f364'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:11.813189 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:11.814491 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-b9065e18-5fdf-44df-8802-c773d342f364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fb20489706e44deb6d36a0a84f21a05', 'request_id': 'req-b9065e18-5fdf-44df-8802-c773d342f364'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:11.897565 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-b9065e18-5fdf-44df-8802-c773d342f364 admin admin] The token cache is being invalidate because project 8fb20489706e44deb6d36a0a84f21a05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:11.898630 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-b9065e18-5fdf-44df-8802-c773d342f364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:11.899323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-b9065e18-5fdf-44df-8802-c773d342f364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:11.901183 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1353/2709] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:11 2022] DELETE /identity/v3/projects/8fb20489706e44deb6d36a0a84f21a05 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:11.906694 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abd4e6-a6aa-4769-9da2-ed12cb074c6a None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:11.907156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abd4e6-a6aa-4769-9da2-ed12cb074c6a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:11.907434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abd4e6-a6aa-4769-9da2-ed12cb074c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:11.925467 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-08abd4e6-a6aa-4769-9da2-ed12cb074c6a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:11.926935 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-08abd4e6-a6aa-4769-9da2-ed12cb074c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:12.001628 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1357/2710] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:12.013054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b0b49-bc1f-4aa7-a024-5c0c25fb888c None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:12.013393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b0b49-bc1f-4aa7-a024-5c0c25fb888c None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:12.013655 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b0b49-bc1f-4aa7-a024-5c0c25fb888c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:12.032161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-823b0b49-bc1f-4aa7-a024-5c0c25fb888c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:12.033383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-823b0b49-bc1f-4aa7-a024-5c0c25fb888c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:12.041607 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1354/2711] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:12.046133 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abd4e6-a6aa-4769-9da2-ed12cb074c6a None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:12.056635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abd4e6-a6aa-4769-9da2-ed12cb074c6a None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:12.061479 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c8e3f-6b33-45da-abdd-f47b0668ce58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:12.062175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c8e3f-6b33-45da-abdd-f47b0668ce58 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:12.062461 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c8e3f-6b33-45da-abdd-f47b0668ce58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:12.062739 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c8e3f-6b33-45da-abdd-f47b0668ce58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:12.063470 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c8e3f-6b33-45da-abdd-f47b0668ce58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:46:12.063781 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c8e3f-6b33-45da-abdd-f47b0668ce58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:12.065420 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c8e3f-6b33-45da-abdd-f47b0668ce58 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:12.078048 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1358/2712] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:46:12.082511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b0b49-bc1f-4aa7-a024-5c0c25fb888c None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:12.091843 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b0b49-bc1f-4aa7-a024-5c0c25fb888c None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:12.099063 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d2db0-e546-4541-b243-4af0abff9bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:12.100086 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d2db0-e546-4541-b243-4af0abff9bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:12.100369 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d2db0-e546-4541-b243-4af0abff9bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:12.100647 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d2db0-e546-4541-b243-4af0abff9bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:12.101362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d2db0-e546-4541-b243-4af0abff9bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:12.103357 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d2db0-e546-4541-b243-4af0abff9bf7 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:12.200981 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1355/2713] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:46:12 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:46:12.206058 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c8e3f-6b33-45da-abdd-f47b0668ce58 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:12.216121 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c8e3f-6b33-45da-abdd-f47b0668ce58 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:12.253239 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:12.275426 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cac8cc-9007-40e9-94d0-4485cde47ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:12.276089 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cac8cc-9007-40e9-94d0-4485cde47ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:12.276376 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cac8cc-9007-40e9-94d0-4485cde47ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:12.276678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cac8cc-9007-40e9-94d0-4485cde47ff6 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:12.277473 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cac8cc-9007-40e9-94d0-4485cde47ff6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:12.279395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cac8cc-9007-40e9-94d0-4485cde47ff6 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:12.389392 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1359/2714] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:46:12 2022] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:46:12.393673 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d2db0-e546-4541-b243-4af0abff9bf7 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:12.404090 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d2db0-e546-4541-b243-4af0abff9bf7 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:12.408767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceaff50-cc8c-4d67-9c8a-52a94bed36e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:12.409635 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceaff50-cc8c-4d67-9c8a-52a94bed36e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:12.410277 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceaff50-cc8c-4d67-9c8a-52a94bed36e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:12.410601 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceaff50-cc8c-4d67-9c8a-52a94bed36e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:12.411317 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceaff50-cc8c-4d67-9c8a-52a94bed36e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:12.413242 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceaff50-cc8c-4d67-9c8a-52a94bed36e7 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:12.434624 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1356/2715] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:46:12.436257 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cac8cc-9007-40e9-94d0-4485cde47ff6 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:12.446402 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cac8cc-9007-40e9-94d0-4485cde47ff6 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:12.451065 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559fe70-79ed-4960-827f-f9112a6722b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:12.451721 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559fe70-79ed-4960-827f-f9112a6722b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:12.452002 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559fe70-79ed-4960-827f-f9112a6722b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:12.452274 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559fe70-79ed-4960-827f-f9112a6722b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:12.453024 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559fe70-79ed-4960-827f-f9112a6722b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:12.454674 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559fe70-79ed-4960-827f-f9112a6722b6 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:12.465149 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1360/2716] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:12.469330 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceaff50-cc8c-4d67-9c8a-52a94bed36e7 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:12.481237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceaff50-cc8c-4d67-9c8a-52a94bed36e7 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:12.486781 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676f78e-e560-4e6e-8e84-23bde6ceb919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:12.488058 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676f78e-e560-4e6e-8e84-23bde6ceb919 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:12.488486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676f78e-e560-4e6e-8e84-23bde6ceb919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:12.488837 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676f78e-e560-4e6e-8e84-23bde6ceb919 admin admin] PATH_INFO: `/v3/projects/3020c73d79a54ad59b9b72f4eebc13c3/users/64d64e79850e447c9614c05a0d64deb8/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:12.510291 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676f78e-e560-4e6e-8e84-23bde6ceb919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3020c73d79a54ad59b9b72f4eebc13c3, user_id=64d64e79850e447c9614c05a0d64deb8, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:12.513005 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676f78e-e560-4e6e-8e84-23bde6ceb919 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:12.610908 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1357/2717] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:12 2022] PUT /identity/v3/projects/3020c73d79a54ad59b9b72f4eebc13c3/users/64d64e79850e447c9614c05a0d64deb8/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:12.621316 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c175e-cca4-45ec-a281-6f9bc9b8584f None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:12.621643 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c175e-cca4-45ec-a281-6f9bc9b8584f None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:12.621922 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689c175e-cca4-45ec-a281-6f9bc9b8584f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:12.647439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-689c175e-cca4-45ec-a281-6f9bc9b8584f None None] MFA Rules not processed for user `64d64e79850e447c9614c05a0d64deb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:12.648628 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-689c175e-cca4-45ec-a281-6f9bc9b8584f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:12.701069 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676f78e-e560-4e6e-8e84-23bde6ceb919 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:12.702808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-a676f78e-e560-4e6e-8e84-23bde6ceb919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:12.718934 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1361/2718] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:12.723349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c175e-cca4-45ec-a281-6f9bc9b8584f None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:12.784229 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676f78e-e560-4e6e-8e84-23bde6ceb919 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:12.790113 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b381b1-9f74-4041-b917-df6d588a357c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:12.791531 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b381b1-9f74-4041-b917-df6d588a357c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:12.791839 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b381b1-9f74-4041-b917-df6d588a357c admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:12.792200 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b381b1-9f74-4041-b917-df6d588a357c admin admin] PATH_INFO: `/v3/users/99bce8e7add7469cb09e1ac7e60d8579` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:12.793468 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b381b1-9f74-4041-b917-df6d588a357c admin admin] RBAC: Authorizing `identity:delete_user(user_id=99bce8e7add7469cb09e1ac7e60d8579)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:12.793610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689c175e-cca4-45ec-a281-6f9bc9b8584f None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:12.795722 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b381b1-9f74-4041-b917-df6d588a357c admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:12.798959 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef2ee6-63fd-4633-880c-b8ba817a6a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:12.805285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef2ee6-63fd-4633-880c-b8ba817a6a64 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:12.805285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef2ee6-63fd-4633-880c-b8ba817a6a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:12.805285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef2ee6-63fd-4633-880c-b8ba817a6a64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:12.805285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef2ee6-63fd-4633-880c-b8ba817a6a64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:12.805285 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef2ee6-63fd-4633-880c-b8ba817a6a64 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:12.923134 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1362/2719] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:46:12 2022] POST /identity/v3/projects => generated 381 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:46:12.928629 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef2ee6-63fd-4633-880c-b8ba817a6a64 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:12.970698 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:13.000378 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef2ee6-63fd-4633-880c-b8ba817a6a64 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:13.005501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16afaa4-fa86-418b-a42f-77d31f7b4518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:13.006193 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16afaa4-fa86-418b-a42f-77d31f7b4518 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:13.006474 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16afaa4-fa86-418b-a42f-77d31f7b4518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:13.006741 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16afaa4-fa86-418b-a42f-77d31f7b4518 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:13.007548 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16afaa4-fa86-418b-a42f-77d31f7b4518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:13.010052 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16afaa4-fa86-418b-a42f-77d31f7b4518 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:13.111947 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-42b381b1-9f74-4041-b917-df6d588a357c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99bce8e7add7469cb09e1ac7e60d8579'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:13.113969 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1363/2720] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:46:12 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:46:13.120641 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16afaa4-fa86-418b-a42f-77d31f7b4518 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:13.124584 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-42b381b1-9f74-4041-b917-df6d588a357c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99bce8e7add7469cb09e1ac7e60d8579'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:13.130417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16afaa4-fa86-418b-a42f-77d31f7b4518 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:13.131475 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-42b381b1-9f74-4041-b917-df6d588a357c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99bce8e7add7469cb09e1ac7e60d8579'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:13.132207 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-42b381b1-9f74-4041-b917-df6d588a357c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99bce8e7add7469cb09e1ac7e60d8579'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:13.132868 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-42b381b1-9f74-4041-b917-df6d588a357c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99bce8e7add7469cb09e1ac7e60d8579'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:13.135922 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65f168-fa70-4773-836c-b5fb7a056175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:13.136606 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65f168-fa70-4773-836c-b5fb7a056175 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:13.136857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65f168-fa70-4773-836c-b5fb7a056175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:13.137135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c65f168-fa70-4773-836c-b5fb7a056175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:13.137931 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65f168-fa70-4773-836c-b5fb7a056175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:13.139664 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c65f168-fa70-4773-836c-b5fb7a056175 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:13.150676 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1364/2721] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:46:13.154941 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65f168-fa70-4773-836c-b5fb7a056175 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:13.156669 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-4c65f168-fa70-4773-836c-b5fb7a056175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:13.172493 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c65f168-fa70-4773-836c-b5fb7a056175 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:13.177621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0de6d-418b-4f93-9900-9e9ae2d0c3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:13.178544 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0de6d-418b-4f93-9900-9e9ae2d0c3e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:13.178966 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0de6d-418b-4f93-9900-9e9ae2d0c3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:13.179244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0de6d-418b-4f93-9900-9e9ae2d0c3e4 admin admin] PATH_INFO: `/v3/projects/2728c474c1564f4cb9c53b25d1f20443/users/5c082fa55b4d47faa366af2256ca8d89/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:13.197074 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0de6d-418b-4f93-9900-9e9ae2d0c3e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2728c474c1564f4cb9c53b25d1f20443, user_id=5c082fa55b4d47faa366af2256ca8d89, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:13.199549 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1358/2722] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:12 2022] DELETE /identity/v3/users/99bce8e7add7469cb09e1ac7e60d8579 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:13.202538 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0de6d-418b-4f93-9900-9e9ae2d0c3e4 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:13.204557 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0d862-938b-41b1-b606-7e7fe6c5cdc8 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:13.209167 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0d862-938b-41b1-b606-7e7fe6c5cdc8 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:13.209167 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca0d862-938b-41b1-b606-7e7fe6c5cdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:13.212926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:13.223147 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-bca0d862-938b-41b1-b606-7e7fe6c5cdc8 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:13.224371 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-bca0d862-938b-41b1-b606-7e7fe6c5cdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:13.268955 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1365/2723] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:13 2022] PUT /identity/v3/projects/2728c474c1564f4cb9c53b25d1f20443/users/5c082fa55b4d47faa366af2256ca8d89/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:13.272771 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0de6d-418b-4f93-9900-9e9ae2d0c3e4 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:13.283571 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1359/2724] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:13.297935 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0d862-938b-41b1-b606-7e7fe6c5cdc8 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:13.299342 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-bca0d862-938b-41b1-b606-7e7fe6c5cdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:13.347604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0de6d-418b-4f93-9900-9e9ae2d0c3e4 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:13.352316 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40f21f-6231-4dc7-bc36-365b888eb1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:13.353020 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40f21f-6231-4dc7-bc36-365b888eb1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:13.353302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40f21f-6231-4dc7-bc36-365b888eb1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:13.353612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40f21f-6231-4dc7-bc36-365b888eb1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:13.354343 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40f21f-6231-4dc7-bc36-365b888eb1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:13.355929 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40f21f-6231-4dc7-bc36-365b888eb1d7 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:13.360520 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca0d862-938b-41b1-b606-7e7fe6c5cdc8 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:13.366603 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1366/2725] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:46:13.371023 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40f21f-6231-4dc7-bc36-365b888eb1d7 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:13.380509 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40f21f-6231-4dc7-bc36-365b888eb1d7 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:13.386015 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5627eee-75d4-45fc-b5e5-69a4031c21d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:13.386859 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5627eee-75d4-45fc-b5e5-69a4031c21d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:13.387142 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5627eee-75d4-45fc-b5e5-69a4031c21d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:13.387413 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5627eee-75d4-45fc-b5e5-69a4031c21d1 admin admin] PATH_INFO: `/v3/projects/2728c474c1564f4cb9c53b25d1f20443/users/5c082fa55b4d47faa366af2256ca8d89/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:13.389397 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5627eee-75d4-45fc-b5e5-69a4031c21d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2728c474c1564f4cb9c53b25d1f20443, user_id=5c082fa55b4d47faa366af2256ca8d89, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:13.392003 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5627eee-75d4-45fc-b5e5-69a4031c21d1 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:13.409611 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1367/2726] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:13 2022] PUT /identity/v3/projects/2728c474c1564f4cb9c53b25d1f20443/users/5c082fa55b4d47faa366af2256ca8d89/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:13.412230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80a65a-4b6a-40ca-a57a-317e2e64c796 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:13.412599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80a65a-4b6a-40ca-a57a-317e2e64c796 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:13.413045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80a65a-4b6a-40ca-a57a-317e2e64c796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:13.418820 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20b80c-abdc-4e2b-9116-c478eecc5cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:13.419660 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20b80c-abdc-4e2b-9116-c478eecc5cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:13.420129 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20b80c-abdc-4e2b-9116-c478eecc5cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:13.420409 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20b80c-abdc-4e2b-9116-c478eecc5cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:13.429553 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20b80c-abdc-4e2b-9116-c478eecc5cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:13.431497 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20b80c-abdc-4e2b-9116-c478eecc5cb8 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:13.439957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-bf80a65a-4b6a-40ca-a57a-317e2e64c796 None None] MFA Rules not processed for user `5c082fa55b4d47faa366af2256ca8d89`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:13.441174 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1360/2727] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:46:13.441460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-bf80a65a-4b6a-40ca-a57a-317e2e64c796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:13.510765 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:13.520365 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1368/2728] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:13.531641 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20b80c-abdc-4e2b-9116-c478eecc5cb8 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:13.533062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ea20b80c-abdc-4e2b-9116-c478eecc5cb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:13.592978 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20b80c-abdc-4e2b-9116-c478eecc5cb8 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:13.610795 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:13.651815 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76a5b9-442a-4ac4-a53a-c2de402780eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:13.653034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76a5b9-442a-4ac4-a53a-c2de402780eb service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:13.653428 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76a5b9-442a-4ac4-a53a-c2de402780eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:13.653751 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76a5b9-442a-4ac4-a53a-c2de402780eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:13.667440 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76a5b9-442a-4ac4-a53a-c2de402780eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:13.668960 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76a5b9-442a-4ac4-a53a-c2de402780eb service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:13.679582 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1361/2729] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:46:13.872848 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80a65a-4b6a-40ca-a57a-317e2e64c796 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:13.875286 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-bf80a65a-4b6a-40ca-a57a-317e2e64c796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:13.960777 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80a65a-4b6a-40ca-a57a-317e2e64c796 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:13.965797 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5b34a-7663-41f4-9a30-89ede7f38d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:13.966659 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5b34a-7663-41f4-9a30-89ede7f38d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:13.966940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5b34a-7663-41f4-9a30-89ede7f38d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:13.967240 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5b34a-7663-41f4-9a30-89ede7f38d9f admin admin] PATH_INFO: `/v3/projects/21dcea2104214f5d99818c2e9318af66` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:13.968491 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5b34a-7663-41f4-9a30-89ede7f38d9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=21dcea2104214f5d99818c2e9318af66)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:13.970443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5b34a-7663-41f4-9a30-89ede7f38d9f admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:14.068747 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-24e5b34a-7663-41f4-9a30-89ede7f38d9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21dcea2104214f5d99818c2e9318af66', 'request_id': 'req-24e5b34a-7663-41f4-9a30-89ede7f38d9f'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:14.083750 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-24e5b34a-7663-41f4-9a30-89ede7f38d9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21dcea2104214f5d99818c2e9318af66', 'request_id': 'req-24e5b34a-7663-41f4-9a30-89ede7f38d9f'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:14.160718 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-24e5b34a-7663-41f4-9a30-89ede7f38d9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21dcea2104214f5d99818c2e9318af66', 'request_id': 'req-24e5b34a-7663-41f4-9a30-89ede7f38d9f'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:14.178381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-24e5b34a-7663-41f4-9a30-89ede7f38d9f admin admin] The token cache is being invalidate because project 21dcea2104214f5d99818c2e9318af66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:14.178648 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-24e5b34a-7663-41f4-9a30-89ede7f38d9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:14.179330 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-24e5b34a-7663-41f4-9a30-89ede7f38d9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:14.181549 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1369/2730] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:13 2022] DELETE /identity/v3/projects/21dcea2104214f5d99818c2e9318af66 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:14.186630 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26ece6-a99d-4ab9-b6db-9cd2745f184a None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:14.187185 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26ece6-a99d-4ab9-b6db-9cd2745f184a None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:14.187691 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f26ece6-a99d-4ab9-b6db-9cd2745f184a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:14.207677 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-4f26ece6-a99d-4ab9-b6db-9cd2745f184a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:14.208915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4f26ece6-a99d-4ab9-b6db-9cd2745f184a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:14.270632 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5b34a-7663-41f4-9a30-89ede7f38d9f admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:14.272029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-24e5b34a-7663-41f4-9a30-89ede7f38d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:14.277159 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1362/2731] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:14.283610 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7dd4e-703d-4f4e-857e-91a625089095 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:14.283908 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7dd4e-703d-4f4e-857e-91a625089095 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:14.284190 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7dd4e-703d-4f4e-857e-91a625089095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:14.285460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5b34a-7663-41f4-9a30-89ede7f38d9f admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:14.290174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03faffec-301f-4072-ac7c-250d901b3286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:14.291043 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faffec-301f-4072-ac7c-250d901b3286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:14.291326 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faffec-301f-4072-ac7c-250d901b3286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:14.291604 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faffec-301f-4072-ac7c-250d901b3286 admin admin] PATH_INFO: `/v3/users/64d64e79850e447c9614c05a0d64deb8` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:14.292903 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03faffec-301f-4072-ac7c-250d901b3286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64d64e79850e447c9614c05a0d64deb8)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:14.295105 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03faffec-301f-4072-ac7c-250d901b3286 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:14.303458 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-59b7dd4e-703d-4f4e-857e-91a625089095 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:14.304900 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-59b7dd4e-703d-4f4e-857e-91a625089095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:14.314052 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1363/2732] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:14.318235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7dd4e-703d-4f4e-857e-91a625089095 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:14.328643 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7dd4e-703d-4f4e-857e-91a625089095 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:14.333193 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b94083-5b4f-47b6-a54d-9f6c9c80bbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:14.333896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b94083-5b4f-47b6-a54d-9f6c9c80bbda admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:14.334187 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b94083-5b4f-47b6-a54d-9f6c9c80bbda admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:14.334460 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b94083-5b4f-47b6-a54d-9f6c9c80bbda admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:14.335190 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b94083-5b4f-47b6-a54d-9f6c9c80bbda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:46:14.335515 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b94083-5b4f-47b6-a54d-9f6c9c80bbda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:14.337654 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b94083-5b4f-47b6-a54d-9f6c9c80bbda admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:14.349779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1364/2733] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:46:14.354396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b94083-5b4f-47b6-a54d-9f6c9c80bbda admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:14.364179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b94083-5b4f-47b6-a54d-9f6c9c80bbda admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:14.369619 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95bf0d-1a7e-4d0e-8f75-1167270706ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:14.370329 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95bf0d-1a7e-4d0e-8f75-1167270706ba admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:14.370757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95bf0d-1a7e-4d0e-8f75-1167270706ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:14.371191 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95bf0d-1a7e-4d0e-8f75-1167270706ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:14.372015 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95bf0d-1a7e-4d0e-8f75-1167270706ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:14.374892 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95bf0d-1a7e-4d0e-8f75-1167270706ba admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:14.498944 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1365/2734] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:46:14 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:46:14.503525 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95bf0d-1a7e-4d0e-8f75-1167270706ba admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:14.542410 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-03faffec-301f-4072-ac7c-250d901b3286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64d64e79850e447c9614c05a0d64deb8'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:14.558900 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-03faffec-301f-4072-ac7c-250d901b3286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64d64e79850e447c9614c05a0d64deb8'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:14.566152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-03faffec-301f-4072-ac7c-250d901b3286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64d64e79850e447c9614c05a0d64deb8'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:14.566967 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-03faffec-301f-4072-ac7c-250d901b3286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64d64e79850e447c9614c05a0d64deb8'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:14.567854 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-03faffec-301f-4072-ac7c-250d901b3286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64d64e79850e447c9614c05a0d64deb8'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:14.573043 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:14.575491 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95bf0d-1a7e-4d0e-8f75-1167270706ba admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:14.580294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2f3a5-52ae-49b8-9b77-20aab3e444d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:14.580907 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2f3a5-52ae-49b8-9b77-20aab3e444d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:14.581187 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2f3a5-52ae-49b8-9b77-20aab3e444d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:14.581464 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2f3a5-52ae-49b8-9b77-20aab3e444d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:14.582190 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2f3a5-52ae-49b8-9b77-20aab3e444d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:14.588457 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2f3a5-52ae-49b8-9b77-20aab3e444d5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:14.785358 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1370/2735] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:14 2022] DELETE /identity/v3/users/64d64e79850e447c9614c05a0d64deb8 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:14.785609 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1366/2736] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:46:14 2022] POST /identity/v3/users => generated 294 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:46:14.788516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03faffec-301f-4072-ac7c-250d901b3286 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:14.789316 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96318fef-5e65-4a95-87b5-590c5ba2ae8d None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:14.789649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96318fef-5e65-4a95-87b5-590c5ba2ae8d None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:14.789936 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96318fef-5e65-4a95-87b5-590c5ba2ae8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:14.790073 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-03faffec-301f-4072-ac7c-250d901b3286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:14.808218 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-96318fef-5e65-4a95-87b5-590c5ba2ae8d None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:14.809433 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-96318fef-5e65-4a95-87b5-590c5ba2ae8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:14.814840 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:14.861823 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03faffec-301f-4072-ac7c-250d901b3286 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:14.866441 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4032ae-9177-4fb3-b6ff-8e707188be74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:14.867102 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4032ae-9177-4fb3-b6ff-8e707188be74 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:14.867388 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4032ae-9177-4fb3-b6ff-8e707188be74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:14.867668 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4032ae-9177-4fb3-b6ff-8e707188be74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:14.868890 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4032ae-9177-4fb3-b6ff-8e707188be74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:14.870512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4032ae-9177-4fb3-b6ff-8e707188be74 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:14.873404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1367/2737] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:14.880505 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1371/2738] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:46:14.885164 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4032ae-9177-4fb3-b6ff-8e707188be74 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:14.891209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96318fef-5e65-4a95-87b5-590c5ba2ae8d None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:14.891209 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-96318fef-5e65-4a95-87b5-590c5ba2ae8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:14.895455 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4032ae-9177-4fb3-b6ff-8e707188be74 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:14.900507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9116e-75e8-4a6e-a8d8-dd29ad24d068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:14.901172 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9116e-75e8-4a6e-a8d8-dd29ad24d068 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:14.901688 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9116e-75e8-4a6e-a8d8-dd29ad24d068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:14.903154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9116e-75e8-4a6e-a8d8-dd29ad24d068 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:14.903154 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9116e-75e8-4a6e-a8d8-dd29ad24d068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:14.904216 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9116e-75e8-4a6e-a8d8-dd29ad24d068 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:14.917617 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1372/2739] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:46:14.921354 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9116e-75e8-4a6e-a8d8-dd29ad24d068 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:14.928389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9116e-75e8-4a6e-a8d8-dd29ad24d068 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:14.933674 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298a34c-8e6b-41eb-833d-cd1a706a5474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:14.934661 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298a34c-8e6b-41eb-833d-cd1a706a5474 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:14.934953 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298a34c-8e6b-41eb-833d-cd1a706a5474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:14.935238 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298a34c-8e6b-41eb-833d-cd1a706a5474 admin admin] PATH_INFO: `/v3/projects/c21964451ae84949bf63b1245f913041/users/7f1f7477475d4065a4e37f795bddf606/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:14.947982 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96318fef-5e65-4a95-87b5-590c5ba2ae8d None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:14.954201 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2276686-3e35-45cb-8c5a-c1725f3348c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:14.954852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2276686-3e35-45cb-8c5a-c1725f3348c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:14.955089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2276686-3e35-45cb-8c5a-c1725f3348c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:14.955409 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2276686-3e35-45cb-8c5a-c1725f3348c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:14.960202 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298a34c-8e6b-41eb-833d-cd1a706a5474 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21964451ae84949bf63b1245f913041, user_id=7f1f7477475d4065a4e37f795bddf606, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:14.963526 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298a34c-8e6b-41eb-833d-cd1a706a5474 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:14.965830 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2276686-3e35-45cb-8c5a-c1725f3348c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:14.967323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2276686-3e35-45cb-8c5a-c1725f3348c7 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:14.976994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1368/2740] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:46:15.050525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1373/2741] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:14 2022] PUT /identity/v3/projects/c21964451ae84949bf63b1245f913041/users/7f1f7477475d4065a4e37f795bddf606/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:15.061640 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993d501-ebd6-4231-bec3-9c5aed2e7b08 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:15.062064 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993d501-ebd6-4231-bec3-9c5aed2e7b08 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:15.062355 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993d501-ebd6-4231-bec3-9c5aed2e7b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:15.092338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-4993d501-ebd6-4231-bec3-9c5aed2e7b08 None None] MFA Rules not processed for user `7f1f7477475d4065a4e37f795bddf606`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:15.093622 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4993d501-ebd6-4231-bec3-9c5aed2e7b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:15.162315 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1369/2742] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:15.167416 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298a34c-8e6b-41eb-833d-cd1a706a5474 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:15.237924 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298a34c-8e6b-41eb-833d-cd1a706a5474 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:15.242613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f176c9c-1e8c-4c3d-ae2d-4d58f0fac1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:15.243906 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f176c9c-1e8c-4c3d-ae2d-4d58f0fac1dd admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:15.244190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f176c9c-1e8c-4c3d-ae2d-4d58f0fac1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:15.244465 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f176c9c-1e8c-4c3d-ae2d-4d58f0fac1dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:15.245160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f176c9c-1e8c-4c3d-ae2d-4d58f0fac1dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:15.247111 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f176c9c-1e8c-4c3d-ae2d-4d58f0fac1dd admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:15.355329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1374/2743] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:46:15 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:46:15.356014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993d501-ebd6-4231-bec3-9c5aed2e7b08 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:15.368155 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993d501-ebd6-4231-bec3-9c5aed2e7b08 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:15.420848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:15.437602 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3ccde-5918-40cf-8ed8-63141847b4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:15.438405 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3ccde-5918-40cf-8ed8-63141847b4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:15.438797 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3ccde-5918-40cf-8ed8-63141847b4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:15.439182 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3ccde-5918-40cf-8ed8-63141847b4a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:15.439988 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3ccde-5918-40cf-8ed8-63141847b4a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:15.442132 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3ccde-5918-40cf-8ed8-63141847b4a3 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:15.525077 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1370/2744] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:46:15 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:46:15.526436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f176c9c-1e8c-4c3d-ae2d-4d58f0fac1dd admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:15.537993 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f176c9c-1e8c-4c3d-ae2d-4d58f0fac1dd admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:15.543590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc937613-03c2-40c9-bc40-aae32443ed98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:15.544811 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc937613-03c2-40c9-bc40-aae32443ed98 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:15.544811 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc937613-03c2-40c9-bc40-aae32443ed98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:15.544811 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc937613-03c2-40c9-bc40-aae32443ed98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:15.545690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc937613-03c2-40c9-bc40-aae32443ed98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:15.547519 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc937613-03c2-40c9-bc40-aae32443ed98 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:15.560482 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1375/2745] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:15.564839 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3ccde-5918-40cf-8ed8-63141847b4a3 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:15.575121 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3ccde-5918-40cf-8ed8-63141847b4a3 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:15.579843 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70c167-da8a-445b-9dd1-b736321c5514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:15.580733 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70c167-da8a-445b-9dd1-b736321c5514 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:15.581012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70c167-da8a-445b-9dd1-b736321c5514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:15.581291 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f70c167-da8a-445b-9dd1-b736321c5514 admin admin] PATH_INFO: `/v3/projects/4c6aeaeb471e4082a804a494f649fbe6/users/fee685a6b8864ab68c056f5145fac00d/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:15.596571 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70c167-da8a-445b-9dd1-b736321c5514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6aeaeb471e4082a804a494f649fbe6, user_id=fee685a6b8864ab68c056f5145fac00d, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:15.599254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f70c167-da8a-445b-9dd1-b736321c5514 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:15.695713 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1371/2746] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:15 2022] PUT /identity/v3/projects/4c6aeaeb471e4082a804a494f649fbe6/users/fee685a6b8864ab68c056f5145fac00d/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:15.699853 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc937613-03c2-40c9-bc40-aae32443ed98 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:15.710236 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc937613-03c2-40c9-bc40-aae32443ed98 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:15.722183 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70c167-da8a-445b-9dd1-b736321c5514 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:15.725634 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-6f70c167-da8a-445b-9dd1-b736321c5514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:15.751053 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:15.793613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0879f-f98c-4aef-a569-c841ff2b585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:15.794284 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0879f-f98c-4aef-a569-c841ff2b585a admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:15.794568 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0879f-f98c-4aef-a569-c841ff2b585a admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:15.794844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0879f-f98c-4aef-a569-c841ff2b585a admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:15.795574 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0879f-f98c-4aef-a569-c841ff2b585a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:15.797167 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d0879f-f98c-4aef-a569-c841ff2b585a admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:15.806559 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f70c167-da8a-445b-9dd1-b736321c5514 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:15.811257 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1376/2747] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:15.813638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de47b58-6d96-4a69-8b80-eb4da5c80889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:15.813783 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0879f-f98c-4aef-a569-c841ff2b585a admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:15.813894 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de47b58-6d96-4a69-8b80-eb4da5c80889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:15.813894 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de47b58-6d96-4a69-8b80-eb4da5c80889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:15.813894 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de47b58-6d96-4a69-8b80-eb4da5c80889 admin admin] PATH_INFO: `/v3/projects/3020c73d79a54ad59b9b72f4eebc13c3` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:15.814354 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de47b58-6d96-4a69-8b80-eb4da5c80889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3020c73d79a54ad59b9b72f4eebc13c3)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:15.816229 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de47b58-6d96-4a69-8b80-eb4da5c80889 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:15.822278 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0879f-f98c-4aef-a569-c841ff2b585a admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:15.827425 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14f4b1-7435-4f6a-b3d2-7702331839f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:15.828298 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14f4b1-7435-4f6a-b3d2-7702331839f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:15.828751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14f4b1-7435-4f6a-b3d2-7702331839f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:15.829007 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14f4b1-7435-4f6a-b3d2-7702331839f0 admin admin] PATH_INFO: `/v3/projects/4c6aeaeb471e4082a804a494f649fbe6/users/fee685a6b8864ab68c056f5145fac00d/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:15.831239 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14f4b1-7435-4f6a-b3d2-7702331839f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6aeaeb471e4082a804a494f649fbe6, user_id=fee685a6b8864ab68c056f5145fac00d, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:15.834368 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14f4b1-7435-4f6a-b3d2-7702331839f0 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:15.845651 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1377/2748] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:15 2022] PUT /identity/v3/projects/4c6aeaeb471e4082a804a494f649fbe6/users/fee685a6b8864ab68c056f5145fac00d/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:15.858037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17ac2c-a601-4d50-a9c9-90fa8ff420a1 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:15.858339 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17ac2c-a601-4d50-a9c9-90fa8ff420a1 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:15.858618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17ac2c-a601-4d50-a9c9-90fa8ff420a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:15.885867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-5b17ac2c-a601-4d50-a9c9-90fa8ff420a1 None None] MFA Rules not processed for user `fee685a6b8864ab68c056f5145fac00d`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:15.887124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-5b17ac2c-a601-4d50-a9c9-90fa8ff420a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:15.947447 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7de47b58-6d96-4a69-8b80-eb4da5c80889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3020c73d79a54ad59b9b72f4eebc13c3', 'request_id': 'req-7de47b58-6d96-4a69-8b80-eb4da5c80889'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:15.953616 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7de47b58-6d96-4a69-8b80-eb4da5c80889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3020c73d79a54ad59b9b72f4eebc13c3', 'request_id': 'req-7de47b58-6d96-4a69-8b80-eb4da5c80889'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:15.958132 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1378/2749] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:15.963095 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7de47b58-6d96-4a69-8b80-eb4da5c80889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3020c73d79a54ad59b9b72f4eebc13c3', 'request_id': 'req-7de47b58-6d96-4a69-8b80-eb4da5c80889'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:15.972256 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17ac2c-a601-4d50-a9c9-90fa8ff420a1 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:15.974034 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-5b17ac2c-a601-4d50-a9c9-90fa8ff420a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:16.032296 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17ac2c-a601-4d50-a9c9-90fa8ff420a1 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:16.032557 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7de47b58-6d96-4a69-8b80-eb4da5c80889 admin admin] The token cache is being invalidate because project 3020c73d79a54ad59b9b72f4eebc13c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:16.032695 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7de47b58-6d96-4a69-8b80-eb4da5c80889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:16.033333 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7de47b58-6d96-4a69-8b80-eb4da5c80889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:16.034951 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1372/2750] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:15 2022] DELETE /identity/v3/projects/3020c73d79a54ad59b9b72f4eebc13c3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:16.038996 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de47b58-6d96-4a69-8b80-eb4da5c80889 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:16.043202 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-7de47b58-6d96-4a69-8b80-eb4da5c80889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:16.083510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3133a0-bb2e-402d-90d9-f11a411e1837 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:16.084162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3133a0-bb2e-402d-90d9-f11a411e1837 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:16.084509 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3133a0-bb2e-402d-90d9-f11a411e1837 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:16.084725 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3133a0-bb2e-402d-90d9-f11a411e1837 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:16.086163 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:16.086626 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-2d3133a0-bb2e-402d-90d9-f11a411e1837 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:16.097582 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:16.114916 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de47b58-6d96-4a69-8b80-eb4da5c80889 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:16.119893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa0119-9e2b-4890-bd78-c765c0f15077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:16.120771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa0119-9e2b-4890-bd78-c765c0f15077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:16.121078 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa0119-9e2b-4890-bd78-c765c0f15077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:16.121367 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa0119-9e2b-4890-bd78-c765c0f15077 admin admin] PATH_INFO: `/v3/users/5c082fa55b4d47faa366af2256ca8d89` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:16.122603 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa0119-9e2b-4890-bd78-c765c0f15077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c082fa55b4d47faa366af2256ca8d89)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:16.124523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa0119-9e2b-4890-bd78-c765c0f15077 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:16.159187 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3133a0-bb2e-402d-90d9-f11a411e1837 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:16.160715 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3133a0-bb2e-402d-90d9-f11a411e1837 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:16.172002 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1379/2751] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:46:16.238517 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3133a0-bb2e-402d-90d9-f11a411e1837 service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:16.242663 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-2d3133a0-bb2e-402d-90d9-f11a411e1837 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:16.253139 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3133a0-bb2e-402d-90d9-f11a411e1837 service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:16.257794 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09a440-4712-4ecc-9ace-b7d05b912837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:16.258655 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09a440-4712-4ecc-9ace-b7d05b912837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:16.259487 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09a440-4712-4ecc-9ace-b7d05b912837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:16.259759 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09a440-4712-4ecc-9ace-b7d05b912837 admin admin] PATH_INFO: `/v3/users/7f1f7477475d4065a4e37f795bddf606` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:16.260957 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09a440-4712-4ecc-9ace-b7d05b912837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f1f7477475d4065a4e37f795bddf606)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:16.262895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09a440-4712-4ecc-9ace-b7d05b912837 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:16.311149 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f9fa0119-9e2b-4890-bd78-c765c0f15077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c082fa55b4d47faa366af2256ca8d89'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:16.322846 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f9fa0119-9e2b-4890-bd78-c765c0f15077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c082fa55b4d47faa366af2256ca8d89'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:16.329684 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f9fa0119-9e2b-4890-bd78-c765c0f15077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c082fa55b4d47faa366af2256ca8d89'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:16.335122 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f9fa0119-9e2b-4890-bd78-c765c0f15077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c082fa55b4d47faa366af2256ca8d89'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:16.335122 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f9fa0119-9e2b-4890-bd78-c765c0f15077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c082fa55b4d47faa366af2256ca8d89'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:16.416247 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1373/2752] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:16 2022] DELETE /identity/v3/users/5c082fa55b4d47faa366af2256ca8d89 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:16.489293 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-2c09a440-4712-4ecc-9ace-b7d05b912837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f1f7477475d4065a4e37f795bddf606'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:16.506859 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-2c09a440-4712-4ecc-9ace-b7d05b912837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f1f7477475d4065a4e37f795bddf606'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:16.515300 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-2c09a440-4712-4ecc-9ace-b7d05b912837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f1f7477475d4065a4e37f795bddf606'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:16.516051 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-2c09a440-4712-4ecc-9ace-b7d05b912837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f1f7477475d4065a4e37f795bddf606'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:16.516799 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-2c09a440-4712-4ecc-9ace-b7d05b912837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f1f7477475d4065a4e37f795bddf606'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:16.581605 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1380/2753] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:16 2022] DELETE /identity/v3/users/7f1f7477475d4065a4e37f795bddf606 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:16.586312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92c7bb-d52e-4710-998d-d18571b89574 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:16.586779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92c7bb-d52e-4710-998d-d18571b89574 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:16.587132 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92c7bb-d52e-4710-998d-d18571b89574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:16.604902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-2f92c7bb-d52e-4710-998d-d18571b89574 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:16.606239 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2f92c7bb-d52e-4710-998d-d18571b89574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:16.674725 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1374/2754] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:16.686290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09a440-4712-4ecc-9ace-b7d05b912837 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:16.690072 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-2c09a440-4712-4ecc-9ace-b7d05b912837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:16.783200 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09a440-4712-4ecc-9ace-b7d05b912837 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:16.788525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c0ba8-f973-47b6-b530-ecc30c0dfbf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:16.789174 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c0ba8-f973-47b6-b530-ecc30c0dfbf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:16.789452 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c0ba8-f973-47b6-b530-ecc30c0dfbf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:16.789774 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c0ba8-f973-47b6-b530-ecc30c0dfbf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:16.800395 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c0ba8-f973-47b6-b530-ecc30c0dfbf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:16.802042 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c0ba8-f973-47b6-b530-ecc30c0dfbf9 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:16.819111 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1381/2755] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:46:16.972200 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92c7bb-d52e-4710-998d-d18571b89574 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:16.973823 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-2f92c7bb-d52e-4710-998d-d18571b89574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:16.986809 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92c7bb-d52e-4710-998d-d18571b89574 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:16.995208 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7598e1b-cb05-4733-88b7-0c457b47e6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:16.996406 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7598e1b-cb05-4733-88b7-0c457b47e6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:16.997095 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7598e1b-cb05-4733-88b7-0c457b47e6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:16.997725 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7598e1b-cb05-4733-88b7-0c457b47e6d2 admin admin] PATH_INFO: `/v3/projects/2728c474c1564f4cb9c53b25d1f20443` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:16.999230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7598e1b-cb05-4733-88b7-0c457b47e6d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2728c474c1564f4cb9c53b25d1f20443)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:17.001654 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7598e1b-cb05-4733-88b7-0c457b47e6d2 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:17.129919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-d7598e1b-cb05-4733-88b7-0c457b47e6d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2728c474c1564f4cb9c53b25d1f20443', 'request_id': 'req-d7598e1b-cb05-4733-88b7-0c457b47e6d2'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:17.136088 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-d7598e1b-cb05-4733-88b7-0c457b47e6d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2728c474c1564f4cb9c53b25d1f20443', 'request_id': 'req-d7598e1b-cb05-4733-88b7-0c457b47e6d2'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:17.137358 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:17.142500 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-d7598e1b-cb05-4733-88b7-0c457b47e6d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2728c474c1564f4cb9c53b25d1f20443', 'request_id': 'req-d7598e1b-cb05-4733-88b7-0c457b47e6d2'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:17.238281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-d7598e1b-cb05-4733-88b7-0c457b47e6d2 admin admin] The token cache is being invalidate because project 2728c474c1564f4cb9c53b25d1f20443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:17.238589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-d7598e1b-cb05-4733-88b7-0c457b47e6d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:17.239252 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-d7598e1b-cb05-4733-88b7-0c457b47e6d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:17.240827 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1375/2756] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:16 2022] DELETE /identity/v3/projects/2728c474c1564f4cb9c53b25d1f20443 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:17.246003 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087561d7-4d02-4551-96a1-60ad773639cc None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:17.246499 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087561d7-4d02-4551-96a1-60ad773639cc None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:17.247272 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087561d7-4d02-4551-96a1-60ad773639cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:17.267906 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-087561d7-4d02-4551-96a1-60ad773639cc None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:17.269662 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-087561d7-4d02-4551-96a1-60ad773639cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:17.286833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:17.333595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1382/2757] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:17.397892 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163400d-fd6c-41e5-8504-1f3f8eefbaf8 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:17.398206 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163400d-fd6c-41e5-8504-1f3f8eefbaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:17.398489 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163400d-fd6c-41e5-8504-1f3f8eefbaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:17.411696 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087561d7-4d02-4551-96a1-60ad773639cc None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:17.414700 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-087561d7-4d02-4551-96a1-60ad773639cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:17.418591 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-e163400d-fd6c-41e5-8504-1f3f8eefbaf8 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:17.419826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e163400d-fd6c-41e5-8504-1f3f8eefbaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:17.426976 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087561d7-4d02-4551-96a1-60ad773639cc None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:17.428107 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1376/2758] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:17.432477 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163400d-fd6c-41e5-8504-1f3f8eefbaf8 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:17.433381 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f96302-2094-45c2-95e1-4380d3952e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:17.435026 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f96302-2094-45c2-95e1-4380d3952e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:17.435313 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f96302-2094-45c2-95e1-4380d3952e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:17.435594 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f96302-2094-45c2-95e1-4380d3952e84 admin admin] PATH_INFO: `/v3/projects/c21964451ae84949bf63b1245f913041` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:17.436825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f96302-2094-45c2-95e1-4380d3952e84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c21964451ae84949bf63b1245f913041)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:17.438795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f96302-2094-45c2-95e1-4380d3952e84 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:17.443223 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163400d-fd6c-41e5-8504-1f3f8eefbaf8 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:17.448853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1563a-4da5-42c3-988a-d104734224a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:17.449641 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1563a-4da5-42c3-988a-d104734224a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:17.449930 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1563a-4da5-42c3-988a-d104734224a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:17.450211 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1563a-4da5-42c3-988a-d104734224a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:17.450941 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1563a-4da5-42c3-988a-d104734224a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:46:17.451253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1563a-4da5-42c3-988a-d104734224a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:17.452888 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1563a-4da5-42c3-988a-d104734224a2 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:17.467480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1377/2759] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:46:17.471867 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1563a-4da5-42c3-988a-d104734224a2 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:17.481930 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1563a-4da5-42c3-988a-d104734224a2 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:17.486802 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de44af0-6d16-4e16-a051-366cb8582225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:17.487395 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de44af0-6d16-4e16-a051-366cb8582225 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:17.487683 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de44af0-6d16-4e16-a051-366cb8582225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:17.487966 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de44af0-6d16-4e16-a051-366cb8582225 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:17.488653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de44af0-6d16-4e16-a051-366cb8582225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:17.490609 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de44af0-6d16-4e16-a051-366cb8582225 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:17.571210 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-80f96302-2094-45c2-95e1-4380d3952e84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c21964451ae84949bf63b1245f913041', 'request_id': 'req-80f96302-2094-45c2-95e1-4380d3952e84'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:17.576658 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-80f96302-2094-45c2-95e1-4380d3952e84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c21964451ae84949bf63b1245f913041', 'request_id': 'req-80f96302-2094-45c2-95e1-4380d3952e84'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:17.588571 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1378/2760] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:46:17 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:46:17.592604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de44af0-6d16-4e16-a051-366cb8582225 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:17.661484 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de44af0-6d16-4e16-a051-366cb8582225 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:17.662072 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-80f96302-2094-45c2-95e1-4380d3952e84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c21964451ae84949bf63b1245f913041', 'request_id': 'req-80f96302-2094-45c2-95e1-4380d3952e84'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:17.667597 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac82994-61c9-47da-b9ed-94debb26e1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:17.668275 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac82994-61c9-47da-b9ed-94debb26e1b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:17.671796 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac82994-61c9-47da-b9ed-94debb26e1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:17.671796 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac82994-61c9-47da-b9ed-94debb26e1b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:17.671796 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac82994-61c9-47da-b9ed-94debb26e1b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:17.671796 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac82994-61c9-47da-b9ed-94debb26e1b7 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:17.676438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-80f96302-2094-45c2-95e1-4380d3952e84 admin admin] The token cache is being invalidate because project c21964451ae84949bf63b1245f913041 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:17.676837 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-80f96302-2094-45c2-95e1-4380d3952e84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:17.677661 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-80f96302-2094-45c2-95e1-4380d3952e84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:17.683419 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1383/2761] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:17 2022] DELETE /identity/v3/projects/c21964451ae84949bf63b1245f913041 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:17.684500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f96302-2094-45c2-95e1-4380d3952e84 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:17.685952 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-80f96302-2094-45c2-95e1-4380d3952e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:17.757120 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f96302-2094-45c2-95e1-4380d3952e84 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:17.763636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25c7b3-4632-4e87-920f-e98b5abe3221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:17.763885 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1379/2762] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:46:17 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:46:17.764794 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25c7b3-4632-4e87-920f-e98b5abe3221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:17.765153 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25c7b3-4632-4e87-920f-e98b5abe3221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:17.765508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25c7b3-4632-4e87-920f-e98b5abe3221 admin admin] PATH_INFO: `/v3/users/fee685a6b8864ab68c056f5145fac00d` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:17.766867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25c7b3-4632-4e87-920f-e98b5abe3221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee685a6b8864ab68c056f5145fac00d)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:17.767592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac82994-61c9-47da-b9ed-94debb26e1b7 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:17.768993 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25c7b3-4632-4e87-920f-e98b5abe3221 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:17.769892 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4ac82994-61c9-47da-b9ed-94debb26e1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:17.791701 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac82994-61c9-47da-b9ed-94debb26e1b7 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:17.798588 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3506b-63af-4368-b797-d9016f503fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:17.799941 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3506b-63af-4368-b797-d9016f503fbe admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:17.800440 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3506b-63af-4368-b797-d9016f503fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:17.800911 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3506b-63af-4368-b797-d9016f503fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:17.801982 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3506b-63af-4368-b797-d9016f503fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:17.804034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3506b-63af-4368-b797-d9016f503fbe admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:17.819860 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1380/2763] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:46:17.822723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3506b-63af-4368-b797-d9016f503fbe admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:17.836364 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3506b-63af-4368-b797-d9016f503fbe admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:17.847793 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c108225-8194-4bc3-bdfe-6ca6f73fd130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:17.848472 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c108225-8194-4bc3-bdfe-6ca6f73fd130 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:17.848754 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c108225-8194-4bc3-bdfe-6ca6f73fd130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:17.849029 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c108225-8194-4bc3-bdfe-6ca6f73fd130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:17.849840 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c108225-8194-4bc3-bdfe-6ca6f73fd130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:17.851448 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c108225-8194-4bc3-bdfe-6ca6f73fd130 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:17.863410 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1381/2764] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:17.867476 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c108225-8194-4bc3-bdfe-6ca6f73fd130 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:17.876811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c108225-8194-4bc3-bdfe-6ca6f73fd130 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:17.885723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd019d-fe2d-4029-86a3-20800c6e32a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:17.885723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd019d-fe2d-4029-86a3-20800c6e32a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:17.885723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd019d-fe2d-4029-86a3-20800c6e32a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:17.885723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd019d-fe2d-4029-86a3-20800c6e32a6 admin admin] PATH_INFO: `/v3/projects/c393a1fd24d940bfba00964f025b483c/users/71958b69e14b4d60ae87c207f8c04652/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:17.897380 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd019d-fe2d-4029-86a3-20800c6e32a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c393a1fd24d940bfba00964f025b483c, user_id=71958b69e14b4d60ae87c207f8c04652, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:17.900547 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd019d-fe2d-4029-86a3-20800c6e32a6 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:18.007091 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1382/2765] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:17 2022] PUT /identity/v3/projects/c393a1fd24d940bfba00964f025b483c/users/71958b69e14b4d60ae87c207f8c04652/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:18.020746 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407954e-3ed9-45a0-bff1-060dc926d901 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:18.021035 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407954e-3ed9-45a0-bff1-060dc926d901 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:18.021314 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407954e-3ed9-45a0-bff1-060dc926d901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:18.047648 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ee25c7b3-4632-4e87-920f-e98b5abe3221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee685a6b8864ab68c056f5145fac00d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:18.055718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-d407954e-3ed9-45a0-bff1-060dc926d901 None None] MFA Rules not processed for user `71958b69e14b4d60ae87c207f8c04652`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:18.057085 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-d407954e-3ed9-45a0-bff1-060dc926d901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:18.061556 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ee25c7b3-4632-4e87-920f-e98b5abe3221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee685a6b8864ab68c056f5145fac00d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:18.068364 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ee25c7b3-4632-4e87-920f-e98b5abe3221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee685a6b8864ab68c056f5145fac00d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:18.069132 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ee25c7b3-4632-4e87-920f-e98b5abe3221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee685a6b8864ab68c056f5145fac00d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:18.069849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-ee25c7b3-4632-4e87-920f-e98b5abe3221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee685a6b8864ab68c056f5145fac00d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:18.089881 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:DELETE=3,keystone:SELECT=91,keystone:INSERT=6 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:18.097735 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:18.121384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1383/2766] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:18.132272 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407954e-3ed9-45a0-bff1-060dc926d901 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:18.133716 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-d407954e-3ed9-45a0-bff1-060dc926d901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:18.137613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1384/2767] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:17 2022] DELETE /identity/v3/users/fee685a6b8864ab68c056f5145fac00d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:18.192566 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407954e-3ed9-45a0-bff1-060dc926d901 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:18.241709 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106e6b7-83f6-4221-bae9-b69dc0237076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:18.242363 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106e6b7-83f6-4221-bae9-b69dc0237076 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:18.242647 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106e6b7-83f6-4221-bae9-b69dc0237076 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:18.242925 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106e6b7-83f6-4221-bae9-b69dc0237076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:18.303796 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106e6b7-83f6-4221-bae9-b69dc0237076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:18.312739 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b106e6b7-83f6-4221-bae9-b69dc0237076 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:18.314437 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1384/2768] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:46:18.334025 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25c7b3-4632-4e87-920f-e98b5abe3221 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:18.335776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ee25c7b3-4632-4e87-920f-e98b5abe3221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:18.413360 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25c7b3-4632-4e87-920f-e98b5abe3221 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:18.419084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0019b6-69c4-41f5-8b92-3a894b209e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:18.420089 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0019b6-69c4-41f5-8b92-3a894b209e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:18.420255 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0019b6-69c4-41f5-8b92-3a894b209e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:18.420525 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0019b6-69c4-41f5-8b92-3a894b209e70 admin admin] PATH_INFO: `/v3/users/71958b69e14b4d60ae87c207f8c04652` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:18.421871 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0019b6-69c4-41f5-8b92-3a894b209e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71958b69e14b4d60ae87c207f8c04652)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:18.423824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0019b6-69c4-41f5-8b92-3a894b209e70 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:18.549274 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106e6b7-83f6-4221-bae9-b69dc0237076 service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:18.550720 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b106e6b7-83f6-4221-bae9-b69dc0237076 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:18.565669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106e6b7-83f6-4221-bae9-b69dc0237076 service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:18.570779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea86b0-0758-4402-bc6c-d54e1152bdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:18.571647 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea86b0-0758-4402-bc6c-d54e1152bdc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:18.571933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea86b0-0758-4402-bc6c-d54e1152bdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:18.572320 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea86b0-0758-4402-bc6c-d54e1152bdc3 admin admin] PATH_INFO: `/v3/projects/4c6aeaeb471e4082a804a494f649fbe6` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:18.573548 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea86b0-0758-4402-bc6c-d54e1152bdc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c6aeaeb471e4082a804a494f649fbe6)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:18.575453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea86b0-0758-4402-bc6c-d54e1152bdc3 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:18.651602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4e0019b6-69c4-41f5-8b92-3a894b209e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71958b69e14b4d60ae87c207f8c04652'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:18.663968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4e0019b6-69c4-41f5-8b92-3a894b209e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71958b69e14b4d60ae87c207f8c04652'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:18.671820 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4e0019b6-69c4-41f5-8b92-3a894b209e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71958b69e14b4d60ae87c207f8c04652'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:18.672558 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4e0019b6-69c4-41f5-8b92-3a894b209e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71958b69e14b4d60ae87c207f8c04652'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:18.676456 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-4e0019b6-69c4-41f5-8b92-3a894b209e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71958b69e14b4d60ae87c207f8c04652'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:18.718757 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c4ea86b0-0758-4402-bc6c-d54e1152bdc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c6aeaeb471e4082a804a494f649fbe6', 'request_id': 'req-c4ea86b0-0758-4402-bc6c-d54e1152bdc3'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:18.724842 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c4ea86b0-0758-4402-bc6c-d54e1152bdc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c6aeaeb471e4082a804a494f649fbe6', 'request_id': 'req-c4ea86b0-0758-4402-bc6c-d54e1152bdc3'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:18.730774 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c4ea86b0-0758-4402-bc6c-d54e1152bdc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c6aeaeb471e4082a804a494f649fbe6', 'request_id': 'req-c4ea86b0-0758-4402-bc6c-d54e1152bdc3'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:18.812161 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1385/2769] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:18 2022] DELETE /identity/v3/users/71958b69e14b4d60ae87c207f8c04652 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:18.816775 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3e3fd-7be8-4325-a4d3-be0f430b34cc None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:18.817068 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3e3fd-7be8-4325-a4d3-be0f430b34cc None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:18.817345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3e3fd-7be8-4325-a4d3-be0f430b34cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:18.833926 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-98a3e3fd-7be8-4325-a4d3-be0f430b34cc None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:18.835058 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-98a3e3fd-7be8-4325-a4d3-be0f430b34cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:18.886161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c4ea86b0-0758-4402-bc6c-d54e1152bdc3 admin admin] The token cache is being invalidate because project 4c6aeaeb471e4082a804a494f649fbe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:18.886465 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c4ea86b0-0758-4402-bc6c-d54e1152bdc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:18.887266 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-c4ea86b0-0758-4402-bc6c-d54e1152bdc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:18.890843 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1385/2770] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:18 2022] DELETE /identity/v3/projects/4c6aeaeb471e4082a804a494f649fbe6 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:18.898946 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c31a9e-763f-42fd-ad24-cd7903e6c9c0 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:18.900009 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c31a9e-763f-42fd-ad24-cd7903e6c9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:18.900394 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c31a9e-763f-42fd-ad24-cd7903e6c9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:18.912843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1386/2771] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:18.921752 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-e7c31a9e-763f-42fd-ad24-cd7903e6c9c0 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:18.922964 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e7c31a9e-763f-42fd-ad24-cd7903e6c9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:18.927089 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3e3fd-7be8-4325-a4d3-be0f430b34cc None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:18.928768 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-98a3e3fd-7be8-4325-a4d3-be0f430b34cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:18.931554 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1386/2772] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:18.939212 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe499f7-3e20-4b42-a55a-ac2f7cc6b85b None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:18.941651 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe499f7-3e20-4b42-a55a-ac2f7cc6b85b None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:18.941651 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe499f7-3e20-4b42-a55a-ac2f7cc6b85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:18.958353 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-ffe499f7-3e20-4b42-a55a-ac2f7cc6b85b None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:18.959581 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ffe499f7-3e20-4b42-a55a-ac2f7cc6b85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:18.968675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1387/2773] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:18.974290 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe499f7-3e20-4b42-a55a-ac2f7cc6b85b None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:18.985635 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe499f7-3e20-4b42-a55a-ac2f7cc6b85b None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:18.991250 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e067f6-ee79-4f28-a893-364b7d7c428a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:18.993291 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e067f6-ee79-4f28-a893-364b7d7c428a admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:18.993291 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e067f6-ee79-4f28-a893-364b7d7c428a admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:18.993291 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e067f6-ee79-4f28-a893-364b7d7c428a admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:18.993642 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e067f6-ee79-4f28-a893-364b7d7c428a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:46:18.994007 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e067f6-ee79-4f28-a893-364b7d7c428a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:18.995730 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e067f6-ee79-4f28-a893-364b7d7c428a admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:19.002722 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3e3fd-7be8-4325-a4d3-be0f430b34cc None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:19.006929 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fab26c-c2f5-4f4b-8d9f-983b82618ccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:19.007576 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fab26c-c2f5-4f4b-8d9f-983b82618ccc service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:19.007860 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fab26c-c2f5-4f4b-8d9f-983b82618ccc service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:19.008141 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fab26c-c2f5-4f4b-8d9f-983b82618ccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:19.009718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1388/2774] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:46:19.013491 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e067f6-ee79-4f28-a893-364b7d7c428a admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:19.022083 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fab26c-c2f5-4f4b-8d9f-983b82618ccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:19.023529 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e067f6-ee79-4f28-a893-364b7d7c428a admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:19.023831 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fab26c-c2f5-4f4b-8d9f-983b82618ccc service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:19.035137 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7338e-0ad0-4a2f-b96f-e4e3bcba7a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:19.035845 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7338e-0ad0-4a2f-b96f-e4e3bcba7a56 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:19.036585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7338e-0ad0-4a2f-b96f-e4e3bcba7a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:19.036965 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7338e-0ad0-4a2f-b96f-e4e3bcba7a56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:19.037816 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7338e-0ad0-4a2f-b96f-e4e3bcba7a56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:19.039941 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7338e-0ad0-4a2f-b96f-e4e3bcba7a56 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:19.046808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1387/2775] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:46:19.138392 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1389/2776] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:46:19 2022] POST /identity/v3/projects => generated 391 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:46:19.142867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fab26c-c2f5-4f4b-8d9f-983b82618ccc service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:19.154021 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fab26c-c2f5-4f4b-8d9f-983b82618ccc service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:19.211067 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e4a94-2855-40c3-bb5c-a9e0b99ffb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:19.214742 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e4a94-2855-40c3-bb5c-a9e0b99ffb98 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:19.214742 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e4a94-2855-40c3-bb5c-a9e0b99ffb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:19.214742 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e4a94-2855-40c3-bb5c-a9e0b99ffb98 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:19.214742 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e4a94-2855-40c3-bb5c-a9e0b99ffb98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:19.216466 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12e4a94-2855-40c3-bb5c-a9e0b99ffb98 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:19.292334 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1388/2777] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:46:19 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:46:19.296575 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7338e-0ad0-4a2f-b96f-e4e3bcba7a56 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:19.307543 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7338e-0ad0-4a2f-b96f-e4e3bcba7a56 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:19.312278 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d526ead-ef06-456f-ad5c-ad24af51e696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:19.313001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d526ead-ef06-456f-ad5c-ad24af51e696 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:19.313441 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d526ead-ef06-456f-ad5c-ad24af51e696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:19.318263 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d526ead-ef06-456f-ad5c-ad24af51e696 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:19.318263 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d526ead-ef06-456f-ad5c-ad24af51e696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:19.318263 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d526ead-ef06-456f-ad5c-ad24af51e696 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:19.327011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1390/2778] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:19.331017 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e4a94-2855-40c3-bb5c-a9e0b99ffb98 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:19.341468 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e4a94-2855-40c3-bb5c-a9e0b99ffb98 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:19.346617 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf549bf-64a8-4b0f-b307-492b9a6abad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:19.347270 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf549bf-64a8-4b0f-b307-492b9a6abad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:19.347553 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf549bf-64a8-4b0f-b307-492b9a6abad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:19.347827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf549bf-64a8-4b0f-b307-492b9a6abad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:19.348549 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf549bf-64a8-4b0f-b307-492b9a6abad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:19.350172 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf549bf-64a8-4b0f-b307-492b9a6abad6 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:19.360868 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1389/2779] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:19.364996 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d526ead-ef06-456f-ad5c-ad24af51e696 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:19.374955 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d526ead-ef06-456f-ad5c-ad24af51e696 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:19.379825 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff47d2d-29e4-4a72-9303-8337f9e4b79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:19.380710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff47d2d-29e4-4a72-9303-8337f9e4b79e admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:19.380993 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff47d2d-29e4-4a72-9303-8337f9e4b79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:19.381270 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff47d2d-29e4-4a72-9303-8337f9e4b79e admin admin] PATH_INFO: `/v3/projects/71b66caf946e4bc788874b37cfb812db/users/683c2c4f278c4541b1d87b4235190781/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:19.395853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff47d2d-29e4-4a72-9303-8337f9e4b79e admin admin] RBAC: Authorizing `identity:create_grant(project_id=71b66caf946e4bc788874b37cfb812db, user_id=683c2c4f278c4541b1d87b4235190781, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:19.398532 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff47d2d-29e4-4a72-9303-8337f9e4b79e admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:19.471587 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf549bf-64a8-4b0f-b307-492b9a6abad6 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:19.473387 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ebf549bf-64a8-4b0f-b307-492b9a6abad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:19.493273 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1391/2780] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:19 2022] PUT /identity/v3/projects/71b66caf946e4bc788874b37cfb812db/users/683c2c4f278c4541b1d87b4235190781/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:19.495104 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf549bf-64a8-4b0f-b307-492b9a6abad6 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:19.505087 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc175b2-eca9-4c26-9e20-527949682047 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:19.505428 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc175b2-eca9-4c26-9e20-527949682047 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:19.509948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc175b2-eca9-4c26-9e20-527949682047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:19.520979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:19.533513 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-8bc175b2-eca9-4c26-9e20-527949682047 None None] MFA Rules not processed for user `683c2c4f278c4541b1d87b4235190781`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:19.534780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-8bc175b2-eca9-4c26-9e20-527949682047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:19.539941 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:19.556827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00549453-f9f9-461d-800d-6fb73776d0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:19.557811 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00549453-f9f9-461d-800d-6fb73776d0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:19.558093 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00549453-f9f9-461d-800d-6fb73776d0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:19.558366 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00549453-f9f9-461d-800d-6fb73776d0df admin admin] PATH_INFO: `/v3/projects/c393a1fd24d940bfba00964f025b483c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:19.559563 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00549453-f9f9-461d-800d-6fb73776d0df admin admin] RBAC: Authorizing `identity:delete_project(project_id=c393a1fd24d940bfba00964f025b483c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:19.561469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00549453-f9f9-461d-800d-6fb73776d0df admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:19.598574 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1392/2781] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:19.603470 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc175b2-eca9-4c26-9e20-527949682047 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:19.613809 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc175b2-eca9-4c26-9e20-527949682047 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:19.618645 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489899d3-1602-4f55-b1d2-259b4c4889c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:19.619280 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489899d3-1602-4f55-b1d2-259b4c4889c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:19.619676 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489899d3-1602-4f55-b1d2-259b4c4889c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:19.620204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489899d3-1602-4f55-b1d2-259b4c4889c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:19.620919 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489899d3-1602-4f55-b1d2-259b4c4889c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:19.622816 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489899d3-1602-4f55-b1d2-259b4c4889c2 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:19.667922 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-00549453-f9f9-461d-800d-6fb73776d0df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c393a1fd24d940bfba00964f025b483c', 'request_id': 'req-00549453-f9f9-461d-800d-6fb73776d0df'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:19.673494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-00549453-f9f9-461d-800d-6fb73776d0df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c393a1fd24d940bfba00964f025b483c', 'request_id': 'req-00549453-f9f9-461d-800d-6fb73776d0df'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:19.743155 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1393/2782] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:46:19 2022] POST /identity/v3/projects => generated 393 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:46:19.747439 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489899d3-1602-4f55-b1d2-259b4c4889c2 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:19.782349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-00549453-f9f9-461d-800d-6fb73776d0df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c393a1fd24d940bfba00964f025b483c', 'request_id': 'req-00549453-f9f9-461d-800d-6fb73776d0df'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:19.794724 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-00549453-f9f9-461d-800d-6fb73776d0df admin admin] The token cache is being invalidate because project c393a1fd24d940bfba00964f025b483c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:19.794994 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-00549453-f9f9-461d-800d-6fb73776d0df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:19.795659 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-00549453-f9f9-461d-800d-6fb73776d0df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:19.797271 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1390/2783] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:19 2022] DELETE /identity/v3/projects/c393a1fd24d940bfba00964f025b483c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:19.802151 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dd666-efb9-4a24-99a5-19f643221c82 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:19.802440 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dd666-efb9-4a24-99a5-19f643221c82 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:19.802716 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dd666-efb9-4a24-99a5-19f643221c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:19.808751 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489899d3-1602-4f55-b1d2-259b4c4889c2 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:19.813785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b6cd9-5d3a-4aed-9d66-aaed9e88bd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:19.814452 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b6cd9-5d3a-4aed-9d66-aaed9e88bd88 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:19.814737 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b6cd9-5d3a-4aed-9d66-aaed9e88bd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:19.815014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b6cd9-5d3a-4aed-9d66-aaed9e88bd88 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:19.815701 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b6cd9-5d3a-4aed-9d66-aaed9e88bd88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:19.817923 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b6cd9-5d3a-4aed-9d66-aaed9e88bd88 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:19.820057 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-599dd666-efb9-4a24-99a5-19f643221c82 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:19.821831 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-599dd666-efb9-4a24-99a5-19f643221c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:19.829821 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1391/2784] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:19.838049 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d070f7-dd24-4215-bdd4-c2ac616672a3 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:19.838335 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d070f7-dd24-4215-bdd4-c2ac616672a3 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:19.838611 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d070f7-dd24-4215-bdd4-c2ac616672a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:19.857408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-41d070f7-dd24-4215-bdd4-c2ac616672a3 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:19.858811 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-41d070f7-dd24-4215-bdd4-c2ac616672a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:19.867396 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1392/2785] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:19.873581 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d070f7-dd24-4215-bdd4-c2ac616672a3 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:19.880318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d070f7-dd24-4215-bdd4-c2ac616672a3 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:19.885510 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e463c-55d1-4d3b-854d-2d2241deca73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:19.886155 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e463c-55d1-4d3b-854d-2d2241deca73 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:19.886438 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e463c-55d1-4d3b-854d-2d2241deca73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:19.886712 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e463c-55d1-4d3b-854d-2d2241deca73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:19.887425 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e463c-55d1-4d3b-854d-2d2241deca73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:46:19.887731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e463c-55d1-4d3b-854d-2d2241deca73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:19.889304 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e463c-55d1-4d3b-854d-2d2241deca73 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:19.892065 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:19.901100 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1393/2786] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 08:46:19.905068 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e463c-55d1-4d3b-854d-2d2241deca73 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:19.914809 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e463c-55d1-4d3b-854d-2d2241deca73 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:19.919642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f22e69-826b-4f81-8b28-e3edabad55cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:19.920283 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f22e69-826b-4f81-8b28-e3edabad55cf admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:19.920568 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f22e69-826b-4f81-8b28-e3edabad55cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:19.920845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f22e69-826b-4f81-8b28-e3edabad55cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:19.921550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f22e69-826b-4f81-8b28-e3edabad55cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:19.922269 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1394/2787] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:46:19 2022] POST /identity/v3/users => generated 303 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:46:19.923021 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b6cd9-5d3a-4aed-9d66-aaed9e88bd88 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:19.923456 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f22e69-826b-4f81-8b28-e3edabad55cf admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:19.924710 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-bc5b6cd9-5d3a-4aed-9d66-aaed9e88bd88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:19.939193 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b6cd9-5d3a-4aed-9d66-aaed9e88bd88 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:19.944180 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1412276-e715-44d3-86fb-82e2af46831f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:19.944842 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1412276-e715-44d3-86fb-82e2af46831f admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:19.945126 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1412276-e715-44d3-86fb-82e2af46831f admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:19.945539 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1412276-e715-44d3-86fb-82e2af46831f admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:19.946826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1412276-e715-44d3-86fb-82e2af46831f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:19.949706 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1412276-e715-44d3-86fb-82e2af46831f admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:19.964020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1395/2788] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:19.967748 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1412276-e715-44d3-86fb-82e2af46831f admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:19.977051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1412276-e715-44d3-86fb-82e2af46831f admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:19.981742 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d4221-0875-42f2-ad07-59314a2b1bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:19.982580 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d4221-0875-42f2-ad07-59314a2b1bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:19.983104 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d4221-0875-42f2-ad07-59314a2b1bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:19.983387 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d4221-0875-42f2-ad07-59314a2b1bb8 admin admin] PATH_INFO: `/v3/projects/c2ad172db00a4d88b8238601b830b8de/users/562f37f1bf2e4945bb6fc944688d583d/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:19.997821 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d4221-0875-42f2-ad07-59314a2b1bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2ad172db00a4d88b8238601b830b8de, user_id=562f37f1bf2e4945bb6fc944688d583d, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:20.000573 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d4221-0875-42f2-ad07-59314a2b1bb8 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:20.018455 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1394/2789] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:46:19 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:46:20.021363 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:20.022490 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f22e69-826b-4f81-8b28-e3edabad55cf admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:20.084203 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f22e69-826b-4f81-8b28-e3edabad55cf admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:20.089492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4056490-f7a5-462d-8eae-ade4c3d9b0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:20.090228 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4056490-f7a5-462d-8eae-ade4c3d9b0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:20.090542 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4056490-f7a5-462d-8eae-ade4c3d9b0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:20.090819 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4056490-f7a5-462d-8eae-ade4c3d9b0e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:20.091518 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4056490-f7a5-462d-8eae-ade4c3d9b0e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:20.093445 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4056490-f7a5-462d-8eae-ade4c3d9b0e7 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:20.121376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1396/2790] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:19 2022] PUT /identity/v3/projects/c2ad172db00a4d88b8238601b830b8de/users/562f37f1bf2e4945bb6fc944688d583d/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:20.125362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d4221-0875-42f2-ad07-59314a2b1bb8 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:20.193352 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d4221-0875-42f2-ad07-59314a2b1bb8 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:20.201055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1395/2791] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:46:20 2022] POST /identity/v3/users => generated 295 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:46:20.202702 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4056490-f7a5-462d-8eae-ade4c3d9b0e7 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:20.204393 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa46a1-6a4a-448a-88ad-90ef126969b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:20.205129 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa46a1-6a4a-448a-88ad-90ef126969b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:20.205401 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa46a1-6a4a-448a-88ad-90ef126969b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:20.205751 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa46a1-6a4a-448a-88ad-90ef126969b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:20.206994 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa46a1-6a4a-448a-88ad-90ef126969b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:20.208299 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa46a1-6a4a-448a-88ad-90ef126969b3 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:20.221767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1397/2792] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:20.222042 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4056490-f7a5-462d-8eae-ade4c3d9b0e7 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:20.225088 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa46a1-6a4a-448a-88ad-90ef126969b3 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:20.226821 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ea7a0-83bb-4c5e-80e9-95e7fe87d61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:20.228581 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ea7a0-83bb-4c5e-80e9-95e7fe87d61a admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:20.228902 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ea7a0-83bb-4c5e-80e9-95e7fe87d61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:20.229243 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ea7a0-83bb-4c5e-80e9-95e7fe87d61a admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:20.230109 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ea7a0-83bb-4c5e-80e9-95e7fe87d61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:20.231749 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ea7a0-83bb-4c5e-80e9-95e7fe87d61a admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:20.237281 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa46a1-6a4a-448a-88ad-90ef126969b3 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:20.243191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1396/2793] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:20.243827 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57a5f3-dc47-4c95-ab1a-66f7d8788702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:20.245115 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57a5f3-dc47-4c95-ab1a-66f7d8788702 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:20.245628 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57a5f3-dc47-4c95-ab1a-66f7d8788702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:20.246129 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57a5f3-dc47-4c95-ab1a-66f7d8788702 admin admin] PATH_INFO: `/v3/projects/c2ad172db00a4d88b8238601b830b8de/users/562f37f1bf2e4945bb6fc944688d583d/roles/beed8caad097496292e544146859df5c` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:20.247564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ea7a0-83bb-4c5e-80e9-95e7fe87d61a admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:20.249555 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57a5f3-dc47-4c95-ab1a-66f7d8788702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2ad172db00a4d88b8238601b830b8de, user_id=562f37f1bf2e4945bb6fc944688d583d, role_id=beed8caad097496292e544146859df5c)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:20.252474 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57a5f3-dc47-4c95-ab1a-66f7d8788702 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:20.258077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ea7a0-83bb-4c5e-80e9-95e7fe87d61a admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:20.273854 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1398/2794] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:20 2022] PUT /identity/v3/projects/c2ad172db00a4d88b8238601b830b8de/users/562f37f1bf2e4945bb6fc944688d583d/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:20.276219 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693df69-ba40-4052-aeeb-d98c50ffdcf5 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:20.276705 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693df69-ba40-4052-aeeb-d98c50ffdcf5 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:20.277194 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693df69-ba40-4052-aeeb-d98c50ffdcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:20.309098 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-4693df69-ba40-4052-aeeb-d98c50ffdcf5 None None] MFA Rules not processed for user `562f37f1bf2e4945bb6fc944688d583d`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:20.310744 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4693df69-ba40-4052-aeeb-d98c50ffdcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:20.320471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:20.322380 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8975ad9-9518-49e5-a36d-3558bb5422cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:20.324213 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8975ad9-9518-49e5-a36d-3558bb5422cf admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:20.324486 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8975ad9-9518-49e5-a36d-3558bb5422cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:20.324766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8975ad9-9518-49e5-a36d-3558bb5422cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:20.325702 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8975ad9-9518-49e5-a36d-3558bb5422cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:20.327335 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8975ad9-9518-49e5-a36d-3558bb5422cf admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:20.338606 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1397/2795] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:20.342618 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8975ad9-9518-49e5-a36d-3558bb5422cf admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:20.353255 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:20.353491 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8975ad9-9518-49e5-a36d-3558bb5422cf admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:20.358809 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e086e0-7fb5-4827-8175-4398edcb1822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:20.359707 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e086e0-7fb5-4827-8175-4398edcb1822 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:20.359996 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e086e0-7fb5-4827-8175-4398edcb1822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:20.360276 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e086e0-7fb5-4827-8175-4398edcb1822 admin admin] PATH_INFO: `/v3/projects/449d0f44f551475e89836f61ccd5a375/users/b539c4bab15c430d8d49f57a826c454a/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:20.379071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e086e0-7fb5-4827-8175-4398edcb1822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=449d0f44f551475e89836f61ccd5a375, user_id=b539c4bab15c430d8d49f57a826c454a, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:20.379586 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e086e0-7fb5-4827-8175-4398edcb1822 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:20.387245 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1399/2796] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:20.399206 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693df69-ba40-4052-aeeb-d98c50ffdcf5 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:20.402592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4693df69-ba40-4052-aeeb-d98c50ffdcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:20.457447 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693df69-ba40-4052-aeeb-d98c50ffdcf5 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:20.461290 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70011f1-ae48-4588-b6cd-dcdb59ee9f3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:20.462078 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70011f1-ae48-4588-b6cd-dcdb59ee9f3c service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:20.462430 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70011f1-ae48-4588-b6cd-dcdb59ee9f3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:20.462769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70011f1-ae48-4588-b6cd-dcdb59ee9f3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:20.469461 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1398/2797] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:20 2022] PUT /identity/v3/projects/449d0f44f551475e89836f61ccd5a375/users/b539c4bab15c430d8d49f57a826c454a/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:20.480136 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70011f1-ae48-4588-b6cd-dcdb59ee9f3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:20.480136 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70011f1-ae48-4588-b6cd-dcdb59ee9f3c service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:20.481601 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233bcf0-22e9-4c62-a864-5cb0d4932a13 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:20.481914 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233bcf0-22e9-4c62-a864-5cb0d4932a13 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:20.482177 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e233bcf0-22e9-4c62-a864-5cb0d4932a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:20.490884 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1400/2798] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:46:20.518468 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-e233bcf0-22e9-4c62-a864-5cb0d4932a13 None None] MFA Rules not processed for user `b539c4bab15c430d8d49f57a826c454a`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:20.520250 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-e233bcf0-22e9-4c62-a864-5cb0d4932a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:20.537322 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70011f1-ae48-4588-b6cd-dcdb59ee9f3c service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:20.539045 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-d70011f1-ae48-4588-b6cd-dcdb59ee9f3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:20.551778 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70011f1-ae48-4588-b6cd-dcdb59ee9f3c service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:20.597245 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1399/2799] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:20.611471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233bcf0-22e9-4c62-a864-5cb0d4932a13 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:20.611672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de578ad6-9603-4f5d-9667-c6fc859cdfc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:20.612559 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de578ad6-9603-4f5d-9667-c6fc859cdfc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:20.612849 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de578ad6-9603-4f5d-9667-c6fc859cdfc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:20.613136 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de578ad6-9603-4f5d-9667-c6fc859cdfc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:20.615017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-de578ad6-9603-4f5d-9667-c6fc859cdfc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:20.622774 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e233bcf0-22e9-4c62-a864-5cb0d4932a13 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:20.626594 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba24c29-54a7-4d80-a86d-1f9e27f497db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:20.627329 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba24c29-54a7-4d80-a86d-1f9e27f497db service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:20.627689 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba24c29-54a7-4d80-a86d-1f9e27f497db service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:20.628035 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba24c29-54a7-4d80-a86d-1f9e27f497db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:20.641155 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba24c29-54a7-4d80-a86d-1f9e27f497db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:20.641155 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba24c29-54a7-4d80-a86d-1f9e27f497db service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:20.648225 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1400/2800] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:46:20.684516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de578ad6-9603-4f5d-9667-c6fc859cdfc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:20.686172 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de578ad6-9603-4f5d-9667-c6fc859cdfc0 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:20.695536 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1401/2801] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:46:27.531427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba24c29-54a7-4d80-a86d-1f9e27f497db service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:27.633006 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba24c29-54a7-4d80-a86d-1f9e27f497db service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:27.638824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc585a-0a5c-4269-8579-c396e1bc9785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:27.639699 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc585a-0a5c-4269-8579-c396e1bc9785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:27.639982 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc585a-0a5c-4269-8579-c396e1bc9785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:27.640261 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc585a-0a5c-4269-8579-c396e1bc9785 admin admin] PATH_INFO: `/v3/users/683c2c4f278c4541b1d87b4235190781` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:27.642029 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc585a-0a5c-4269-8579-c396e1bc9785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=683c2c4f278c4541b1d87b4235190781)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:27.644022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc585a-0a5c-4269-8579-c396e1bc9785 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:27.660571 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:27.808375 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-05bc585a-0a5c-4269-8579-c396e1bc9785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '683c2c4f278c4541b1d87b4235190781'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:27.820340 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-05bc585a-0a5c-4269-8579-c396e1bc9785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '683c2c4f278c4541b1d87b4235190781'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:27.828123 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-05bc585a-0a5c-4269-8579-c396e1bc9785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '683c2c4f278c4541b1d87b4235190781'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:27.828895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-05bc585a-0a5c-4269-8579-c396e1bc9785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '683c2c4f278c4541b1d87b4235190781'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:27.829567 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-05bc585a-0a5c-4269-8579-c396e1bc9785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '683c2c4f278c4541b1d87b4235190781'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:27.879820 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1401/2802] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:27 2022] DELETE /identity/v3/users/683c2c4f278c4541b1d87b4235190781 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:27.885294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfe059-0878-419d-93ae-a3981e8a0b55 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:27.885808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfe059-0878-419d-93ae-a3981e8a0b55 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:27.885931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dfe059-0878-419d-93ae-a3981e8a0b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:27.904161 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-c9dfe059-0878-419d-93ae-a3981e8a0b55 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:27.905387 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-c9dfe059-0878-419d-93ae-a3981e8a0b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:27.937137 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=100 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:27.969375 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1402/2803] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:27.979862 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc585a-0a5c-4269-8579-c396e1bc9785 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:27.981508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-05bc585a-0a5c-4269-8579-c396e1bc9785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:28.038359 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc585a-0a5c-4269-8579-c396e1bc9785 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:28.042704 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c64797-6db2-4755-b61f-8539145db53a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:28.043355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c64797-6db2-4755-b61f-8539145db53a service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:28.043645 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c64797-6db2-4755-b61f-8539145db53a service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:28.043912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c64797-6db2-4755-b61f-8539145db53a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:28.057417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c64797-6db2-4755-b61f-8539145db53a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:28.057417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c64797-6db2-4755-b61f-8539145db53a service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:28.070015 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1402/2804] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:46:28.498763 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfe059-0878-419d-93ae-a3981e8a0b55 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:28.500300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-c9dfe059-0878-419d-93ae-a3981e8a0b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:28.512574 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dfe059-0878-419d-93ae-a3981e8a0b55 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:28.517123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b875f13-da13-412d-bd5c-b332ff6791af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:28.518021 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b875f13-da13-412d-bd5c-b332ff6791af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:28.518382 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b875f13-da13-412d-bd5c-b332ff6791af admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:28.518659 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b875f13-da13-412d-bd5c-b332ff6791af admin admin] PATH_INFO: `/v3/projects/71b66caf946e4bc788874b37cfb812db` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:28.519891 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b875f13-da13-412d-bd5c-b332ff6791af admin admin] RBAC: Authorizing `identity:delete_project(project_id=71b66caf946e4bc788874b37cfb812db)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:28.521826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b875f13-da13-412d-bd5c-b332ff6791af admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:28.642519 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4b875f13-da13-412d-bd5c-b332ff6791af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71b66caf946e4bc788874b37cfb812db', 'request_id': 'req-4b875f13-da13-412d-bd5c-b332ff6791af'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:28.651338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4b875f13-da13-412d-bd5c-b332ff6791af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71b66caf946e4bc788874b37cfb812db', 'request_id': 'req-4b875f13-da13-412d-bd5c-b332ff6791af'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:28.657134 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4b875f13-da13-412d-bd5c-b332ff6791af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71b66caf946e4bc788874b37cfb812db', 'request_id': 'req-4b875f13-da13-412d-bd5c-b332ff6791af'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:28.732868 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4b875f13-da13-412d-bd5c-b332ff6791af admin admin] The token cache is being invalidate because project 71b66caf946e4bc788874b37cfb812db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:28.733345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4b875f13-da13-412d-bd5c-b332ff6791af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:28.733979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-4b875f13-da13-412d-bd5c-b332ff6791af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:28.735606 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1403/2805] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:28 2022] DELETE /identity/v3/projects/71b66caf946e4bc788874b37cfb812db => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:28.740215 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c64797-6db2-4755-b61f-8539145db53a service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:28.750173 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c64797-6db2-4755-b61f-8539145db53a service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:28.812795 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3774c4-1ff4-4658-b9cf-a7cbe0bbce86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:28.813689 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3774c4-1ff4-4658-b9cf-a7cbe0bbce86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:28.813975 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3774c4-1ff4-4658-b9cf-a7cbe0bbce86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:28.814251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3774c4-1ff4-4658-b9cf-a7cbe0bbce86 admin admin] PATH_INFO: `/v3/users/562f37f1bf2e4945bb6fc944688d583d` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:28.815427 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3774c4-1ff4-4658-b9cf-a7cbe0bbce86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=562f37f1bf2e4945bb6fc944688d583d)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:28.817363 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3774c4-1ff4-4658-b9cf-a7cbe0bbce86 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:29.029450 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:29.037480 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9b3774c4-1ff4-4658-b9cf-a7cbe0bbce86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '562f37f1bf2e4945bb6fc944688d583d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:29.048989 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9b3774c4-1ff4-4658-b9cf-a7cbe0bbce86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '562f37f1bf2e4945bb6fc944688d583d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:29.058775 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9b3774c4-1ff4-4658-b9cf-a7cbe0bbce86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '562f37f1bf2e4945bb6fc944688d583d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:29.059484 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9b3774c4-1ff4-4658-b9cf-a7cbe0bbce86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '562f37f1bf2e4945bb6fc944688d583d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:29.060099 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9b3774c4-1ff4-4658-b9cf-a7cbe0bbce86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '562f37f1bf2e4945bb6fc944688d583d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:29.120815 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1403/2806] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:28 2022] DELETE /identity/v3/users/562f37f1bf2e4945bb6fc944688d583d => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:29.536964 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b875f13-da13-412d-bd5c-b332ff6791af admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:29.538491 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-4b875f13-da13-412d-bd5c-b332ff6791af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:29.552778 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b875f13-da13-412d-bd5c-b332ff6791af admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:29.610860 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bf74f-c888-4cd3-8f58-ab7ea20bd82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:29.611721 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bf74f-c888-4cd3-8f58-ab7ea20bd82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:29.612001 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bf74f-c888-4cd3-8f58-ab7ea20bd82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:29.612272 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bf74f-c888-4cd3-8f58-ab7ea20bd82a admin admin] PATH_INFO: `/v3/projects/c2ad172db00a4d88b8238601b830b8de` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:29.613430 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bf74f-c888-4cd3-8f58-ab7ea20bd82a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2ad172db00a4d88b8238601b830b8de)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:29.615352 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bf74f-c888-4cd3-8f58-ab7ea20bd82a admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:29.715481 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3f9bf74f-c888-4cd3-8f58-ab7ea20bd82a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2ad172db00a4d88b8238601b830b8de', 'request_id': 'req-3f9bf74f-c888-4cd3-8f58-ab7ea20bd82a'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:29.721512 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3f9bf74f-c888-4cd3-8f58-ab7ea20bd82a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2ad172db00a4d88b8238601b830b8de', 'request_id': 'req-3f9bf74f-c888-4cd3-8f58-ab7ea20bd82a'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:29.723561 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:29.727386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3f9bf74f-c888-4cd3-8f58-ab7ea20bd82a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2ad172db00a4d88b8238601b830b8de', 'request_id': 'req-3f9bf74f-c888-4cd3-8f58-ab7ea20bd82a'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:29.821022 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3f9bf74f-c888-4cd3-8f58-ab7ea20bd82a admin admin] The token cache is being invalidate because project c2ad172db00a4d88b8238601b830b8de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:29.821246 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3f9bf74f-c888-4cd3-8f58-ab7ea20bd82a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:29.821897 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-3f9bf74f-c888-4cd3-8f58-ab7ea20bd82a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:29.823467 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1404/2807] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:29 2022] DELETE /identity/v3/projects/c2ad172db00a4d88b8238601b830b8de => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:29.828888 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebbe5b-41bf-4b5f-815d-b24e4c6a4cda None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:29.829389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebbe5b-41bf-4b5f-815d-b24e4c6a4cda None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:29.829478 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ebbe5b-41bf-4b5f-815d-b24e4c6a4cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:29.847949 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-61ebbe5b-41bf-4b5f-815d-b24e4c6a4cda None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:29.849181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-61ebbe5b-41bf-4b5f-815d-b24e4c6a4cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:29.909335 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1404/2808] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:29.917614 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249e242-95d6-4171-89a9-e1ab14d93a5b None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:29.917904 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249e242-95d6-4171-89a9-e1ab14d93a5b None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:29.918179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249e242-95d6-4171-89a9-e1ab14d93a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:29.936930 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-6249e242-95d6-4171-89a9-e1ab14d93a5b None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:29.938168 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-6249e242-95d6-4171-89a9-e1ab14d93a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:29.946445 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1405/2809] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:29.950593 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebbe5b-41bf-4b5f-815d-b24e4c6a4cda None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:29.960571 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ebbe5b-41bf-4b5f-815d-b24e4c6a4cda None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:29.965909 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b2f5f-697e-4d23-acb9-985ac265956d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:29.966558 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b2f5f-697e-4d23-acb9-985ac265956d admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:29.966843 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b2f5f-697e-4d23-acb9-985ac265956d admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:29.967120 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b2f5f-697e-4d23-acb9-985ac265956d admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:29.967851 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b2f5f-697e-4d23-acb9-985ac265956d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:46:29.968157 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b2f5f-697e-4d23-acb9-985ac265956d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:29.969766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b2f5f-697e-4d23-acb9-985ac265956d admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:29.982336 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1405/2810] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:46:29.986908 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249e242-95d6-4171-89a9-e1ab14d93a5b None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:29.996267 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6249e242-95d6-4171-89a9-e1ab14d93a5b None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:30.001262 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc0f48-4e79-4979-af69-f8eb6d6d8ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:30.001988 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc0f48-4e79-4979-af69-f8eb6d6d8ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:30.002274 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc0f48-4e79-4979-af69-f8eb6d6d8ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:30.002552 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbc0f48-4e79-4979-af69-f8eb6d6d8ed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:30.003253 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc0f48-4e79-4979-af69-f8eb6d6d8ed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:30.005204 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbc0f48-4e79-4979-af69-f8eb6d6d8ed1 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:30.102906 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b2f5f-697e-4d23-acb9-985ac265956d admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:30.104719 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-822b2f5f-697e-4d23-acb9-985ac265956d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:30.121828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1406/2811] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:46:29 2022] POST /identity/v3/projects => generated 399 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:46:30.131904 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc0f48-4e79-4979-af69-f8eb6d6d8ed1 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:30.174254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b2f5f-697e-4d23-acb9-985ac265956d admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:30.208322 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbc0f48-4e79-4979-af69-f8eb6d6d8ed1 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:30.214323 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e15f7-c923-45a5-acc0-cfa0b875dc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:30.214999 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e15f7-c923-45a5-acc0-cfa0b875dc81 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:30.215286 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e15f7-c923-45a5-acc0-cfa0b875dc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:30.215570 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e15f7-c923-45a5-acc0-cfa0b875dc81 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:30.216261 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e15f7-c923-45a5-acc0-cfa0b875dc81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:30.218260 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e15f7-c923-45a5-acc0-cfa0b875dc81 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:30.226468 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f73d53-3536-40d4-ba62-4ae0c60095b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:30.227184 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f73d53-3536-40d4-ba62-4ae0c60095b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:30.228043 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f73d53-3536-40d4-ba62-4ae0c60095b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:30.228389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f73d53-3536-40d4-ba62-4ae0c60095b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:30.230292 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-98f73d53-3536-40d4-ba62-4ae0c60095b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:30.240697 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:30.295837 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f73d53-3536-40d4-ba62-4ae0c60095b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:30.297282 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f73d53-3536-40d4-ba62-4ae0c60095b6 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:30.298155 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1407/2812] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:46:30 2022] POST /identity/v3/users => generated 300 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 08:46:30.302261 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e15f7-c923-45a5-acc0-cfa0b875dc81 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:30.311827 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1406/2813] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:46:30.318608 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e15f7-c923-45a5-acc0-cfa0b875dc81 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:30.324130 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e083e2-f112-4f3a-9cc8-86c7f8699f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:30.324130 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e083e2-f112-4f3a-9cc8-86c7f8699f24 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:30.324383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e083e2-f112-4f3a-9cc8-86c7f8699f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:30.324675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e083e2-f112-4f3a-9cc8-86c7f8699f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:30.325612 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e083e2-f112-4f3a-9cc8-86c7f8699f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:30.327295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e083e2-f112-4f3a-9cc8-86c7f8699f24 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:30.338525 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1408/2814] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 08:46:30.342460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f73d53-3536-40d4-ba62-4ae0c60095b6 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:30.356579 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f73d53-3536-40d4-ba62-4ae0c60095b6 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:30.359114 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b733749-98a6-4d05-8188-9cacc91274e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:30.359785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b733749-98a6-4d05-8188-9cacc91274e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:30.360070 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b733749-98a6-4d05-8188-9cacc91274e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:30.360349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b733749-98a6-4d05-8188-9cacc91274e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:30.361093 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b733749-98a6-4d05-8188-9cacc91274e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:30.362705 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b733749-98a6-4d05-8188-9cacc91274e2 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:30.374867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1407/2815] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:30.378557 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e083e2-f112-4f3a-9cc8-86c7f8699f24 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:30.388645 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e083e2-f112-4f3a-9cc8-86c7f8699f24 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:30.393424 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b61ba-6ac8-4db3-9b53-cecbe5a889fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:30.394339 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b61ba-6ac8-4db3-9b53-cecbe5a889fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:30.394626 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b61ba-6ac8-4db3-9b53-cecbe5a889fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:30.394906 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b61ba-6ac8-4db3-9b53-cecbe5a889fb admin admin] PATH_INFO: `/v3/projects/ef5ec2e15a7140749d3bd1101852d2ff/users/d2230b808c6647c6b6cbc701b48c2e9b/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:30.410178 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b61ba-6ac8-4db3-9b53-cecbe5a889fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5ec2e15a7140749d3bd1101852d2ff, user_id=d2230b808c6647c6b6cbc701b48c2e9b, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:30.412854 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817b61ba-6ac8-4db3-9b53-cecbe5a889fb admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:30.501768 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1409/2816] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:30 2022] PUT /identity/v3/projects/ef5ec2e15a7140749d3bd1101852d2ff/users/d2230b808c6647c6b6cbc701b48c2e9b/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:30.513833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d1acd-88e5-439c-9f45-a3b5d998913f None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:30.513972 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d1acd-88e5-439c-9f45-a3b5d998913f None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:30.514189 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d1acd-88e5-439c-9f45-a3b5d998913f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:30.544230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-a98d1acd-88e5-439c-9f45-a3b5d998913f None None] MFA Rules not processed for user `d2230b808c6647c6b6cbc701b48c2e9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:30.545600 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a98d1acd-88e5-439c-9f45-a3b5d998913f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:30.623302 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1408/2817] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:30.627753 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b61ba-6ac8-4db3-9b53-cecbe5a889fb admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:30.692156 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b61ba-6ac8-4db3-9b53-cecbe5a889fb admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:30.696819 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25601efa-08a8-4754-b725-cab2cf12135a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:30.697590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25601efa-08a8-4754-b725-cab2cf12135a admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:30.697895 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25601efa-08a8-4754-b725-cab2cf12135a admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:30.698081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25601efa-08a8-4754-b725-cab2cf12135a admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:30.698893 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25601efa-08a8-4754-b725-cab2cf12135a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:30.700833 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25601efa-08a8-4754-b725-cab2cf12135a admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:30.715373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=91,keystone:DELETE=2,keystone:INSERT=7 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:30.824327 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1410/2818] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:46:30 2022] POST /identity/v3/projects => generated 399 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:46:30.828503 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d1acd-88e5-439c-9f45-a3b5d998913f None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:30.840681 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d1acd-88e5-439c-9f45-a3b5d998913f None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:30.898911 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54265951-1dcb-4130-9d65-d6686b33c5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:30.900389 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54265951-1dcb-4130-9d65-d6686b33c5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:30.900673 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54265951-1dcb-4130-9d65-d6686b33c5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:30.900946 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54265951-1dcb-4130-9d65-d6686b33c5a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:30.901689 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54265951-1dcb-4130-9d65-d6686b33c5a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:30.903706 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54265951-1dcb-4130-9d65-d6686b33c5a9 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:30.970412 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1409/2819] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:46:30 2022] POST /identity/v3/users => generated 306 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:46:30.974490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25601efa-08a8-4754-b725-cab2cf12135a admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:30.986249 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25601efa-08a8-4754-b725-cab2cf12135a admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:30.991045 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad8621-3e7a-4843-aa0a-f4758f394b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:30.991692 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad8621-3e7a-4843-aa0a-f4758f394b98 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:30.991976 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad8621-3e7a-4843-aa0a-f4758f394b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:30.992254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad8621-3e7a-4843-aa0a-f4758f394b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:30.993010 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad8621-3e7a-4843-aa0a-f4758f394b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:30.994664 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad8621-3e7a-4843-aa0a-f4758f394b98 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:31.006222 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1411/2820] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:31.011007 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54265951-1dcb-4130-9d65-d6686b33c5a9 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:31.023034 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54265951-1dcb-4130-9d65-d6686b33c5a9 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:31.028693 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42277d3-79c3-4be2-9350-6771753f6bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:31.029642 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42277d3-79c3-4be2-9350-6771753f6bea admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:31.029930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42277d3-79c3-4be2-9350-6771753f6bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:31.030212 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42277d3-79c3-4be2-9350-6771753f6bea admin admin] PATH_INFO: `/v3/projects/23e73b8049314d23addcf9c4ad5a5061/users/b2d7c275378b450aa20b38d4b84417b4/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:31.048487 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:31.052007 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42277d3-79c3-4be2-9350-6771753f6bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e73b8049314d23addcf9c4ad5a5061, user_id=b2d7c275378b450aa20b38d4b84417b4, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:31.055951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42277d3-79c3-4be2-9350-6771753f6bea admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:31.136845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1410/2821] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:31 2022] PUT /identity/v3/projects/23e73b8049314d23addcf9c4ad5a5061/users/b2d7c275378b450aa20b38d4b84417b4/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:31.140906 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad8621-3e7a-4843-aa0a-f4758f394b98 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:31.151653 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad8621-3e7a-4843-aa0a-f4758f394b98 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:31.207569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e62a1a-c750-4e7d-b0f3-add3b2eb2771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:31.208426 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e62a1a-c750-4e7d-b0f3-add3b2eb2771 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:31.208607 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e62a1a-c750-4e7d-b0f3-add3b2eb2771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:31.208850 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e62a1a-c750-4e7d-b0f3-add3b2eb2771 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:31.209610 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e62a1a-c750-4e7d-b0f3-add3b2eb2771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:31.211217 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e62a1a-c750-4e7d-b0f3-add3b2eb2771 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:31.223384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1412/2822] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:31.227497 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42277d3-79c3-4be2-9350-6771753f6bea admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:31.240064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42277d3-79c3-4be2-9350-6771753f6bea admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:31.245243 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441332b-3723-4beb-90d0-bebb1b270fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:31.246280 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441332b-3723-4beb-90d0-bebb1b270fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:31.246661 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441332b-3723-4beb-90d0-bebb1b270fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:31.247036 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441332b-3723-4beb-90d0-bebb1b270fb0 admin admin] PATH_INFO: `/v3/projects/23e73b8049314d23addcf9c4ad5a5061/users/b2d7c275378b450aa20b38d4b84417b4/roles/beed8caad097496292e544146859df5c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:31.251072 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441332b-3723-4beb-90d0-bebb1b270fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e73b8049314d23addcf9c4ad5a5061, user_id=b2d7c275378b450aa20b38d4b84417b4, role_id=beed8caad097496292e544146859df5c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:31.254125 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441332b-3723-4beb-90d0-bebb1b270fb0 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:31.265577 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1411/2823] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:31 2022] PUT /identity/v3/projects/23e73b8049314d23addcf9c4ad5a5061/users/b2d7c275378b450aa20b38d4b84417b4/roles/beed8caad097496292e544146859df5c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:31.276436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16035407-7b8d-49d1-a0fd-7d9bde6a3118 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:31.276762 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16035407-7b8d-49d1-a0fd-7d9bde6a3118 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:31.277063 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16035407-7b8d-49d1-a0fd-7d9bde6a3118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:31.303586 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-16035407-7b8d-49d1-a0fd-7d9bde6a3118 None None] MFA Rules not processed for user `b2d7c275378b450aa20b38d4b84417b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:31.304813 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-16035407-7b8d-49d1-a0fd-7d9bde6a3118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:31.375945 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1413/2824] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:31 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:31.387130 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441332b-3723-4beb-90d0-bebb1b270fb0 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:31.388794 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-1441332b-3723-4beb-90d0-bebb1b270fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:31.445635 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441332b-3723-4beb-90d0-bebb1b270fb0 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:31.450125 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d041f-87b9-4b5a-8ce0-e713e3d59935 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:31.450776 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d041f-87b9-4b5a-8ce0-e713e3d59935 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:31.451063 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d041f-87b9-4b5a-8ce0-e713e3d59935 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:31.451342 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d041f-87b9-4b5a-8ce0-e713e3d59935 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:31.461371 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d041f-87b9-4b5a-8ce0-e713e3d59935 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:31.462879 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d041f-87b9-4b5a-8ce0-e713e3d59935 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:31.472972 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1412/2825] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:31 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:46:31.704554 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16035407-7b8d-49d1-a0fd-7d9bde6a3118 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:31.718298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16035407-7b8d-49d1-a0fd-7d9bde6a3118 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:31.726344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751675a-4e35-4693-a790-d263d26f800f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:31.726344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751675a-4e35-4693-a790-d263d26f800f service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:31.726344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751675a-4e35-4693-a790-d263d26f800f service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:31.726344 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751675a-4e35-4693-a790-d263d26f800f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:31.794045 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751675a-4e35-4693-a790-d263d26f800f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:31.795496 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751675a-4e35-4693-a790-d263d26f800f service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:31.810523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1414/2826] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:46:37.031320 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d041f-87b9-4b5a-8ce0-e713e3d59935 service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:37.032864 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-3b0d041f-87b9-4b5a-8ce0-e713e3d59935 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:37.128224 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d041f-87b9-4b5a-8ce0-e713e3d59935 service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:37.133779 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937df95d-d315-468a-a601-d20518199dcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38b7e84d6a43efbb4c1a52e2b3e681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:37.134443 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937df95d-d315-468a-a601-d20518199dcc service placement] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:37.134730 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937df95d-d315-468a-a601-d20518199dcc service placement] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:37.135007 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937df95d-d315-468a-a601-d20518199dcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:37.136930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-937df95d-d315-468a-a601-d20518199dcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:37.150152 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937df95d-d315-468a-a601-d20518199dcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:37.151623 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937df95d-d315-468a-a601-d20518199dcc service placement] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:37.162090 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1413/2827] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:46:41.800623 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=98 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:42.220153 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751675a-4e35-4693-a790-d263d26f800f service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:42.289861 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751675a-4e35-4693-a790-d263d26f800f service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:42.295240 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d70a9c-4e56-47a4-96ab-3835789065fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:42.296124 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d70a9c-4e56-47a4-96ab-3835789065fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:42.296410 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d70a9c-4e56-47a4-96ab-3835789065fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:42.296679 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d70a9c-4e56-47a4-96ab-3835789065fa admin admin] PATH_INFO: `/v3/users/d2230b808c6647c6b6cbc701b48c2e9b` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:42.297865 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d70a9c-4e56-47a4-96ab-3835789065fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2230b808c6647c6b6cbc701b48c2e9b)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:42.299793 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d70a9c-4e56-47a4-96ab-3835789065fa admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:42.480507 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f3d70a9c-4e56-47a4-96ab-3835789065fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2230b808c6647c6b6cbc701b48c2e9b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:42.492590 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f3d70a9c-4e56-47a4-96ab-3835789065fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2230b808c6647c6b6cbc701b48c2e9b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:42.500083 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f3d70a9c-4e56-47a4-96ab-3835789065fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2230b808c6647c6b6cbc701b48c2e9b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:42.500771 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f3d70a9c-4e56-47a4-96ab-3835789065fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2230b808c6647c6b6cbc701b48c2e9b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:42.501384 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f3d70a9c-4e56-47a4-96ab-3835789065fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2230b808c6647c6b6cbc701b48c2e9b'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:42.568881 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1415/2828] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:42 2022] DELETE /identity/v3/users/d2230b808c6647c6b6cbc701b48c2e9b => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:42.574077 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa244d-a863-4c64-86e3-077b10540d7c None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:42.574546 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa244d-a863-4c64-86e3-077b10540d7c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:42.574844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa244d-a863-4c64-86e3-077b10540d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:42.591866 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-dcfa244d-a863-4c64-86e3-077b10540d7c None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:42.593066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-dcfa244d-a863-4c64-86e3-077b10540d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:42.644770 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:42.645604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d70a9c-4e56-47a4-96ab-3835789065fa admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:42.647039 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f3d70a9c-4e56-47a4-96ab-3835789065fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:42.659702 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1414/2829] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:42.669469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa244d-a863-4c64-86e3-077b10540d7c None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:42.671186 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-dcfa244d-a863-4c64-86e3-077b10540d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:42.714487 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d70a9c-4e56-47a4-96ab-3835789065fa admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:42.719230 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b15f3-85d5-4c8b-801d-7877a2d85d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:42.720112 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b15f3-85d5-4c8b-801d-7877a2d85d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:42.720396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b15f3-85d5-4c8b-801d-7877a2d85d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:42.720677 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b15f3-85d5-4c8b-801d-7877a2d85d90 admin admin] PATH_INFO: `/v3/users/b539c4bab15c430d8d49f57a826c454a` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:42.721906 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b15f3-85d5-4c8b-801d-7877a2d85d90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b539c4bab15c430d8d49f57a826c454a)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:42.723817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b15f3-85d5-4c8b-801d-7877a2d85d90 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:42.729514 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa244d-a863-4c64-86e3-077b10540d7c None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:42.733711 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e0e99-c115-4582-9ec5-ba347cbf2141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:42.734290 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e0e99-c115-4582-9ec5-ba347cbf2141 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:42.734578 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e0e99-c115-4582-9ec5-ba347cbf2141 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:42.734855 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e0e99-c115-4582-9ec5-ba347cbf2141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:42.745022 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e0e99-c115-4582-9ec5-ba347cbf2141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:42.746550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e0e99-c115-4582-9ec5-ba347cbf2141 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:42.748828 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:42.756841 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1415/2830] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:46:42.960307 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-b32b15f3-85d5-4c8b-801d-7877a2d85d90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b539c4bab15c430d8d49f57a826c454a'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:42.975404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-b32b15f3-85d5-4c8b-801d-7877a2d85d90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b539c4bab15c430d8d49f57a826c454a'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:42.992669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-b32b15f3-85d5-4c8b-801d-7877a2d85d90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b539c4bab15c430d8d49f57a826c454a'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:42.992669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-b32b15f3-85d5-4c8b-801d-7877a2d85d90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b539c4bab15c430d8d49f57a826c454a'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:42.992669 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-b32b15f3-85d5-4c8b-801d-7877a2d85d90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b539c4bab15c430d8d49f57a826c454a'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:43.069311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1416/2831] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:42 2022] DELETE /identity/v3/users/b539c4bab15c430d8d49f57a826c454a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:43.073822 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5c6ad-feff-4632-84cf-c3f14908a7d2 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:43.074122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5c6ad-feff-4632-84cf-c3f14908a7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:43.074404 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5c6ad-feff-4632-84cf-c3f14908a7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:43.091716 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-dbc5c6ad-feff-4632-84cf-c3f14908a7d2 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:43.092927 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-dbc5c6ad-feff-4632-84cf-c3f14908a7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:43.152834 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1416/2832] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:43.164357 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b15f3-85d5-4c8b-801d-7877a2d85d90 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:43.166325 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b32b15f3-85d5-4c8b-801d-7877a2d85d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:43.178483 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5c6ad-feff-4632-84cf-c3f14908a7d2 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:43.179874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-dbc5c6ad-feff-4632-84cf-c3f14908a7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:43.192930 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5c6ad-feff-4632-84cf-c3f14908a7d2 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:43.197602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cd55b-0333-4e82-accc-132920efd2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:43.198474 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cd55b-0333-4e82-accc-132920efd2d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:43.198755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cd55b-0333-4e82-accc-132920efd2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:43.199030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cd55b-0333-4e82-accc-132920efd2d2 admin admin] PATH_INFO: `/v3/projects/ef5ec2e15a7140749d3bd1101852d2ff` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:43.200214 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cd55b-0333-4e82-accc-132920efd2d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef5ec2e15a7140749d3bd1101852d2ff)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:43.202538 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cd55b-0333-4e82-accc-132920efd2d2 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:43.238522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b15f3-85d5-4c8b-801d-7877a2d85d90 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:43.242024 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb4243-c724-4b9b-a494-b6f75b0ae3b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:43.242673 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb4243-c724-4b9b-a494-b6f75b0ae3b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:43.242956 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb4243-c724-4b9b-a494-b6f75b0ae3b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:43.243234 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb4243-c724-4b9b-a494-b6f75b0ae3b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:43.252905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb4243-c724-4b9b-a494-b6f75b0ae3b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:43.254374 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb4243-c724-4b9b-a494-b6f75b0ae3b7 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:43.264008 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1417/2833] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:46:43.298995 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7a2cd55b-0333-4e82-accc-132920efd2d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef5ec2e15a7140749d3bd1101852d2ff', 'request_id': 'req-7a2cd55b-0333-4e82-accc-132920efd2d2'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:43.304785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7a2cd55b-0333-4e82-accc-132920efd2d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef5ec2e15a7140749d3bd1101852d2ff', 'request_id': 'req-7a2cd55b-0333-4e82-accc-132920efd2d2'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:43.381278 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7a2cd55b-0333-4e82-accc-132920efd2d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef5ec2e15a7140749d3bd1101852d2ff', 'request_id': 'req-7a2cd55b-0333-4e82-accc-132920efd2d2'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:43.392831 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7a2cd55b-0333-4e82-accc-132920efd2d2 admin admin] The token cache is being invalidate because project ef5ec2e15a7140749d3bd1101852d2ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:43.393112 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7a2cd55b-0333-4e82-accc-132920efd2d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:43.393771 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7a2cd55b-0333-4e82-accc-132920efd2d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:43.395509 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1417/2834] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:43 2022] DELETE /identity/v3/projects/ef5ec2e15a7140749d3bd1101852d2ff => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:43.399311 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb4243-c724-4b9b-a494-b6f75b0ae3b7 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:43.409583 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb4243-c724-4b9b-a494-b6f75b0ae3b7 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:43.466819 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7e08e-b105-408d-afe1-79c4eadbddba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:43.467707 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7e08e-b105-408d-afe1-79c4eadbddba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:43.467989 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7e08e-b105-408d-afe1-79c4eadbddba admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:43.468263 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7e08e-b105-408d-afe1-79c4eadbddba admin admin] PATH_INFO: `/v3/users/b2d7c275378b450aa20b38d4b84417b4` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:43.469461 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7e08e-b105-408d-afe1-79c4eadbddba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d7c275378b450aa20b38d4b84417b4)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:43.471887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7e08e-b105-408d-afe1-79c4eadbddba admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:43.679228 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:43.682517 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-edf7e08e-b105-408d-afe1-79c4eadbddba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d7c275378b450aa20b38d4b84417b4'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:43.694081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-edf7e08e-b105-408d-afe1-79c4eadbddba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d7c275378b450aa20b38d4b84417b4'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:43.701589 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-edf7e08e-b105-408d-afe1-79c4eadbddba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d7c275378b450aa20b38d4b84417b4'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:43.702288 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-edf7e08e-b105-408d-afe1-79c4eadbddba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d7c275378b450aa20b38d4b84417b4'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:43.708783 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-edf7e08e-b105-408d-afe1-79c4eadbddba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d7c275378b450aa20b38d4b84417b4'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:43.709552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cd55b-0333-4e82-accc-132920efd2d2 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:43.711065 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7a2cd55b-0333-4e82-accc-132920efd2d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:43.725478 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cd55b-0333-4e82-accc-132920efd2d2 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:43.738103 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b1b8da-a12b-4ace-b076-66d1e35116cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:43.738103 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1b8da-a12b-4ace-b076-66d1e35116cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:43.738103 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1b8da-a12b-4ace-b076-66d1e35116cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:43.738103 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b1b8da-a12b-4ace-b076-66d1e35116cb admin admin] PATH_INFO: `/v3/projects/449d0f44f551475e89836f61ccd5a375` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:43.738903 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1b8da-a12b-4ace-b076-66d1e35116cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=449d0f44f551475e89836f61ccd5a375)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:43.738903 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b1b8da-a12b-4ace-b076-66d1e35116cb admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:43.749812 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:43.804473 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1418/2835] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:43 2022] DELETE /identity/v3/users/b2d7c275378b450aa20b38d4b84417b4 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:43.875928 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-33b1b8da-a12b-4ace-b076-66d1e35116cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '449d0f44f551475e89836f61ccd5a375', 'request_id': 'req-33b1b8da-a12b-4ace-b076-66d1e35116cb'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:43.881502 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-33b1b8da-a12b-4ace-b076-66d1e35116cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '449d0f44f551475e89836f61ccd5a375', 'request_id': 'req-33b1b8da-a12b-4ace-b076-66d1e35116cb'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:43.943374 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-33b1b8da-a12b-4ace-b076-66d1e35116cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '449d0f44f551475e89836f61ccd5a375', 'request_id': 'req-33b1b8da-a12b-4ace-b076-66d1e35116cb'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:43.956085 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-33b1b8da-a12b-4ace-b076-66d1e35116cb admin admin] The token cache is being invalidate because project 449d0f44f551475e89836f61ccd5a375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:43.956379 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-33b1b8da-a12b-4ace-b076-66d1e35116cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:43.957028 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-33b1b8da-a12b-4ace-b076-66d1e35116cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:43.958609 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1418/2836] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:43 2022] DELETE /identity/v3/projects/449d0f44f551475e89836f61ccd5a375 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 08:46:44.191038 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7e08e-b105-408d-afe1-79c4eadbddba admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:44.192663 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-edf7e08e-b105-408d-afe1-79c4eadbddba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:44.264308 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7e08e-b105-408d-afe1-79c4eadbddba admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:44.318662 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828ee22-9b3e-4963-8001-d24875444948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:44.319446 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828ee22-9b3e-4963-8001-d24875444948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:44.319731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828ee22-9b3e-4963-8001-d24875444948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:44.320011 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828ee22-9b3e-4963-8001-d24875444948 admin admin] PATH_INFO: `/v3/projects/23e73b8049314d23addcf9c4ad5a5061` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:44.321190 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828ee22-9b3e-4963-8001-d24875444948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e73b8049314d23addcf9c4ad5a5061)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:44.323648 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828ee22-9b3e-4963-8001-d24875444948 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:44.416926 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f828ee22-9b3e-4963-8001-d24875444948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e73b8049314d23addcf9c4ad5a5061', 'request_id': 'req-f828ee22-9b3e-4963-8001-d24875444948'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:44.422934 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f828ee22-9b3e-4963-8001-d24875444948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e73b8049314d23addcf9c4ad5a5061', 'request_id': 'req-f828ee22-9b3e-4963-8001-d24875444948'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:44.428352 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f828ee22-9b3e-4963-8001-d24875444948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e73b8049314d23addcf9c4ad5a5061', 'request_id': 'req-f828ee22-9b3e-4963-8001-d24875444948'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:44.503520 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:44.507817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f828ee22-9b3e-4963-8001-d24875444948 admin admin] The token cache is being invalidate because project 23e73b8049314d23addcf9c4ad5a5061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:44.508106 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f828ee22-9b3e-4963-8001-d24875444948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:44.508733 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-f828ee22-9b3e-4963-8001-d24875444948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:44.510905 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1419/2837] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:44 2022] DELETE /identity/v3/projects/23e73b8049314d23addcf9c4ad5a5061 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:44.517726 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1644f-b12f-4b9b-bec5-62dae20c2674 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:44.518021 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1644f-b12f-4b9b-bec5-62dae20c2674 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:44.518332 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1644f-b12f-4b9b-bec5-62dae20c2674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:44.535718 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-1fe1644f-b12f-4b9b-bec5-62dae20c2674 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:44.536977 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-1fe1644f-b12f-4b9b-bec5-62dae20c2674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:44.596368 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1419/2838] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 08:46:44.604396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17235b9f-4451-428a-b49b-dfa00a4cf21f None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:44.604716 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17235b9f-4451-428a-b49b-dfa00a4cf21f None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:44.604999 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17235b9f-4451-428a-b49b-dfa00a4cf21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:44.624097 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-17235b9f-4451-428a-b49b-dfa00a4cf21f None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:44.625300 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-17235b9f-4451-428a-b49b-dfa00a4cf21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:44.633212 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1420/2839] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:44.638112 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1644f-b12f-4b9b-bec5-62dae20c2674 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:44.647646 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1644f-b12f-4b9b-bec5-62dae20c2674 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:44.652199 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94049e6e-6b67-4caa-bf3a-1fdcd7b82d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:44.652839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94049e6e-6b67-4caa-bf3a-1fdcd7b82d2c admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:44.653119 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94049e6e-6b67-4caa-bf3a-1fdcd7b82d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:44.653391 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94049e6e-6b67-4caa-bf3a-1fdcd7b82d2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:44.654156 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94049e6e-6b67-4caa-bf3a-1fdcd7b82d2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80261) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:46:44.654463 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94049e6e-6b67-4caa-bf3a-1fdcd7b82d2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:44.656047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94049e6e-6b67-4caa-bf3a-1fdcd7b82d2c admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:44.667452 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1420/2840] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:46:44.671603 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17235b9f-4451-428a-b49b-dfa00a4cf21f None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:44.680638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17235b9f-4451-428a-b49b-dfa00a4cf21f None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:44.685698 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83b809-c9d1-4e81-8f9b-361e4b759ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:44.686332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83b809-c9d1-4e81-8f9b-361e4b759ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:44.686613 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83b809-c9d1-4e81-8f9b-361e4b759ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:44.686887 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83b809-c9d1-4e81-8f9b-361e4b759ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:44.687573 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83b809-c9d1-4e81-8f9b-361e4b759ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:44.689453 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83b809-c9d1-4e81-8f9b-361e4b759ed3 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:44.773345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1421/2841] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:46:44 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:46:44.777459 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94049e6e-6b67-4caa-bf3a-1fdcd7b82d2c admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:44.787709 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94049e6e-6b67-4caa-bf3a-1fdcd7b82d2c admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:44.843813 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b041a-54c9-46c0-b6fa-1b7cc7024fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:44.844470 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b041a-54c9-46c0-b6fa-1b7cc7024fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:44.844756 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b041a-54c9-46c0-b6fa-1b7cc7024fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:44.845034 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b041a-54c9-46c0-b6fa-1b7cc7024fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:44.845765 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b041a-54c9-46c0-b6fa-1b7cc7024fc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:44.847731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b041a-54c9-46c0-b6fa-1b7cc7024fc6 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:44.958517 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1421/2842] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:46:44 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:46:44.963191 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83b809-c9d1-4e81-8f9b-361e4b759ed3 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:44.973836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83b809-c9d1-4e81-8f9b-361e4b759ed3 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:44.978592 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48145dcd-ccbf-4003-8412-39f8c09bf546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:44.979259 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48145dcd-ccbf-4003-8412-39f8c09bf546 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:44.979663 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48145dcd-ccbf-4003-8412-39f8c09bf546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:44.979947 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48145dcd-ccbf-4003-8412-39f8c09bf546 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:44.980672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48145dcd-ccbf-4003-8412-39f8c09bf546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:44.982310 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48145dcd-ccbf-4003-8412-39f8c09bf546 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:44.993232 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1422/2843] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:44.997390 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b041a-54c9-46c0-b6fa-1b7cc7024fc6 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:45.007523 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b041a-54c9-46c0-b6fa-1b7cc7024fc6 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:45.012616 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ab7ff-940a-48c6-969e-a66b5c0f5b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:45.013268 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ab7ff-940a-48c6-969e-a66b5c0f5b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:45.013584 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ab7ff-940a-48c6-969e-a66b5c0f5b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:45.013874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ab7ff-940a-48c6-969e-a66b5c0f5b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:45.014596 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ab7ff-940a-48c6-969e-a66b5c0f5b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:45.016183 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ab7ff-940a-48c6-969e-a66b5c0f5b3e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:45.026703 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1422/2844] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:45.030786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48145dcd-ccbf-4003-8412-39f8c09bf546 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:45.040630 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48145dcd-ccbf-4003-8412-39f8c09bf546 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:45.045266 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37652342-2d3e-416b-9f11-6973eca747d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:45.046165 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37652342-2d3e-416b-9f11-6973eca747d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:45.046447 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37652342-2d3e-416b-9f11-6973eca747d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:45.046723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37652342-2d3e-416b-9f11-6973eca747d2 admin admin] PATH_INFO: `/v3/projects/b93301baf3d44bc29df86e2675607a53/users/b1669ec3a65f45f3b00f02a170252331/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:45.061966 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37652342-2d3e-416b-9f11-6973eca747d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b93301baf3d44bc29df86e2675607a53, user_id=b1669ec3a65f45f3b00f02a170252331, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:45.064989 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37652342-2d3e-416b-9f11-6973eca747d2 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:45.136217 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1423/2845] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:45 2022] PUT /identity/v3/projects/b93301baf3d44bc29df86e2675607a53/users/b1669ec3a65f45f3b00f02a170252331/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:45.141219 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a21673-42bf-4b94-aea9-0684f6d11728 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:45.141512 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a21673-42bf-4b94-aea9-0684f6d11728 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:45.141823 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a21673-42bf-4b94-aea9-0684f6d11728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:45.154821 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:45.160407 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-b3a21673-42bf-4b94-aea9-0684f6d11728 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:45.161640 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b3a21673-42bf-4b94-aea9-0684f6d11728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:45.222122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1423/2846] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:45.231995 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37652342-2d3e-416b-9f11-6973eca747d2 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:45.233979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-37652342-2d3e-416b-9f11-6973eca747d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:45.289958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37652342-2d3e-416b-9f11-6973eca747d2 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:45.294219 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010864a4-2c95-43fa-8809-e0405e9f95fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:45.294868 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010864a4-2c95-43fa-8809-e0405e9f95fd service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:45.295152 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010864a4-2c95-43fa-8809-e0405e9f95fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:45.295430 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010864a4-2c95-43fa-8809-e0405e9f95fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:45.304467 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010864a4-2c95-43fa-8809-e0405e9f95fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:45.305943 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010864a4-2c95-43fa-8809-e0405e9f95fd service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:45.315254 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1424/2847] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:46:46.823793 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d90de-f2d0-4ae6-81b4-c8382a697d9c None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:46.824409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d90de-f2d0-4ae6-81b4-c8382a697d9c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:46.824409 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d90de-f2d0-4ae6-81b4-c8382a697d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:46.850835 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-ed8d90de-f2d0-4ae6-81b4-c8382a697d9c None None] MFA Rules not processed for user `b1669ec3a65f45f3b00f02a170252331`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:46.852065 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-ed8d90de-f2d0-4ae6-81b4-c8382a697d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:46.918846 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1424/2848] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:46.929488 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010864a4-2c95-43fa-8809-e0405e9f95fd service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:46.931081 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-010864a4-2c95-43fa-8809-e0405e9f95fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:46.992784 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010864a4-2c95-43fa-8809-e0405e9f95fd service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:46.997118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c2ffc-0e4d-43cf-9d0b-c0f78ea8c73b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:46.997812 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c2ffc-0e4d-43cf-9d0b-c0f78ea8c73b service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:46.998097 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c2ffc-0e4d-43cf-9d0b-c0f78ea8c73b service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:46.998373 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c2ffc-0e4d-43cf-9d0b-c0f78ea8c73b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:47.007362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c2ffc-0e4d-43cf-9d0b-c0f78ea8c73b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:47.008736 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c2ffc-0e4d-43cf-9d0b-c0f78ea8c73b service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:47.019014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1425/2849] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:46:48.730550 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae93af0-a130-4e09-9717-fe492285b83c None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:48.731050 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae93af0-a130-4e09-9717-fe492285b83c None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:48.731050 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae93af0-a130-4e09-9717-fe492285b83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:48.750112 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-fae93af0-a130-4e09-9717-fe492285b83c None None] MFA Rules not processed for user `b1669ec3a65f45f3b00f02a170252331`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:48.751520 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-fae93af0-a130-4e09-9717-fe492285b83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:48.758690 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1425/2850] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:51.350362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c2ffc-0e4d-43cf-9d0b-c0f78ea8c73b service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:51.351925 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-250c2ffc-0e4d-43cf-9d0b-c0f78ea8c73b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:51.366200 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c2ffc-0e4d-43cf-9d0b-c0f78ea8c73b service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:51.371411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de195c0e-e08f-4155-b3ac-0a0839ee8b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:51.371623 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de195c0e-e08f-4155-b3ac-0a0839ee8b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:51.371766 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de195c0e-e08f-4155-b3ac-0a0839ee8b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:51.372054 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de195c0e-e08f-4155-b3ac-0a0839ee8b29 admin admin] PATH_INFO: `/v3/users/7b719d60ca904f43831da051a8da2577` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:51.373214 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de195c0e-e08f-4155-b3ac-0a0839ee8b29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b719d60ca904f43831da051a8da2577)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:51.375145 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de195c0e-e08f-4155-b3ac-0a0839ee8b29 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:51.565658 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:51.576295 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-de195c0e-e08f-4155-b3ac-0a0839ee8b29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b719d60ca904f43831da051a8da2577'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:51.590769 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-de195c0e-e08f-4155-b3ac-0a0839ee8b29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b719d60ca904f43831da051a8da2577'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:51.597934 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-de195c0e-e08f-4155-b3ac-0a0839ee8b29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b719d60ca904f43831da051a8da2577'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:51.598811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-de195c0e-e08f-4155-b3ac-0a0839ee8b29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b719d60ca904f43831da051a8da2577'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:51.599649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-de195c0e-e08f-4155-b3ac-0a0839ee8b29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b719d60ca904f43831da051a8da2577'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:51.681605 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1426/2851] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:51 2022] DELETE /identity/v3/users/7b719d60ca904f43831da051a8da2577 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:51.686227 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a0612-bde6-4967-9d8f-2ec7a2f7139a None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:51.698664 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a0612-bde6-4967-9d8f-2ec7a2f7139a None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:51.698664 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a0612-bde6-4967-9d8f-2ec7a2f7139a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:51.706472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-5b2a0612-bde6-4967-9d8f-2ec7a2f7139a None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:51.707744 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-5b2a0612-bde6-4967-9d8f-2ec7a2f7139a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:51.768911 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1426/2852] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:51.779321 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de195c0e-e08f-4155-b3ac-0a0839ee8b29 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:51.785048 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-de195c0e-e08f-4155-b3ac-0a0839ee8b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:51.840557 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de195c0e-e08f-4155-b3ac-0a0839ee8b29 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:51.845213 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5bc10-4612-4d36-b491-7eab41baef3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:51.845839 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5bc10-4612-4d36-b491-7eab41baef3c service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:51.846123 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5bc10-4612-4d36-b491-7eab41baef3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:51.846419 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5bc10-4612-4d36-b491-7eab41baef3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:51.856486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5bc10-4612-4d36-b491-7eab41baef3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:51.857969 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5bc10-4612-4d36-b491-7eab41baef3c service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:51.867881 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1427/2853] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:46:52.304053 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a0612-bde6-4967-9d8f-2ec7a2f7139a None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:52.305638 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-5b2a0612-bde6-4967-9d8f-2ec7a2f7139a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:52.318952 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a0612-bde6-4967-9d8f-2ec7a2f7139a None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:52.324949 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5bd1a-be6f-4a2b-b463-c1997887edac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:52.326598 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5bd1a-be6f-4a2b-b463-c1997887edac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:52.328186 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5bd1a-be6f-4a2b-b463-c1997887edac admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:52.328186 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5bd1a-be6f-4a2b-b463-c1997887edac admin admin] PATH_INFO: `/v3/projects/de63d925d63e46c09956a61936d5ef0c` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:52.329132 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5bd1a-be6f-4a2b-b463-c1997887edac admin admin] RBAC: Authorizing `identity:delete_project(project_id=de63d925d63e46c09956a61936d5ef0c)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:52.331192 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5bd1a-be6f-4a2b-b463-c1997887edac admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:52.417171 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:52.433406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e2b5bd1a-be6f-4a2b-b463-c1997887edac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de63d925d63e46c09956a61936d5ef0c', 'request_id': 'req-e2b5bd1a-be6f-4a2b-b463-c1997887edac'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:52.438710 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e2b5bd1a-be6f-4a2b-b463-c1997887edac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de63d925d63e46c09956a61936d5ef0c', 'request_id': 'req-e2b5bd1a-be6f-4a2b-b463-c1997887edac'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:52.506841 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e2b5bd1a-be6f-4a2b-b463-c1997887edac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de63d925d63e46c09956a61936d5ef0c', 'request_id': 'req-e2b5bd1a-be6f-4a2b-b463-c1997887edac'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:52.519084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e2b5bd1a-be6f-4a2b-b463-c1997887edac admin admin] The token cache is being invalidate because project de63d925d63e46c09956a61936d5ef0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:52.519385 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e2b5bd1a-be6f-4a2b-b463-c1997887edac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:52.519999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-e2b5bd1a-be6f-4a2b-b463-c1997887edac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:52.521516 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1427/2854] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:52 2022] DELETE /identity/v3/projects/de63d925d63e46c09956a61936d5ef0c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:52.530007 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d041b0e-48e5-4a39-ba16-7a2ab301622d None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:52.530606 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d041b0e-48e5-4a39-ba16-7a2ab301622d None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:52.530606 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d041b0e-48e5-4a39-ba16-7a2ab301622d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:52.552238 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-7d041b0e-48e5-4a39-ba16-7a2ab301622d None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:52.553575 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-7d041b0e-48e5-4a39-ba16-7a2ab301622d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:52.617667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1428/2855] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:52.625518 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e47053-f173-47dd-ba02-4c1ec19d1457 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:52.627292 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e47053-f173-47dd-ba02-4c1ec19d1457 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:52.627292 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e47053-f173-47dd-ba02-4c1ec19d1457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:52.649164 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-f3e47053-f173-47dd-ba02-4c1ec19d1457 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:52.650545 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f3e47053-f173-47dd-ba02-4c1ec19d1457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:52.662349 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1428/2856] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:52.666495 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d041b0e-48e5-4a39-ba16-7a2ab301622d None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:52.679020 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d041b0e-48e5-4a39-ba16-7a2ab301622d None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:52.685458 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25030c77-8e0e-449e-9915-2421c24ad6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:52.688557 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25030c77-8e0e-449e-9915-2421c24ad6ee admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:52.688557 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25030c77-8e0e-449e-9915-2421c24ad6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:52.688557 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25030c77-8e0e-449e-9915-2421c24ad6ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:52.688557 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25030c77-8e0e-449e-9915-2421c24ad6ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80262) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 08:46:52.688557 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25030c77-8e0e-449e-9915-2421c24ad6ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:52.690292 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25030c77-8e0e-449e-9915-2421c24ad6ee admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:52.706512 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1429/2857] 10.222.0.57 () {58 vars in 1152 bytes} [Thu Jul 21 08:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 08:46:52.717023 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e47053-f173-47dd-ba02-4c1ec19d1457 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:52.729791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e47053-f173-47dd-ba02-4c1ec19d1457 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:52.735421 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fdaf7-b506-4a7e-a4ff-e0bfaeda097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:52.736355 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fdaf7-b506-4a7e-a4ff-e0bfaeda097e admin admin] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:52.736803 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fdaf7-b506-4a7e-a4ff-e0bfaeda097e admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:52.737246 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fdaf7-b506-4a7e-a4ff-e0bfaeda097e admin admin] PATH_INFO: `/v3/projects` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:52.738135 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fdaf7-b506-4a7e-a4ff-e0bfaeda097e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:52.740724 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fdaf7-b506-4a7e-a4ff-e0bfaeda097e admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:52.897637 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1429/2858] 10.222.0.57 () {60 vars in 1152 bytes} [Thu Jul 21 08:46:52 2022] POST /identity/v3/projects => generated 383 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:46:52.901546 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25030c77-8e0e-449e-9915-2421c24ad6ee admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:52.911694 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25030c77-8e0e-449e-9915-2421c24ad6ee admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:52.952296 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:52.968122 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a24dd0-974b-4b06-972b-fad23b0f4bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:52.968785 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a24dd0-974b-4b06-972b-fad23b0f4bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:52.969068 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a24dd0-974b-4b06-972b-fad23b0f4bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:52.969345 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a24dd0-974b-4b06-972b-fad23b0f4bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:52.970064 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a24dd0-974b-4b06-972b-fad23b0f4bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:52.971988 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a24dd0-974b-4b06-972b-fad23b0f4bb3 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:53.038595 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1430/2859] 10.222.0.57 () {60 vars in 1143 bytes} [Thu Jul 21 08:46:52 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 08:46:53.043350 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fdaf7-b506-4a7e-a4ff-e0bfaeda097e admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:53.054181 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fdaf7-b506-4a7e-a4ff-e0bfaeda097e admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:53.058839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afbf60-4b95-4455-8c1f-cd99f9af1da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:53.059805 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afbf60-4b95-4455-8c1f-cd99f9af1da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:53.065303 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afbf60-4b95-4455-8c1f-cd99f9af1da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:53.065303 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afbf60-4b95-4455-8c1f-cd99f9af1da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:53.065303 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afbf60-4b95-4455-8c1f-cd99f9af1da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:53.065303 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afbf60-4b95-4455-8c1f-cd99f9af1da3 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:53.073845 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1430/2860] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:53.080152 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a24dd0-974b-4b06-972b-fad23b0f4bb3 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:53.093154 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a24dd0-974b-4b06-972b-fad23b0f4bb3 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:53.098265 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2cf503-6444-4ae7-919b-fa7af7ba1390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:53.098931 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cf503-6444-4ae7-919b-fa7af7ba1390 admin admin] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:53.099251 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cf503-6444-4ae7-919b-fa7af7ba1390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:53.099487 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2cf503-6444-4ae7-919b-fa7af7ba1390 admin admin] PATH_INFO: `/v3/roles` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:53.100208 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cf503-6444-4ae7-919b-fa7af7ba1390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:53.101918 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2cf503-6444-4ae7-919b-fa7af7ba1390 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:53.113312 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1431/2861] 10.222.0.57 () {58 vars in 1121 bytes} [Thu Jul 21 08:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 08:46:53.117405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afbf60-4b95-4455-8c1f-cd99f9af1da3 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:53.127439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afbf60-4b95-4455-8c1f-cd99f9af1da3 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:53.132684 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1287b3-8ae2-4866-b407-60216561e6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:53.133656 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1287b3-8ae2-4866-b407-60216561e6be admin admin] REQUEST_METHOD: `PUT` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:53.133935 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1287b3-8ae2-4866-b407-60216561e6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:53.134235 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1287b3-8ae2-4866-b407-60216561e6be admin admin] PATH_INFO: `/v3/projects/1a2ab8ebe901453dac6f012dc661f347/users/3aa398d359884f72b921caa5163608c3/roles/80c590b37af34bca8dee5f7c87a38999` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:53.150165 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1287b3-8ae2-4866-b407-60216561e6be admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2ab8ebe901453dac6f012dc661f347, user_id=3aa398d359884f72b921caa5163608c3, role_id=80c590b37af34bca8dee5f7c87a38999)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:53.153291 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1287b3-8ae2-4866-b407-60216561e6be admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:53.232472 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1431/2862] 10.222.0.57 () {60 vars in 1482 bytes} [Thu Jul 21 08:46:53 2022] PUT /identity/v3/projects/1a2ab8ebe901453dac6f012dc661f347/users/3aa398d359884f72b921caa5163608c3/roles/80c590b37af34bca8dee5f7c87a38999 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:53.244091 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888f8c0-9176-4538-869d-03ff05bf6204 None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:53.244383 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888f8c0-9176-4538-869d-03ff05bf6204 None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:53.244665 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888f8c0-9176-4538-869d-03ff05bf6204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:53.272523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-e888f8c0-9176-4538-869d-03ff05bf6204 None None] MFA Rules not processed for user `3aa398d359884f72b921caa5163608c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:53.273764 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e888f8c0-9176-4538-869d-03ff05bf6204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:53.355152 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1432/2863] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:53.366436 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1287b3-8ae2-4866-b407-60216561e6be admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:53.368162 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9f1287b3-8ae2-4866-b407-60216561e6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:53.431734 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1287b3-8ae2-4866-b407-60216561e6be admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:53.436095 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cda72-528d-41d3-a198-dfa9d3e7ba59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:53.436742 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cda72-528d-41d3-a198-dfa9d3e7ba59 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:53.437021 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cda72-528d-41d3-a198-dfa9d3e7ba59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:53.437297 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cda72-528d-41d3-a198-dfa9d3e7ba59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:53.446289 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cda72-528d-41d3-a198-dfa9d3e7ba59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:53.447727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cda72-528d-41d3-a198-dfa9d3e7ba59 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:53.456753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1432/2864] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:46:56.420496 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888f8c0-9176-4538-869d-03ff05bf6204 None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:56.481359 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888f8c0-9176-4538-869d-03ff05bf6204 None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:56.486058 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c90c9-773f-4d5f-a2fd-306a42dd6965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:56.486925 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c90c9-773f-4d5f-a2fd-306a42dd6965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:56.487212 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c90c9-773f-4d5f-a2fd-306a42dd6965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:56.487493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c90c9-773f-4d5f-a2fd-306a42dd6965 admin admin] PATH_INFO: `/v3/users/3aa398d359884f72b921caa5163608c3` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:56.488675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c90c9-773f-4d5f-a2fd-306a42dd6965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aa398d359884f72b921caa5163608c3)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:56.490654 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c90c9-773f-4d5f-a2fd-306a42dd6965 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:56.693864 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ad6c90c9-773f-4d5f-a2fd-306a42dd6965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aa398d359884f72b921caa5163608c3'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:56.698396 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:56.706101 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ad6c90c9-773f-4d5f-a2fd-306a42dd6965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aa398d359884f72b921caa5163608c3'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:56.712953 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ad6c90c9-773f-4d5f-a2fd-306a42dd6965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aa398d359884f72b921caa5163608c3'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:56.713674 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ad6c90c9-773f-4d5f-a2fd-306a42dd6965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aa398d359884f72b921caa5163608c3'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:56.714284 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-ad6c90c9-773f-4d5f-a2fd-306a42dd6965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aa398d359884f72b921caa5163608c3'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:56.817573 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1433/2865] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 08:46:56 2022] DELETE /identity/v3/users/3aa398d359884f72b921caa5163608c3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:46:56.822013 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9877efd-4790-485d-ade8-c404c7913086 None None] REQUEST_METHOD: `POST` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:56.822495 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9877efd-4790-485d-ade8-c404c7913086 None None] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:56.822613 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9877efd-4790-485d-ade8-c404c7913086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:56.839636 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.auth.core [None req-f9877efd-4790-485d-ade8-c404c7913086 None None] MFA Rules not processed for user `1854e64df6074ad496a8d7112fa61f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80261) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 08:46:56.840825 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f9877efd-4790-485d-ade8-c404c7913086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:56.887460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:46:56.899351 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1433/2866] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 08:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 08:46:56.909494 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c90c9-773f-4d5f-a2fd-306a42dd6965 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:56.910945 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ad6c90c9-773f-4d5f-a2fd-306a42dd6965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:56.969516 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c90c9-773f-4d5f-a2fd-306a42dd6965 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:56.973120 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706cc4b8-cfbf-40df-8faf-0a5772785fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:56.973805 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cc4b8-cfbf-40df-8faf-0a5772785fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:56.974088 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cc4b8-cfbf-40df-8faf-0a5772785fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:56.974362 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cc4b8-cfbf-40df-8faf-0a5772785fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:56.984422 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706cc4b8-cfbf-40df-8faf-0a5772785fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:56.985979 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706cc4b8-cfbf-40df-8faf-0a5772785fc6 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:56.995386 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1434/2867] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:46:57.386406 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9877efd-4790-485d-ade8-c404c7913086 None None] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:46:57.387458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f9877efd-4790-485d-ade8-c404c7913086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:46:57.401260 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9877efd-4790-485d-ade8-c404c7913086 None None] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:46:57.408166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43b113-ee93-4e25-8b89-15e515098703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:46:57.412324 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43b113-ee93-4e25-8b89-15e515098703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:46:57.412324 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43b113-ee93-4e25-8b89-15e515098703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:46:57.412324 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43b113-ee93-4e25-8b89-15e515098703 admin admin] PATH_INFO: `/v3/projects/1a2ab8ebe901453dac6f012dc661f347` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:46:57.412324 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43b113-ee93-4e25-8b89-15e515098703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a2ab8ebe901453dac6f012dc661f347)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:46:57.412986 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43b113-ee93-4e25-8b89-15e515098703 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:46:57.515001 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7c43b113-ee93-4e25-8b89-15e515098703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a2ab8ebe901453dac6f012dc661f347', 'request_id': 'req-7c43b113-ee93-4e25-8b89-15e515098703'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:57.521800 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7c43b113-ee93-4e25-8b89-15e515098703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a2ab8ebe901453dac6f012dc661f347', 'request_id': 'req-7c43b113-ee93-4e25-8b89-15e515098703'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:57.583153 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7c43b113-ee93-4e25-8b89-15e515098703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a2ab8ebe901453dac6f012dc661f347', 'request_id': 'req-7c43b113-ee93-4e25-8b89-15e515098703'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:57.595471 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7c43b113-ee93-4e25-8b89-15e515098703 admin admin] The token cache is being invalidate because project 1a2ab8ebe901453dac6f012dc661f347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 08:46:57.595771 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7c43b113-ee93-4e25-8b89-15e515098703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:57.596429 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-7c43b113-ee93-4e25-8b89-15e515098703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 08:46:57.598039 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1434/2868] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 08:46:57 2022] DELETE /identity/v3/projects/1a2ab8ebe901453dac6f012dc661f347 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 08:47:06.991188 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:DELETE=3,keystone:SELECT=36,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:47:07.592376 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=30,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:47:30.755500 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706cc4b8-cfbf-40df-8faf-0a5772785fc6 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:47:30.764389 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706cc4b8-cfbf-40df-8faf-0a5772785fc6 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:47:30.813068 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb344ad2-44de-4794-8a72-3e16d0e36e8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:47:30.813763 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb344ad2-44de-4794-8a72-3e16d0e36e8c service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:47:30.814056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb344ad2-44de-4794-8a72-3e16d0e36e8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:47:30.814322 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb344ad2-44de-4794-8a72-3e16d0e36e8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:47:30.816085 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-fb344ad2-44de-4794-8a72-3e16d0e36e8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:47:30.884960 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb344ad2-44de-4794-8a72-3e16d0e36e8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:47:30.886448 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb344ad2-44de-4794-8a72-3e16d0e36e8c service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:47:30.897932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1435/2869] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:47:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:47:32.330701 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43b113-ee93-4e25-8b89-15e515098703 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:47:32.332204 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-7c43b113-ee93-4e25-8b89-15e515098703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:47:32.344190 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43b113-ee93-4e25-8b89-15e515098703 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:47:32.347892 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af1c37-0b07-4d5c-b46a-3c0ba915b356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:47:32.354585 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af1c37-0b07-4d5c-b46a-3c0ba915b356 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:47:32.354585 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af1c37-0b07-4d5c-b46a-3c0ba915b356 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:47:32.354585 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af1c37-0b07-4d5c-b46a-3c0ba915b356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:47:32.354585 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a8af1c37-0b07-4d5c-b46a-3c0ba915b356 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:47:32.364855 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af1c37-0b07-4d5c-b46a-3c0ba915b356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:47:32.366348 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af1c37-0b07-4d5c-b46a-3c0ba915b356 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:47:32.377774 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1435/2870] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:47:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:47:40.893014 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=54 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:47:42.372268 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=6 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:48:21.130875 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb344ad2-44de-4794-8a72-3e16d0e36e8c service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:48:21.132158 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-fb344ad2-44de-4794-8a72-3e16d0e36e8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:48:21.146763 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb344ad2-44de-4794-8a72-3e16d0e36e8c service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:48:21.154848 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad0547-5963-4faa-b743-12591d752bb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:48:21.155496 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad0547-5963-4faa-b743-12591d752bb8 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:48:21.155779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad0547-5963-4faa-b743-12591d752bb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:48:21.156103 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad0547-5963-4faa-b743-12591d752bb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:48:21.157932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b0ad0547-5963-4faa-b743-12591d752bb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:48:21.171010 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad0547-5963-4faa-b743-12591d752bb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:48:21.172645 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad0547-5963-4faa-b743-12591d752bb8 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:48:21.184671 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1436/2871] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:48:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:48:28.067047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af1c37-0b07-4d5c-b46a-3c0ba915b356 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:48:28.068595 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-a8af1c37-0b07-4d5c-b46a-3c0ba915b356 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:48:28.079881 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af1c37-0b07-4d5c-b46a-3c0ba915b356 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:48:28.083551 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef5eca-7e85-4cc1-8ed0-6c36ab71248c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:48:28.085405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef5eca-7e85-4cc1-8ed0-6c36ab71248c service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:48:28.085405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef5eca-7e85-4cc1-8ed0-6c36ab71248c service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:48:28.085405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef5eca-7e85-4cc1-8ed0-6c36ab71248c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:48:28.086622 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-41ef5eca-7e85-4cc1-8ed0-6c36ab71248c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:48:28.096611 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef5eca-7e85-4cc1-8ed0-6c36ab71248c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:48:28.098127 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ef5eca-7e85-4cc1-8ed0-6c36ab71248c service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:48:28.107071 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1436/2872] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:48:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:48:31.179752 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=6 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:48:38.102844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=6 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:48:46.799731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad0547-5963-4faa-b743-12591d752bb8 service nova] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:48:46.801390 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b0ad0547-5963-4faa-b743-12591d752bb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:48:46.819078 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad0547-5963-4faa-b743-12591d752bb8 service nova] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:48:46.826118 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dcabd-758b-4083-8be7-719a0d52da3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:48:46.826942 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dcabd-758b-4083-8be7-719a0d52da3e service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:48:46.827491 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dcabd-758b-4083-8be7-719a0d52da3e service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:48:46.827969 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dcabd-758b-4083-8be7-719a0d52da3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:48:46.829883 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f24dcabd-758b-4083-8be7-719a0d52da3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:48:46.842811 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24dcabd-758b-4083-8be7-719a0d52da3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:48:46.845220 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24dcabd-758b-4083-8be7-719a0d52da3e service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:48:46.858826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1437/2873] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:48:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:48:56.853116 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=6 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:49:22.010441 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef5eca-7e85-4cc1-8ed0-6c36ab71248c service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:49:22.024064 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef5eca-7e85-4cc1-8ed0-6c36ab71248c service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:49:22.030244 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da3135-d6bd-4bdf-a480-040464a2df57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:49:22.030874 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da3135-d6bd-4bdf-a480-040464a2df57 service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:49:22.031160 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da3135-d6bd-4bdf-a480-040464a2df57 service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:49:22.031439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da3135-d6bd-4bdf-a480-040464a2df57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:49:22.033199 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-77da3135-d6bd-4bdf-a480-040464a2df57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:49:22.093417 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da3135-d6bd-4bdf-a480-040464a2df57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:49:22.095041 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da3135-d6bd-4bdf-a480-040464a2df57 service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:49:22.106028 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1437/2874] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:49:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:49:32.099867 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=28 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:50:39.600328 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dcabd-758b-4083-8be7-719a0d52da3e service nova] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:50:39.612247 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dcabd-758b-4083-8be7-719a0d52da3e service nova] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:50:39.617499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a88221-dbaa-4639-9cd4-cba6d191c816 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:50:39.618179 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a88221-dbaa-4639-9cd4-cba6d191c816 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:50:39.618462 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a88221-dbaa-4639-9cd4-cba6d191c816 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:50:39.618731 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a88221-dbaa-4639-9cd4-cba6d191c816 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:50:39.620499 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-45a88221-dbaa-4639-9cd4-cba6d191c816 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:50:39.676644 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a88221-dbaa-4639-9cd4-cba6d191c816 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:50:39.678263 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a88221-dbaa-4639-9cd4-cba6d191c816 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:50:39.687075 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1438/2875] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:50:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:50:49.682981 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=28 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:51:39.304508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da3135-d6bd-4bdf-a480-040464a2df57 service nova] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:51:39.306733 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-77da3135-d6bd-4bdf-a480-040464a2df57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:51:39.375842 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da3135-d6bd-4bdf-a480-040464a2df57 service nova] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:51:39.380849 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679a63d-40a5-4d18-932e-0423a9d44030 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38b7e84d6a43efbb4c1a52e2b3e681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:51:39.381539 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679a63d-40a5-4d18-932e-0423a9d44030 service placement] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:51:39.381830 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679a63d-40a5-4d18-932e-0423a9d44030 service placement] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:51:39.382110 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679a63d-40a5-4d18-932e-0423a9d44030 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:51:39.384055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-1679a63d-40a5-4d18-932e-0423a9d44030 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:51:39.395927 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679a63d-40a5-4d18-932e-0423a9d44030 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:51:39.397517 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679a63d-40a5-4d18-932e-0423a9d44030 service placement] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:51:39.408226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1438/2876] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:51:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:51:49.403774 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=32 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:52:21.570656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a88221-dbaa-4639-9cd4-cba6d191c816 service nova] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:52:21.572050 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-45a88221-dbaa-4639-9cd4-cba6d191c816 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:52:21.627957 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a88221-dbaa-4639-9cd4-cba6d191c816 service nova] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:52:21.631623 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83f57f-2fcd-4250-9046-821424137f8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:52:21.632263 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83f57f-2fcd-4250-9046-821424137f8d service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:52:21.632548 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83f57f-2fcd-4250-9046-821424137f8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:52:21.632826 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83f57f-2fcd-4250-9046-821424137f8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:52:21.634666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-cd83f57f-2fcd-4250-9046-821424137f8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:52:21.691573 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83f57f-2fcd-4250-9046-821424137f8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:52:21.693012 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd83f57f-2fcd-4250-9046-821424137f8d service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:52:21.701844 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1439/2877] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:52:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:52:30.969351 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679a63d-40a5-4d18-932e-0423a9d44030 service placement] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:52:30.979066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679a63d-40a5-4d18-932e-0423a9d44030 service placement] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:52:30.982537 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07696f7d-a55a-4569-8a89-368fdaaebf3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:52:30.983163 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07696f7d-a55a-4569-8a89-368fdaaebf3f service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:52:30.983440 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07696f7d-a55a-4569-8a89-368fdaaebf3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:52:30.983712 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07696f7d-a55a-4569-8a89-368fdaaebf3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:52:30.994680 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07696f7d-a55a-4569-8a89-368fdaaebf3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:52:30.996086 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07696f7d-a55a-4569-8a89-368fdaaebf3f service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:52:31.006816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1439/2878] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:52:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:52:31.697808 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=48 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:52:33.079061 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83f57f-2fcd-4250-9046-821424137f8d service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:52:33.089338 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83f57f-2fcd-4250-9046-821424137f8d service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:52:33.093004 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193934c-d2e1-4371-b438-230ebb5ae9e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:52:33.093694 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193934c-d2e1-4371-b438-230ebb5ae9e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:52:33.093977 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193934c-d2e1-4371-b438-230ebb5ae9e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:52:33.094255 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193934c-d2e1-4371-b438-230ebb5ae9e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:52:33.104910 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193934c-d2e1-4371-b438-230ebb5ae9e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:52:33.106385 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193934c-d2e1-4371-b438-230ebb5ae9e3 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:52:33.118071 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1440/2879] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:52:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:52:41.002055 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=6 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:52:43.113404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=6 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:53:34.978587 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07696f7d-a55a-4569-8a89-368fdaaebf3f service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:53:34.988222 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07696f7d-a55a-4569-8a89-368fdaaebf3f service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:53:34.991965 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465b1d1-f0c7-48ab-a043-d43b53f2e3cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:53:34.992599 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465b1d1-f0c7-48ab-a043-d43b53f2e3cb service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:53:34.992912 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465b1d1-f0c7-48ab-a043-d43b53f2e3cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:53:34.993192 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465b1d1-f0c7-48ab-a043-d43b53f2e3cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:53:35.000612 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465b1d1-f0c7-48ab-a043-d43b53f2e3cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:53:35.002084 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465b1d1-f0c7-48ab-a043-d43b53f2e3cb service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:53:35.010104 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1440/2880] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:53:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:53:45.006474 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=6 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:54:21.813293 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193934c-d2e1-4371-b438-230ebb5ae9e3 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:54:21.822756 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193934c-d2e1-4371-b438-230ebb5ae9e3 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:54:21.826884 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782dbf7-be5f-4e58-b51e-7fd577d447d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:54:21.827511 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782dbf7-be5f-4e58-b51e-7fd577d447d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:54:21.827879 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782dbf7-be5f-4e58-b51e-7fd577d447d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:54:21.828049 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782dbf7-be5f-4e58-b51e-7fd577d447d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:54:21.836550 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782dbf7-be5f-4e58-b51e-7fd577d447d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:54:21.838008 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782dbf7-be5f-4e58-b51e-7fd577d447d1 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:54:21.869235 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1441/2881] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:54:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:54:31.864423 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=13 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:54:32.395923 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465b1d1-f0c7-48ab-a043-d43b53f2e3cb service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:54:32.411475 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465b1d1-f0c7-48ab-a043-d43b53f2e3cb service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:54:32.417095 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764be7f-c97f-40fd-89e1-a431ac1214a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:54:32.417759 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764be7f-c97f-40fd-89e1-a431ac1214a3 service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:54:32.418066 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764be7f-c97f-40fd-89e1-a431ac1214a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:54:32.418345 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764be7f-c97f-40fd-89e1-a431ac1214a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:54:32.427446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764be7f-c97f-40fd-89e1-a431ac1214a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:54:32.429030 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764be7f-c97f-40fd-89e1-a431ac1214a3 service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:54:32.440138 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1441/2882] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:54:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:54:42.435561 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=6 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:56:22.143526 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782dbf7-be5f-4e58-b51e-7fd577d447d1 service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:56:22.209376 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782dbf7-be5f-4e58-b51e-7fd577d447d1 service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:56:22.215470 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893ee15-1ad0-4554-bbf4-d4b76f07b7e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:56:22.216112 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893ee15-1ad0-4554-bbf4-d4b76f07b7e7 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:56:22.216395 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893ee15-1ad0-4554-bbf4-d4b76f07b7e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:56:22.216672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893ee15-1ad0-4554-bbf4-d4b76f07b7e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:56:22.224643 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893ee15-1ad0-4554-bbf4-d4b76f07b7e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:56:22.226258 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893ee15-1ad0-4554-bbf4-d4b76f07b7e7 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:56:22.254439 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1442/2883] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:56:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:56:32.251763 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=37 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:56:40.246037 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764be7f-c97f-40fd-89e1-a431ac1214a3 service nova] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:56:40.247447 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-c764be7f-c97f-40fd-89e1-a431ac1214a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:56:40.320824 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764be7f-c97f-40fd-89e1-a431ac1214a3 service nova] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:56:40.326408 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64716d-3132-4e1d-bba0-4bafa163c54d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38b7e84d6a43efbb4c1a52e2b3e681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:56:40.327053 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64716d-3132-4e1d-bba0-4bafa163c54d service placement] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:56:40.327336 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64716d-3132-4e1d-bba0-4bafa163c54d service placement] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:56:40.327610 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64716d-3132-4e1d-bba0-4bafa163c54d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:56:40.336342 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64716d-3132-4e1d-bba0-4bafa163c54d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:56:40.337952 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64716d-3132-4e1d-bba0-4bafa163c54d service placement] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:56:40.347747 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1442/2884] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:56:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 08:56:50.343501 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=33 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:57:22.001930 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893ee15-1ad0-4554-bbf4-d4b76f07b7e7 service nova] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:57:22.013813 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893ee15-1ad0-4554-bbf4-d4b76f07b7e7 service nova] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:57:22.019361 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e8d92-98ff-4da8-9a02-a3a7fc91dd58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:57:22.022621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e8d92-98ff-4da8-9a02-a3a7fc91dd58 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:57:22.022621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e8d92-98ff-4da8-9a02-a3a7fc91dd58 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:57:22.022621 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e8d92-98ff-4da8-9a02-a3a7fc91dd58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:57:22.028563 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e8d92-98ff-4da8-9a02-a3a7fc91dd58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:57:22.030234 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e8d92-98ff-4da8-9a02-a3a7fc91dd58 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:57:22.056995 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1443/2885] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:57:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:57:32.054356 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=13 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:58:22.123405 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64716d-3132-4e1d-bba0-4bafa163c54d service placement] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:58:22.143148 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64716d-3132-4e1d-bba0-4bafa163c54d service placement] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:58:22.148552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8785ea8-1e6d-479a-864a-ce61a9f1b8a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:58:22.148552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8785ea8-1e6d-479a-864a-ce61a9f1b8a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:58:22.148552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8785ea8-1e6d-479a-864a-ce61a9f1b8a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:58:22.148552 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8785ea8-1e6d-479a-864a-ce61a9f1b8a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:58:22.149733 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b8785ea8-1e6d-479a-864a-ce61a9f1b8a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:58:22.233166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8785ea8-1e6d-479a-864a-ce61a9f1b8a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:58:22.234758 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8785ea8-1e6d-479a-864a-ce61a9f1b8a3 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:58:22.246753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1443/2886] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:58:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:58:22.288868 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e8d92-98ff-4da8-9a02-a3a7fc91dd58 service nova] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:58:22.297558 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e8d92-98ff-4da8-9a02-a3a7fc91dd58 service nova] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:58:22.301430 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d16e82-dc14-4b01-b6ba-ed17b18b6bc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:58:22.302100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d16e82-dc14-4b01-b6ba-ed17b18b6bc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:58:22.302379 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d16e82-dc14-4b01-b6ba-ed17b18b6bc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:58:22.302654 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d16e82-dc14-4b01-b6ba-ed17b18b6bc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:58:22.304709 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-69d16e82-dc14-4b01-b6ba-ed17b18b6bc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:58:22.319945 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d16e82-dc14-4b01-b6ba-ed17b18b6bc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:58:22.321309 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d16e82-dc14-4b01-b6ba-ed17b18b6bc0 service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:58:22.332917 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1444/2887] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:58:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:58:32.241044 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=43 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:58:32.328246 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=6 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 08:58:37.041829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8785ea8-1e6d-479a-864a-ce61a9f1b8a3 service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 08:58:37.043430 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b8785ea8-1e6d-479a-864a-ce61a9f1b8a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:58:37.119691 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8785ea8-1e6d-479a-864a-ce61a9f1b8a3 service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 08:58:37.123906 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f7d79-166f-4256-abd2-f605eead00b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 08:58:37.124538 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f7d79-166f-4256-abd2-f605eead00b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 08:58:37.124817 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f7d79-166f-4256-abd2-f605eead00b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 08:58:37.125087 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f7d79-166f-4256-abd2-f605eead00b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 08:58:37.126951 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b98f7d79-166f-4256-abd2-f605eead00b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 08:58:37.136686 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f7d79-166f-4256-abd2-f605eead00b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 08:58:37.138168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f7d79-166f-4256-abd2-f605eead00b8 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 08:58:37.146253 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1444/2888] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 08:58:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 08:58:47.142539 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=35 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:00:22.925836 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d16e82-dc14-4b01-b6ba-ed17b18b6bc0 service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:00:22.934411 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d16e82-dc14-4b01-b6ba-ed17b18b6bc0 service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:00:22.937986 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eee48a-8269-45f2-9ce0-f603ba18d3fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:00:22.938611 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eee48a-8269-45f2-9ce0-f603ba18d3fd service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:00:22.938896 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eee48a-8269-45f2-9ce0-f603ba18d3fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:00:22.939212 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eee48a-8269-45f2-9ce0-f603ba18d3fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:00:22.941034 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-36eee48a-8269-45f2-9ce0-f603ba18d3fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:00:23.011970 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eee48a-8269-45f2-9ce0-f603ba18d3fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:00:23.013963 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eee48a-8269-45f2-9ce0-f603ba18d3fd service cinder] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:00:23.022839 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1445/2889] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:00:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:00:32.561315 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f7d79-166f-4256-abd2-f605eead00b8 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:00:32.562940 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-b98f7d79-166f-4256-abd2-f605eead00b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:00:32.573476 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f7d79-166f-4256-abd2-f605eead00b8 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:00:32.577729 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7371cc-4f84-4e97-9c2e-03e77cb563b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:00:32.578309 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7371cc-4f84-4e97-9c2e-03e77cb563b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:00:32.578592 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7371cc-4f84-4e97-9c2e-03e77cb563b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:00:32.578896 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7371cc-4f84-4e97-9c2e-03e77cb563b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:00:32.580659 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-cb7371cc-4f84-4e97-9c2e-03e77cb563b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:00:32.664934 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7371cc-4f84-4e97-9c2e-03e77cb563b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:00:32.666462 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7371cc-4f84-4e97-9c2e-03e77cb563b2 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:00:32.684974 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1445/2890] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:00:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:00:33.018734 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=33 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:00:36.040925 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eee48a-8269-45f2-9ce0-f603ba18d3fd service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:00:36.053486 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eee48a-8269-45f2-9ce0-f603ba18d3fd service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:00:36.059164 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e23b22-8c96-4439-9600-a974ea1a528d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38b7e84d6a43efbb4c1a52e2b3e681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:00:36.059956 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e23b22-8c96-4439-9600-a974ea1a528d service placement] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:00:36.060332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e23b22-8c96-4439-9600-a974ea1a528d service placement] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:00:36.060668 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e23b22-8c96-4439-9600-a974ea1a528d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:00:36.062534 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f4e23b22-8c96-4439-9600-a974ea1a528d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:00:36.075137 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e23b22-8c96-4439-9600-a974ea1a528d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:00:36.076649 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e23b22-8c96-4439-9600-a974ea1a528d service placement] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:00:36.086711 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1446/2891] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:00:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:00:39.548709 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7371cc-4f84-4e97-9c2e-03e77cb563b2 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:00:39.562541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7371cc-4f84-4e97-9c2e-03e77cb563b2 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:00:39.570180 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a54905-d5ca-4026-9b38-ca67a21a6659 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38b7e84d6a43efbb4c1a52e2b3e681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:00:39.574739 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a54905-d5ca-4026-9b38-ca67a21a6659 service placement] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:00:39.574739 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a54905-d5ca-4026-9b38-ca67a21a6659 service placement] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:00:39.574739 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a54905-d5ca-4026-9b38-ca67a21a6659 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:00:39.574739 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f2a54905-d5ca-4026-9b38-ca67a21a6659 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:00:39.585688 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a54905-d5ca-4026-9b38-ca67a21a6659 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:00:39.587352 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a54905-d5ca-4026-9b38-ca67a21a6659 service placement] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:00:39.598234 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1446/2892] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:00:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:00:39.656900 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e23b22-8c96-4439-9600-a974ea1a528d service placement] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:00:39.658332 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-f4e23b22-8c96-4439-9600-a974ea1a528d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:00:39.675190 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e23b22-8c96-4439-9600-a974ea1a528d service placement] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:00:39.677049 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5759c-86b8-4f82-bb77-2051c568f8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:00:39.677950 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5759c-86b8-4f82-bb77-2051c568f8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:00:39.678237 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5759c-86b8-4f82-bb77-2051c568f8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:00:39.678513 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba5759c-86b8-4f82-bb77-2051c568f8e5 admin admin] PATH_INFO: `/v3/users/4a5d975b49984bb38bba6704c3feff7d` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:00:39.692569 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5759c-86b8-4f82-bb77-2051c568f8e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a5d975b49984bb38bba6704c3feff7d)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:00:39.694520 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba5759c-86b8-4f82-bb77-2051c568f8e5 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:00:39.891886 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7ba5759c-86b8-4f82-bb77-2051c568f8e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a5d975b49984bb38bba6704c3feff7d'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:00:39.904019 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7ba5759c-86b8-4f82-bb77-2051c568f8e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a5d975b49984bb38bba6704c3feff7d'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:00:39.910823 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7ba5759c-86b8-4f82-bb77-2051c568f8e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a5d975b49984bb38bba6704c3feff7d'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:00:39.911538 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7ba5759c-86b8-4f82-bb77-2051c568f8e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a5d975b49984bb38bba6704c3feff7d'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:00:39.912155 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-7ba5759c-86b8-4f82-bb77-2051c568f8e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a5d975b49984bb38bba6704c3feff7d'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:00:39.998041 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1447/2893] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 09:00:39 2022] DELETE /identity/v3/users/4a5d975b49984bb38bba6704c3feff7d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:00:40.234913 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a54905-d5ca-4026-9b38-ca67a21a6659 service placement] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:00:40.246911 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a54905-d5ca-4026-9b38-ca67a21a6659 service placement] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:00:40.301343 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72beea82-5983-4ab3-baf5-1d401a3e4ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:00:40.302230 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72beea82-5983-4ab3-baf5-1d401a3e4ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:00:40.302513 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72beea82-5983-4ab3-baf5-1d401a3e4ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:00:40.302791 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72beea82-5983-4ab3-baf5-1d401a3e4ccf admin admin] PATH_INFO: `/v3/projects/c9007646c738451aaebc5817087ec60f` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:00:40.303965 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72beea82-5983-4ab3-baf5-1d401a3e4ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9007646c738451aaebc5817087ec60f)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:00:40.305894 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72beea82-5983-4ab3-baf5-1d401a3e4ccf admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:00:40.410344 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-72beea82-5983-4ab3-baf5-1d401a3e4ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9007646c738451aaebc5817087ec60f', 'request_id': 'req-72beea82-5983-4ab3-baf5-1d401a3e4ccf'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:00:40.414111 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:00:40.416248 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-72beea82-5983-4ab3-baf5-1d401a3e4ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9007646c738451aaebc5817087ec60f', 'request_id': 'req-72beea82-5983-4ab3-baf5-1d401a3e4ccf'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:00:40.528952 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-72beea82-5983-4ab3-baf5-1d401a3e4ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9007646c738451aaebc5817087ec60f', 'request_id': 'req-72beea82-5983-4ab3-baf5-1d401a3e4ccf'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:00:40.542252 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-72beea82-5983-4ab3-baf5-1d401a3e4ccf admin admin] The token cache is being invalidate because project c9007646c738451aaebc5817087ec60f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:00:40.542541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-72beea82-5983-4ab3-baf5-1d401a3e4ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:00:40.544124 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-72beea82-5983-4ab3-baf5-1d401a3e4ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:00:40.544808 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1447/2894] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 09:00:40 2022] DELETE /identity/v3/projects/c9007646c738451aaebc5817087ec60f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:00:40.548776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5759c-86b8-4f82-bb77-2051c568f8e5 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:00:40.550263 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-7ba5759c-86b8-4f82-bb77-2051c568f8e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:00:40.563960 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba5759c-86b8-4f82-bb77-2051c568f8e5 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:00:40.618436 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5943f-7037-4cf2-a02e-b269dfdbf1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:00:40.619335 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5943f-7037-4cf2-a02e-b269dfdbf1cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:00:40.619619 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5943f-7037-4cf2-a02e-b269dfdbf1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:00:40.619913 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5943f-7037-4cf2-a02e-b269dfdbf1cd admin admin] PATH_INFO: `/v3/users/d0a53a73685b4fc4a329a56b06b04989` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:00:40.635562 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5943f-7037-4cf2-a02e-b269dfdbf1cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0a53a73685b4fc4a329a56b06b04989)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:00:40.638176 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5943f-7037-4cf2-a02e-b269dfdbf1cd admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:00:40.846416 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:00:40.852097 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-0dd5943f-7037-4cf2-a02e-b269dfdbf1cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0a53a73685b4fc4a329a56b06b04989'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:00:40.864519 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-0dd5943f-7037-4cf2-a02e-b269dfdbf1cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0a53a73685b4fc4a329a56b06b04989'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:00:40.871784 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-0dd5943f-7037-4cf2-a02e-b269dfdbf1cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0a53a73685b4fc4a329a56b06b04989'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:00:40.872470 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-0dd5943f-7037-4cf2-a02e-b269dfdbf1cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0a53a73685b4fc4a329a56b06b04989'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:00:40.873079 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-0dd5943f-7037-4cf2-a02e-b269dfdbf1cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0a53a73685b4fc4a329a56b06b04989'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:00:40.922780 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1448/2895] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 09:00:40 2022] DELETE /identity/v3/users/d0a53a73685b4fc4a329a56b06b04989 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:00:41.141981 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72beea82-5983-4ab3-baf5-1d401a3e4ccf admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:00:41.143439 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-72beea82-5983-4ab3-baf5-1d401a3e4ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:00:41.158870 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72beea82-5983-4ab3-baf5-1d401a3e4ccf admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:00:41.216280 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69085e-de93-4b13-9249-f56a574fe4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:00:41.217143 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69085e-de93-4b13-9249-f56a574fe4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:00:41.217424 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69085e-de93-4b13-9249-f56a574fe4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:00:41.217727 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69085e-de93-4b13-9249-f56a574fe4bf admin admin] PATH_INFO: `/v3/projects/d6474ba2c46b4b08b4f5840791d5a187` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:00:41.227804 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69085e-de93-4b13-9249-f56a574fe4bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6474ba2c46b4b08b4f5840791d5a187)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:00:41.229728 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69085e-de93-4b13-9249-f56a574fe4bf admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:00:41.322711 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-1b69085e-de93-4b13-9249-f56a574fe4bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6474ba2c46b4b08b4f5840791d5a187', 'request_id': 'req-1b69085e-de93-4b13-9249-f56a574fe4bf'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:00:41.328316 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-1b69085e-de93-4b13-9249-f56a574fe4bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6474ba2c46b4b08b4f5840791d5a187', 'request_id': 'req-1b69085e-de93-4b13-9249-f56a574fe4bf'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:00:41.392639 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-1b69085e-de93-4b13-9249-f56a574fe4bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6474ba2c46b4b08b4f5840791d5a187', 'request_id': 'req-1b69085e-de93-4b13-9249-f56a574fe4bf'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:00:41.404687 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-1b69085e-de93-4b13-9249-f56a574fe4bf admin admin] The token cache is being invalidate because project d6474ba2c46b4b08b4f5840791d5a187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:00:41.404974 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-1b69085e-de93-4b13-9249-f56a574fe4bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:00:41.405621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-1b69085e-de93-4b13-9249-f56a574fe4bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:00:41.407145 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1448/2896] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 09:00:41 2022] DELETE /identity/v3/projects/d6474ba2c46b4b08b4f5840791d5a187 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:00:50.974902 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:DELETE=5,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:00:51.401178 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:DELETE=9,keystone:SELECT=60,keystone:INSERT=2 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:01:45.242634 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5943f-7037-4cf2-a02e-b269dfdbf1cd admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:01:45.244080 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-0dd5943f-7037-4cf2-a02e-b269dfdbf1cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:01:45.313090 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5943f-7037-4cf2-a02e-b269dfdbf1cd admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:01:45.371587 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f7b09-b6fc-45e3-9d50-3593e05f1081 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38b7e84d6a43efbb4c1a52e2b3e681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:01:45.372236 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f7b09-b6fc-45e3-9d50-3593e05f1081 service placement] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:01:45.372523 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f7b09-b6fc-45e3-9d50-3593e05f1081 service placement] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:01:45.372800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f7b09-b6fc-45e3-9d50-3593e05f1081 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:01:45.374852 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5f4f7b09-b6fc-45e3-9d50-3593e05f1081 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:01:45.385945 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f7b09-b6fc-45e3-9d50-3593e05f1081 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:01:45.387522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f7b09-b6fc-45e3-9d50-3593e05f1081 service placement] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:01:45.397867 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1449/2897] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:01:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:01:55.393600 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=58 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:23.177122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69085e-de93-4b13-9249-f56a574fe4bf admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:23.178538 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-1b69085e-de93-4b13-9249-f56a574fe4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:23.247338 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69085e-de93-4b13-9249-f56a574fe4bf admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:23.251176 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482ed69-b3c6-4a54-96eb-2fae81843dad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:23.251826 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482ed69-b3c6-4a54-96eb-2fae81843dad service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:23.252112 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482ed69-b3c6-4a54-96eb-2fae81843dad service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:23.252392 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482ed69-b3c6-4a54-96eb-2fae81843dad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:23.254220 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-0482ed69-b3c6-4a54-96eb-2fae81843dad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:23.327590 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482ed69-b3c6-4a54-96eb-2fae81843dad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:02:23.329023 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482ed69-b3c6-4a54-96eb-2fae81843dad service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:02:23.337753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1449/2898] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:02:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:02:33.333798 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=58 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:02:44.348647 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f7b09-b6fc-45e3-9d50-3593e05f1081 service placement] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:02:44.350089 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-5f4f7b09-b6fc-45e3-9d50-3593e05f1081 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:44.361878 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f7b09-b6fc-45e3-9d50-3593e05f1081 service placement] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:02:44.365718 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267bfaa-c787-42a7-b20f-2ff10edfcb13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:02:44.366353 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267bfaa-c787-42a7-b20f-2ff10edfcb13 service cinder] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:02:44.366638 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267bfaa-c787-42a7-b20f-2ff10edfcb13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:02:44.366918 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267bfaa-c787-42a7-b20f-2ff10edfcb13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:02:44.368618 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e267bfaa-c787-42a7-b20f-2ff10edfcb13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:02:44.396404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application [None req-e267bfaa-c787-42a7-b20f-2ff10edfcb13 service cinder] Could not find project: c9007646c738451aaebc5817087ec60f.: keystone.exception.ProjectNotFound: Could not find project: c9007646c738451aaebc5817087ec60f. Jul 21 09:02:44.396404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 09:02:44.396404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 09:02:44.396404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 09:02:44.396404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 09:02:44.396404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 09:02:44.396404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 09:02:44.396404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 09:02:44.396404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 09:02:44.396404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 09:02:44.396404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 09:02:44.396404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 09:02:44.396404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jul 21 09:02:44.396404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jul 21 09:02:44.396404 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 21 09:02:44.397853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 21 09:02:44.397853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 21 09:02:44.397853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 21 09:02:44.397853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:02:44.397853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:02:44.397853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jul 21 09:02:44.397853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jul 21 09:02:44.397853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:02:44.397853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:02:44.397853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:02:44.397853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:02:44.397853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:02:44.397853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 09:02:44.397853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:02:44.397853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:02:44.397853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:02:44.397853 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:02:44.399334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:02:44.399334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:02:44.399334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:02:44.399334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:02:44.399334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jul 21 09:02:44.399334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jul 21 09:02:44.399334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jul 21 09:02:44.399334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self._validate_token_resources() Jul 21 09:02:44.399334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jul 21 09:02:44.399334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jul 21 09:02:44.399334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jul 21 09:02:44.399334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jul 21 09:02:44.399334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 09:02:44.399334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 09:02:44.399334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 09:02:44.399334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 09:02:44.399334 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 09:02:44.400959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 09:02:44.400959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 09:02:44.400959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application with Lock( Jul 21 09:02:44.400959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 09:02:44.400959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._enter() Jul 21 09:02:44.400959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 09:02:44.400959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 09:02:44.400959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 09:02:44.400959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.creator() Jul 21 09:02:44.400959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 09:02:44.400959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application created_value = creator( Jul 21 09:02:44.400959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 09:02:44.400959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 09:02:44.400959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 09:02:44.400959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 09:02:44.400959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 09:02:44.400959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 09:02:44.402429 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c9007646c738451aaebc5817087ec60f. Jul 21 09:02:44.402429 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: ERROR keystone.server.flask.application Jul 21 09:02:44.402429 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1450/2899] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:02:44 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 21 09:02:54.372040 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=4 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:03:41.968209 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482ed69-b3c6-4a54-96eb-2fae81843dad service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:03:41.969836 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-0482ed69-b3c6-4a54-96eb-2fae81843dad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:42.028755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482ed69-b3c6-4a54-96eb-2fae81843dad service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:03:42.032521 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6797c23-2a5d-49d1-8052-13b863bf65d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:03:42.033166 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6797c23-2a5d-49d1-8052-13b863bf65d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:03:42.033494 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6797c23-2a5d-49d1-8052-13b863bf65d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:03:42.033814 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6797c23-2a5d-49d1-8052-13b863bf65d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:03:42.035559 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-d6797c23-2a5d-49d1-8052-13b863bf65d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:03:42.045018 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6797c23-2a5d-49d1-8052-13b863bf65d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:03:42.046514 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6797c23-2a5d-49d1-8052-13b863bf65d7 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:03:42.054515 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1450/2900] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:03:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:03:52.050895 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=26 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:23.701541 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267bfaa-c787-42a7-b20f-2ff10edfcb13 service cinder] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:23.703028 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e267bfaa-c787-42a7-b20f-2ff10edfcb13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:23.715675 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267bfaa-c787-42a7-b20f-2ff10edfcb13 service cinder] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:23.719322 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ed957-a825-4ba0-96bd-7c8d367c0d84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:23.719954 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ed957-a825-4ba0-96bd-7c8d367c0d84 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:23.720240 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ed957-a825-4ba0-96bd-7c8d367c0d84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:23.720518 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ed957-a825-4ba0-96bd-7c8d367c0d84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:23.722298 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b20ed957-a825-4ba0-96bd-7c8d367c0d84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:23.796962 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ed957-a825-4ba0-96bd-7c8d367c0d84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:23.798480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ed957-a825-4ba0-96bd-7c8d367c0d84 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:23.809889 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1451/2901] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:04:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:04:24.981919 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6797c23-2a5d-49d1-8052-13b863bf65d7 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:24.990872 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6797c23-2a5d-49d1-8052-13b863bf65d7 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:24.994464 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4028066-afc2-44a7-b9f4-4c8b20eff34b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:24.995091 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4028066-afc2-44a7-b9f4-4c8b20eff34b service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:24.995372 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4028066-afc2-44a7-b9f4-4c8b20eff34b service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:24.995649 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4028066-afc2-44a7-b9f4-4c8b20eff34b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:24.997460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f4028066-afc2-44a7-b9f4-4c8b20eff34b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:25.010792 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4028066-afc2-44a7-b9f4-4c8b20eff34b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:25.012821 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4028066-afc2-44a7-b9f4-4c8b20eff34b service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:25.023723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1451/2902] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:04:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:04:33.804703 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=34 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:35.018922 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=6 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:44.054682 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ed957-a825-4ba0-96bd-7c8d367c0d84 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:44.063878 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ed957-a825-4ba0-96bd-7c8d367c0d84 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:44.067672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af7879-f4fe-4c0f-99b8-51d8e59da418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:44.068378 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af7879-f4fe-4c0f-99b8-51d8e59da418 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:44.068667 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af7879-f4fe-4c0f-99b8-51d8e59da418 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:44.069018 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af7879-f4fe-4c0f-99b8-51d8e59da418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:44.070840 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-b4af7879-f4fe-4c0f-99b8-51d8e59da418 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:44.136152 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af7879-f4fe-4c0f-99b8-51d8e59da418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:44.137623 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4af7879-f4fe-4c0f-99b8-51d8e59da418 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:44.147540 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1452/2903] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:04:51.376713 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4028066-afc2-44a7-b9f4-4c8b20eff34b service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:51.383723 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f4028066-afc2-44a7-b9f4-4c8b20eff34b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:51.393621 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4028066-afc2-44a7-b9f4-4c8b20eff34b service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:51.398288 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4170ef-cd4e-45c6-9a1d-bc8e7632bcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:51.399168 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4170ef-cd4e-45c6-9a1d-bc8e7632bcf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:51.399434 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4170ef-cd4e-45c6-9a1d-bc8e7632bcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:51.399707 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4170ef-cd4e-45c6-9a1d-bc8e7632bcf9 admin admin] PATH_INFO: `/v3/users/99f3fb6b49934fa6baa5b16b22528f1d` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:51.400917 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4170ef-cd4e-45c6-9a1d-bc8e7632bcf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99f3fb6b49934fa6baa5b16b22528f1d)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:51.403170 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4170ef-cd4e-45c6-9a1d-bc8e7632bcf9 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:51.578999 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-8a4170ef-cd4e-45c6-9a1d-bc8e7632bcf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99f3fb6b49934fa6baa5b16b22528f1d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:04:51.591045 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-8a4170ef-cd4e-45c6-9a1d-bc8e7632bcf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99f3fb6b49934fa6baa5b16b22528f1d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:04:51.597812 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-8a4170ef-cd4e-45c6-9a1d-bc8e7632bcf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99f3fb6b49934fa6baa5b16b22528f1d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:04:51.598476 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-8a4170ef-cd4e-45c6-9a1d-bc8e7632bcf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99f3fb6b49934fa6baa5b16b22528f1d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:04:51.599101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-8a4170ef-cd4e-45c6-9a1d-bc8e7632bcf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99f3fb6b49934fa6baa5b16b22528f1d'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:04:51.689747 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1452/2904] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 09:04:51 2022] DELETE /identity/v3/users/99f3fb6b49934fa6baa5b16b22528f1d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:04:51.944326 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af7879-f4fe-4c0f-99b8-51d8e59da418 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:51.955184 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af7879-f4fe-4c0f-99b8-51d8e59da418 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:52.014017 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6412fb-49d0-4f0c-806c-5d5a15a031eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:52.014880 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6412fb-49d0-4f0c-806c-5d5a15a031eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:52.015163 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6412fb-49d0-4f0c-806c-5d5a15a031eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:52.015457 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6412fb-49d0-4f0c-806c-5d5a15a031eb admin admin] PATH_INFO: `/v3/projects/99cd7b7979214fe380423b7b52e05e59` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:52.026322 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6412fb-49d0-4f0c-806c-5d5a15a031eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=99cd7b7979214fe380423b7b52e05e59)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:52.028421 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6412fb-49d0-4f0c-806c-5d5a15a031eb admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:52.121792 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6b6412fb-49d0-4f0c-806c-5d5a15a031eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99cd7b7979214fe380423b7b52e05e59', 'request_id': 'req-6b6412fb-49d0-4f0c-806c-5d5a15a031eb'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:04:52.128813 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6b6412fb-49d0-4f0c-806c-5d5a15a031eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99cd7b7979214fe380423b7b52e05e59', 'request_id': 'req-6b6412fb-49d0-4f0c-806c-5d5a15a031eb'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:04:52.137282 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6b6412fb-49d0-4f0c-806c-5d5a15a031eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99cd7b7979214fe380423b7b52e05e59', 'request_id': 'req-6b6412fb-49d0-4f0c-806c-5d5a15a031eb'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:04:52.193248 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6b6412fb-49d0-4f0c-806c-5d5a15a031eb admin admin] The token cache is being invalidate because project 99cd7b7979214fe380423b7b52e05e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:04:52.193480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6b6412fb-49d0-4f0c-806c-5d5a15a031eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:04:52.194690 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-6b6412fb-49d0-4f0c-806c-5d5a15a031eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:04:52.196329 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1453/2905] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 09:04:51 2022] DELETE /identity/v3/projects/99cd7b7979214fe380423b7b52e05e59 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:04:52.200359 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4170ef-cd4e-45c6-9a1d-bc8e7632bcf9 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:52.201844 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-8a4170ef-cd4e-45c6-9a1d-bc8e7632bcf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:52.216005 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4170ef-cd4e-45c6-9a1d-bc8e7632bcf9 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:52.272312 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080036a8-02fa-4eed-bb5f-2171b1293b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:52.273176 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080036a8-02fa-4eed-bb5f-2171b1293b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:52.273460 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080036a8-02fa-4eed-bb5f-2171b1293b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:52.273763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080036a8-02fa-4eed-bb5f-2171b1293b04 admin admin] PATH_INFO: `/v3/users/47290b6fa0554100b57ff26522c52d73` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:52.288419 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080036a8-02fa-4eed-bb5f-2171b1293b04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47290b6fa0554100b57ff26522c52d73)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:52.290403 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080036a8-02fa-4eed-bb5f-2171b1293b04 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:52.473766 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-080036a8-02fa-4eed-bb5f-2171b1293b04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47290b6fa0554100b57ff26522c52d73'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:04:52.485229 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:52.486442 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-080036a8-02fa-4eed-bb5f-2171b1293b04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47290b6fa0554100b57ff26522c52d73'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:04:52.493519 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-080036a8-02fa-4eed-bb5f-2171b1293b04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47290b6fa0554100b57ff26522c52d73'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:04:52.494222 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-080036a8-02fa-4eed-bb5f-2171b1293b04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47290b6fa0554100b57ff26522c52d73'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:04:52.494833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-080036a8-02fa-4eed-bb5f-2171b1293b04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47290b6fa0554100b57ff26522c52d73'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:04:52.556885 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1453/2906] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 09:04:52 2022] DELETE /identity/v3/users/47290b6fa0554100b57ff26522c52d73 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:04:52.801220 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6412fb-49d0-4f0c-806c-5d5a15a031eb admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:04:52.802740 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-6b6412fb-49d0-4f0c-806c-5d5a15a031eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:04:52.816252 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6412fb-49d0-4f0c-806c-5d5a15a031eb admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:04:52.829767 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:04:52.878796 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac6021-072e-4372-9273-b850aca881b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:04:52.879666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac6021-072e-4372-9273-b850aca881b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:04:52.879948 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac6021-072e-4372-9273-b850aca881b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:04:52.880225 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac6021-072e-4372-9273-b850aca881b1 admin admin] PATH_INFO: `/v3/projects/65e64862e9ef4a79b89322c97933dabb` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:04:52.891297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac6021-072e-4372-9273-b850aca881b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65e64862e9ef4a79b89322c97933dabb)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:04:52.893247 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac6021-072e-4372-9273-b850aca881b1 admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:04:52.976607 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-36ac6021-072e-4372-9273-b850aca881b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65e64862e9ef4a79b89322c97933dabb', 'request_id': 'req-36ac6021-072e-4372-9273-b850aca881b1'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:04:52.983098 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-36ac6021-072e-4372-9273-b850aca881b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65e64862e9ef4a79b89322c97933dabb', 'request_id': 'req-36ac6021-072e-4372-9273-b850aca881b1'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:04:52.988779 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-36ac6021-072e-4372-9273-b850aca881b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65e64862e9ef4a79b89322c97933dabb', 'request_id': 'req-36ac6021-072e-4372-9273-b850aca881b1'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:04:53.044110 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-36ac6021-072e-4372-9273-b850aca881b1 admin admin] The token cache is being invalidate because project 65e64862e9ef4a79b89322c97933dabb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80262) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:04:53.044336 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-36ac6021-072e-4372-9273-b850aca881b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:04:53.045062 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-36ac6021-072e-4372-9273-b850aca881b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:04:53.046686 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1454/2907] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 09:04:52 2022] DELETE /identity/v3/projects/65e64862e9ef4a79b89322c97933dabb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:05:02.603210 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=7,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:05:03.040933 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:06:48.338716 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080036a8-02fa-4eed-bb5f-2171b1293b04 admin admin] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:06:48.340121 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-080036a8-02fa-4eed-bb5f-2171b1293b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:06:48.476398 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080036a8-02fa-4eed-bb5f-2171b1293b04 admin admin] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:06:48.533500 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa620b-0390-4049-a4f6-af29a8a8337c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38b7e84d6a43efbb4c1a52e2b3e681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:06:48.534171 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa620b-0390-4049-a4f6-af29a8a8337c service placement] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:06:48.534455 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa620b-0390-4049-a4f6-af29a8a8337c service placement] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:06:48.534731 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa620b-0390-4049-a4f6-af29a8a8337c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:06:48.536514 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f2fa620b-0390-4049-a4f6-af29a8a8337c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:06:48.548052 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa620b-0390-4049-a4f6-af29a8a8337c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:06:48.549674 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa620b-0390-4049-a4f6-af29a8a8337c service placement] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:06:48.559900 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1454/2908] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:06:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:06:58.555106 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=89 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:07:23.554187 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac6021-072e-4372-9273-b850aca881b1 admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:07:23.555692 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-36ac6021-072e-4372-9273-b850aca881b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:07:23.665801 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac6021-072e-4372-9273-b850aca881b1 admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:07:23.671915 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14df7d3-b3e7-41ea-a368-1935eb06e01d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:07:23.672558 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14df7d3-b3e7-41ea-a368-1935eb06e01d service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:07:23.672844 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14df7d3-b3e7-41ea-a368-1935eb06e01d service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:07:23.673124 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14df7d3-b3e7-41ea-a368-1935eb06e01d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:07:23.674914 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-a14df7d3-b3e7-41ea-a368-1935eb06e01d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:07:23.740817 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14df7d3-b3e7-41ea-a368-1935eb06e01d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:07:23.742480 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14df7d3-b3e7-41ea-a368-1935eb06e01d service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:07:23.762890 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1455/2909] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:07:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:07:33.759105 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=82 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:08:25.010458 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa620b-0390-4049-a4f6-af29a8a8337c service placement] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:08:25.011979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f2fa620b-0390-4049-a4f6-af29a8a8337c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:08:25.040208 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa620b-0390-4049-a4f6-af29a8a8337c service placement] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:08:25.045562 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4c6ac-9eb3-4e3a-a7d5-c6389dde018b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:08:25.046209 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4c6ac-9eb3-4e3a-a7d5-c6389dde018b service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:08:25.046492 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4c6ac-9eb3-4e3a-a7d5-c6389dde018b service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:08:25.046771 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4c6ac-9eb3-4e3a-a7d5-c6389dde018b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:08:25.048522 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9ec4c6ac-9eb3-4e3a-a7d5-c6389dde018b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:08:25.060507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4c6ac-9eb3-4e3a-a7d5-c6389dde018b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:08:25.062122 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4c6ac-9eb3-4e3a-a7d5-c6389dde018b service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:08:25.072749 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1455/2910] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:08:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:08:35.068304 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=11 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:09:24.076656 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14df7d3-b3e7-41ea-a368-1935eb06e01d service nova] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:09:24.078148 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-a14df7d3-b3e7-41ea-a368-1935eb06e01d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:09:24.155736 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14df7d3-b3e7-41ea-a368-1935eb06e01d service nova] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:09:24.159303 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04dcaa-803d-43e2-b925-b0263c31e034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:09:24.159940 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04dcaa-803d-43e2-b925-b0263c31e034 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:09:24.160220 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04dcaa-803d-43e2-b925-b0263c31e034 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:09:24.160490 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04dcaa-803d-43e2-b925-b0263c31e034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:09:24.162220 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-1a04dcaa-803d-43e2-b925-b0263c31e034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:09:24.175736 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04dcaa-803d-43e2-b925-b0263c31e034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:09:24.177152 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04dcaa-803d-43e2-b925-b0263c31e034 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:09:24.188674 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1456/2911] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:09:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:09:25.291231 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4c6ac-9eb3-4e3a-a7d5-c6389dde018b service nova] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:09:25.292628 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9ec4c6ac-9eb3-4e3a-a7d5-c6389dde018b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:09:25.303977 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4c6ac-9eb3-4e3a-a7d5-c6389dde018b service nova] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:09:25.307594 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361c895-5e48-4198-bf25-ad2b047be8c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:09:25.308225 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361c895-5e48-4198-bf25-ad2b047be8c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:09:25.308508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361c895-5e48-4198-bf25-ad2b047be8c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:09:25.308782 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361c895-5e48-4198-bf25-ad2b047be8c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:09:25.311271 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f361c895-5e48-4198-bf25-ad2b047be8c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:09:25.324602 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361c895-5e48-4198-bf25-ad2b047be8c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:09:25.326753 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361c895-5e48-4198-bf25-ad2b047be8c0 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:09:25.337446 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1456/2912] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:09:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:09:34.182968 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=35 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:09:35.332601 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=6 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:11:50.252207 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04dcaa-803d-43e2-b925-b0263c31e034 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:11:50.253657 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-1a04dcaa-803d-43e2-b925-b0263c31e034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:11:50.268133 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04dcaa-803d-43e2-b925-b0263c31e034 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:11:50.273041 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0478d1-01c2-4202-985c-69afdbd291c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38b7e84d6a43efbb4c1a52e2b3e681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:11:50.273727 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0478d1-01c2-4202-985c-69afdbd291c1 service placement] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:11:50.274013 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0478d1-01c2-4202-985c-69afdbd291c1 service placement] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:11:50.274294 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0478d1-01c2-4202-985c-69afdbd291c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:11:50.282841 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0478d1-01c2-4202-985c-69afdbd291c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:11:50.284418 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0478d1-01c2-4202-985c-69afdbd291c1 service placement] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:11:50.294536 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1457/2913] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:11:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:12:00.290085 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=6 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:12:24.202728 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361c895-5e48-4198-bf25-ad2b047be8c0 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:12:24.204121 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-f361c895-5e48-4198-bf25-ad2b047be8c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:12:24.280962 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361c895-5e48-4198-bf25-ad2b047be8c0 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:12:24.284585 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429442f-2335-4c6b-a162-de47a19350ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:12:24.285226 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429442f-2335-4c6b-a162-de47a19350ed service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:12:24.285549 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429442f-2335-4c6b-a162-de47a19350ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:12:24.285833 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d429442f-2335-4c6b-a162-de47a19350ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:12:24.294257 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429442f-2335-4c6b-a162-de47a19350ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:12:24.315308 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d429442f-2335-4c6b-a162-de47a19350ed service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:12:24.315308 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1457/2914] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:12:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:12:34.300541 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=35 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:16:58.231646 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0478d1-01c2-4202-985c-69afdbd291c1 service placement] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:16:58.233051 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-ee0478d1-01c2-4202-985c-69afdbd291c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:58.347604 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0478d1-01c2-4202-985c-69afdbd291c1 service placement] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:16:58.352723 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9df6e-a77a-457c-ac99-59591fa80a86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38b7e84d6a43efbb4c1a52e2b3e681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:16:58.353368 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9df6e-a77a-457c-ac99-59591fa80a86 service placement] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:16:58.353687 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9df6e-a77a-457c-ac99-59591fa80a86 service placement] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:16:58.353972 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9df6e-a77a-457c-ac99-59591fa80a86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:16:58.355843 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-0ca9df6e-a77a-457c-ac99-59591fa80a86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:16:58.367586 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9df6e-a77a-457c-ac99-59591fa80a86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:16:58.369176 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9df6e-a77a-457c-ac99-59591fa80a86 service placement] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:16:58.379529 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1458/2915] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:16:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:17:08.375695 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=52 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:17:24.805816 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429442f-2335-4c6b-a162-de47a19350ed service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:17:24.807214 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-d429442f-2335-4c6b-a162-de47a19350ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:17:24.828807 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d429442f-2335-4c6b-a162-de47a19350ed service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:17:24.832461 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cf4fc-e890-4c6c-9676-6aa21c106b26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aebefbc2dc0244d8a5ae7d88be6b63ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:17:24.833089 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cf4fc-e890-4c6c-9676-6aa21c106b26 service cinder] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:17:24.833370 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cf4fc-e890-4c6c-9676-6aa21c106b26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:17:24.833678 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cf4fc-e890-4c6c-9676-6aa21c106b26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:17:24.835489 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-555cf4fc-e890-4c6c-9676-6aa21c106b26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:17:24.925278 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cf4fc-e890-4c6c-9676-6aa21c106b26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:17:24.926751 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555cf4fc-e890-4c6c-9676-6aa21c106b26 service cinder] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:17:24.944801 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1458/2916] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:17:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:17:34.942327 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=52 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:18:27.626786 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13b93d-11a6-4d61-b142-497caf0eea9f None None] REQUEST_METHOD: `POST` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:27.632039 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13b93d-11a6-4d61-b142-497caf0eea9f None None] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:27.632039 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13b93d-11a6-4d61-b142-497caf0eea9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:27.657056 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.auth.core [None req-fa13b93d-11a6-4d61-b142-497caf0eea9f None None] MFA Rules not processed for user `b1669ec3a65f45f3b00f02a170252331`. Rule list: `[]` (Enabled: `True`). {{(pid=80262) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 09:18:27.658838 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-fa13b93d-11a6-4d61-b142-497caf0eea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:27.665752 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1459/2917] 10.222.0.57 () {58 vars in 957 bytes} [Thu Jul 21 09:18:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 09:18:27.704491 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cf4fc-e890-4c6c-9676-6aa21c106b26 service cinder] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:18:27.706469 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-555cf4fc-e890-4c6c-9676-6aa21c106b26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:27.794890 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cf4fc-e890-4c6c-9676-6aa21c106b26 service cinder] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:18:27.798570 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7511c7a-d0b6-4024-b95d-463ac00d8512 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2b27a4861d6b4ddfaca1a97efdaf008d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:18:27.799205 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7511c7a-d0b6-4024-b95d-463ac00d8512 service glance] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:27.799484 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7511c7a-d0b6-4024-b95d-463ac00d8512 service glance] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:27.799756 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7511c7a-d0b6-4024-b95d-463ac00d8512 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:27.881336 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7511c7a-d0b6-4024-b95d-463ac00d8512 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:18:27.882829 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7511c7a-d0b6-4024-b95d-463ac00d8512 service glance] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:18:27.903821 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1459/2918] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:18:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:18:28.108105 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13b93d-11a6-4d61-b142-497caf0eea9f None None] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:18:28.118212 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13b93d-11a6-4d61-b142-497caf0eea9f None None] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:18:28.121800 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce8ebc-f5db-4f30-a51f-681211b800ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:18:28.122467 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce8ebc-f5db-4f30-a51f-681211b800ab service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:28.122748 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce8ebc-f5db-4f30-a51f-681211b800ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:28.123024 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce8ebc-f5db-4f30-a51f-681211b800ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:28.125299 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-97ce8ebc-f5db-4f30-a51f-681211b800ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:28.135064 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce8ebc-f5db-4f30-a51f-681211b800ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:18:28.136585 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce8ebc-f5db-4f30-a51f-681211b800ab service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:18:28.145612 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1460/2919] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:18:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:18:28.586857 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7511c7a-d0b6-4024-b95d-463ac00d8512 service glance] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:18:28.593701 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce8ebc-f5db-4f30-a51f-681211b800ab service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:18:28.598586 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7511c7a-d0b6-4024-b95d-463ac00d8512 service glance] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:18:28.602481 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce8ebc-f5db-4f30-a51f-681211b800ab service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:18:28.603539 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2edad-9d84-479f-aaae-eff0caba3144 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38b7e84d6a43efbb4c1a52e2b3e681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:18:28.604175 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2edad-9d84-479f-aaae-eff0caba3144 service placement] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:28.604455 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2edad-9d84-479f-aaae-eff0caba3144 service placement] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:28.604728 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2edad-9d84-479f-aaae-eff0caba3144 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:28.606079 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4514adb-7646-4784-a5f3-b99bf4d007a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:18:28.606531 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-fbf2edad-9d84-479f-aaae-eff0caba3144 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:28.606714 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4514adb-7646-4784-a5f3-b99bf4d007a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:28.606998 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4514adb-7646-4784-a5f3-b99bf4d007a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:28.607303 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4514adb-7646-4784-a5f3-b99bf4d007a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:28.618634 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4514adb-7646-4784-a5f3-b99bf4d007a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:18:28.619980 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2edad-9d84-479f-aaae-eff0caba3144 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:18:28.620114 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4514adb-7646-4784-a5f3-b99bf4d007a0 service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:18:28.621104 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2edad-9d84-479f-aaae-eff0caba3144 service placement] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:18:28.631907 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1460/2920] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:18:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:18:28.632100 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1461/2921] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:18:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 09:18:31.414530 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2edad-9d84-479f-aaae-eff0caba3144 service placement] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:18:31.424564 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2edad-9d84-479f-aaae-eff0caba3144 service placement] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:18:31.428330 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0e0d2-e9b3-499b-a046-ea8238110b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:18:31.428960 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0e0d2-e9b3-499b-a046-ea8238110b25 service neutron] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:31.429245 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0e0d2-e9b3-499b-a046-ea8238110b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:31.429519 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0e0d2-e9b3-499b-a046-ea8238110b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:31.431318 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9cc0e0d2-e9b3-499b-a046-ea8238110b25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:31.441368 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0e0d2-e9b3-499b-a046-ea8238110b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:18:31.442839 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0e0d2-e9b3-499b-a046-ea8238110b25 service neutron] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:18:31.450979 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1461/2922] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:18:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:18:32.241831 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4514adb-7646-4784-a5f3-b99bf4d007a0 service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:18:32.243415 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-e4514adb-7646-4784-a5f3-b99bf4d007a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:32.272672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4514adb-7646-4784-a5f3-b99bf4d007a0 service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:18:32.278825 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760a908-bd00-4016-843a-739369ed36b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:18:32.282929 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760a908-bd00-4016-843a-739369ed36b9 service nova] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:32.282929 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760a908-bd00-4016-843a-739369ed36b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:32.282929 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760a908-bd00-4016-843a-739369ed36b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:32.282929 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-1760a908-bd00-4016-843a-739369ed36b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:32.294672 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760a908-bd00-4016-843a-739369ed36b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:18:32.296256 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760a908-bd00-4016-843a-739369ed36b9 service nova] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:18:32.308206 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1462/2923] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:18:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:18:37.239755 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0e0d2-e9b3-499b-a046-ea8238110b25 service neutron] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:18:37.241772 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-9cc0e0d2-e9b3-499b-a046-ea8238110b25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:37.257507 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0e0d2-e9b3-499b-a046-ea8238110b25 service neutron] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:18:37.263110 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6c683-1e59-46e1-ac37-c0b84ede6cfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6670a010c034f7999c9445452c02473', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:18:37.263785 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6c683-1e59-46e1-ac37-c0b84ede6cfd service nova] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:18:37.264101 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6c683-1e59-46e1-ac37-c0b84ede6cfd service nova] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:18:37.264414 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6c683-1e59-46e1-ac37-c0b84ede6cfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:18:37.266183 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-01d6c683-1e59-46e1-ac37-c0b84ede6cfd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:18:37.278745 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6c683-1e59-46e1-ac37-c0b84ede6cfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:18:37.280328 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d6c683-1e59-46e1-ac37-c0b84ede6cfd service nova] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:18:37.291571 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1462/2924] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:18:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:18:42.302949 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=29 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:18:47.286989 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=91 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:19:33.816596 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760a908-bd00-4016-843a-739369ed36b9 service nova] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:19:33.818225 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-1760a908-bd00-4016-843a-739369ed36b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:19:33.895643 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760a908-bd00-4016-843a-739369ed36b9 service nova] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:19:33.899271 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a007310-db2f-4d3c-a6cf-9d0a230188ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a25749f3a7c84c50b860538d1b661901', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:19:33.900491 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a007310-db2f-4d3c-a6cf-9d0a230188ba service neutron] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:19:33.900776 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a007310-db2f-4d3c-a6cf-9d0a230188ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:19:33.901048 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a007310-db2f-4d3c-a6cf-9d0a230188ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:19:33.902959 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-8a007310-db2f-4d3c-a6cf-9d0a230188ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:19:33.986214 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a007310-db2f-4d3c-a6cf-9d0a230188ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:19:33.987666 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a007310-db2f-4d3c-a6cf-9d0a230188ba service neutron] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:19:34.006438 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1463/2925] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:19:34.513712 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6c683-1e59-46e1-ac37-c0b84ede6cfd service nova] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:19:34.525254 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6c683-1e59-46e1-ac37-c0b84ede6cfd service nova] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:19:34.530387 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b90c4f-d3e7-44e5-b245-81fde3c9d3be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38b7e84d6a43efbb4c1a52e2b3e681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:19:34.531200 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b90c4f-d3e7-44e5-b245-81fde3c9d3be service placement] REQUEST_METHOD: `GET` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:19:34.531484 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b90c4f-d3e7-44e5-b245-81fde3c9d3be service placement] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:19:34.531763 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b90c4f-d3e7-44e5-b245-81fde3c9d3be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:19:34.533743 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.fernet_utils [None req-15b90c4f-d3e7-44e5-b245-81fde3c9d3be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80261) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:19:34.546191 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b90c4f-d3e7-44e5-b245-81fde3c9d3be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:19:34.547873 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b90c4f-d3e7-44e5-b245-81fde3c9d3be service placement] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:19:34.558701 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1463/2926] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:19:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:19:34.617245 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a007310-db2f-4d3c-a6cf-9d0a230188ba service neutron] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:19:34.619388 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-8a007310-db2f-4d3c-a6cf-9d0a230188ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:19:34.631958 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a007310-db2f-4d3c-a6cf-9d0a230188ba service neutron] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:19:34.636582 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c44fb-254f-40fd-b6af-a3920b23cbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:19:34.637493 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c44fb-254f-40fd-b6af-a3920b23cbce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:19:34.637807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c44fb-254f-40fd-b6af-a3920b23cbce admin admin] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:19:34.638087 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c44fb-254f-40fd-b6af-a3920b23cbce admin admin] PATH_INFO: `/v3/users/b1669ec3a65f45f3b00f02a170252331` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:19:34.639262 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c44fb-254f-40fd-b6af-a3920b23cbce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1669ec3a65f45f3b00f02a170252331)` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:19:34.641189 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8c44fb-254f-40fd-b6af-a3920b23cbce admin admin] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:19:34.836522 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-8b8c44fb-254f-40fd-b6af-a3920b23cbce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1669ec3a65f45f3b00f02a170252331'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:19:34.843535 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:19:34.848807 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-8b8c44fb-254f-40fd-b6af-a3920b23cbce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1669ec3a65f45f3b00f02a170252331'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:19:34.856067 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-8b8c44fb-254f-40fd-b6af-a3920b23cbce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1669ec3a65f45f3b00f02a170252331'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:19:34.856736 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-8b8c44fb-254f-40fd-b6af-a3920b23cbce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1669ec3a65f45f3b00f02a170252331'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:19:34.857340 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.notifications [None req-8b8c44fb-254f-40fd-b6af-a3920b23cbce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1669ec3a65f45f3b00f02a170252331'} {{(pid=80262) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:19:34.937271 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1464/2927] 10.222.0.57 () {58 vars in 1223 bytes} [Thu Jul 21 09:19:34 2022] DELETE /identity/v3/users/b1669ec3a65f45f3b00f02a170252331 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:19:35.174530 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b90c4f-d3e7-44e5-b245-81fde3c9d3be service placement] Authenticating user token {{(pid=80261) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:19:35.185256 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b90c4f-d3e7-44e5-b245-81fde3c9d3be service placement] Validating token access rules against request {{(pid=80261) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:19:35.246840 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82bafd-f558-4bfe-b72c-1bbd8747e377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1854e64df6074ad496a8d7112fa61f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '735f219fa6204590a96733afe606902c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80261) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:19:35.247701 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82bafd-f558-4bfe-b72c-1bbd8747e377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:19:35.247980 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82bafd-f558-4bfe-b72c-1bbd8747e377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:19:35.248251 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82bafd-f558-4bfe-b72c-1bbd8747e377 admin admin] PATH_INFO: `/v3/projects/b93301baf3d44bc29df86e2675607a53` {{(pid=80261) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:19:35.249435 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82bafd-f558-4bfe-b72c-1bbd8747e377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b93301baf3d44bc29df86e2675607a53)` {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:19:35.251358 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82bafd-f558-4bfe-b72c-1bbd8747e377 admin admin] RBAC: Authorization granted {{(pid=80261) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:19:35.349047 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9d82bafd-f558-4bfe-b72c-1bbd8747e377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b93301baf3d44bc29df86e2675607a53', 'request_id': 'req-9d82bafd-f558-4bfe-b72c-1bbd8747e377'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:19:35.354508 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9d82bafd-f558-4bfe-b72c-1bbd8747e377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b93301baf3d44bc29df86e2675607a53', 'request_id': 'req-9d82bafd-f558-4bfe-b72c-1bbd8747e377'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:19:35.415984 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9d82bafd-f558-4bfe-b72c-1bbd8747e377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b93301baf3d44bc29df86e2675607a53', 'request_id': 'req-9d82bafd-f558-4bfe-b72c-1bbd8747e377'} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:19:35.426987 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9d82bafd-f558-4bfe-b72c-1bbd8747e377 admin admin] The token cache is being invalidate because project b93301baf3d44bc29df86e2675607a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80261) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 09:19:35.427275 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9d82bafd-f558-4bfe-b72c-1bbd8747e377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:19:35.427899 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG keystone.notifications [None req-9d82bafd-f558-4bfe-b72c-1bbd8747e377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80261) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 09:19:35.429453 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: [pid: 80261|app: 0|req: 1464/2928] 10.222.0.57 () {58 vars in 1232 bytes} [Thu Jul 21 09:19:35 2022] DELETE /identity/v3/projects/b93301baf3d44bc29df86e2675607a53 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 09:19:44.942814 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=9,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:19:45.423968 dv-cinder-850318-4-iscsi devstack@keystone.service[80261]: DEBUG dbcounter [-] [80261] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80261) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 09:22:03.186531 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c44fb-254f-40fd-b6af-a3920b23cbce admin admin] Authenticating user token {{(pid=80262) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 09:22:03.187932 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-8b8c44fb-254f-40fd-b6af-a3920b23cbce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:03.255978 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c44fb-254f-40fd-b6af-a3920b23cbce admin admin] Validating token access rules against request {{(pid=80262) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 09:22:03.313423 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7adcfe-aaf7-42ce-bb88-b35570c7d9ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e38b7e84d6a43efbb4c1a52e2b3e681', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83100b3a5d584e39886c234391fdb204', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80262) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 09:22:03.314109 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7adcfe-aaf7-42ce-bb88-b35570c7d9ad service placement] REQUEST_METHOD: `GET` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 09:22:03.314408 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7adcfe-aaf7-42ce-bb88-b35570c7d9ad service placement] SCRIPT_NAME: `/identity` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 09:22:03.314670 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7adcfe-aaf7-42ce-bb88-b35570c7d9ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80262) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 09:22:03.316441 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.fernet_utils [None req-7d7adcfe-aaf7-42ce-bb88-b35570c7d9ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80262) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 09:22:03.327423 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7adcfe-aaf7-42ce-bb88-b35570c7d9ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 09:22:03.328999 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7adcfe-aaf7-42ce-bb88-b35570c7d9ad service placement] RBAC: Authorization granted {{(pid=80262) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 09:22:03.339297 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: [pid: 80262|app: 0|req: 1465/2929] 10.222.0.57 () {60 vars in 1365 bytes} [Thu Jul 21 09:22:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 09:22:13.334814 dv-cinder-850318-4-iscsi devstack@keystone.service[80262]: DEBUG dbcounter [-] [80262] Writing DB stats keystone:SELECT=58 {{(pid=80262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}